-- Logs begin at Wed 2022-06-01 16:45:06 UTC, end at Wed 2022-06-01 18:39:25 UTC. -- Jun 01 17:23:56.814259 dv-cinder-797608-23-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 01 17:23:56.823279 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 01 17:23:56.825329 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 1 17:23:56 2022] *** Jun 01 17:23:56.825329 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 01 17:23:56.825329 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 01 17:23:56.825329 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: nodename: dv-cinder-797608-23-iscsi Jun 01 17:23:56.825329 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: machine: x86_64 Jun 01 17:23:56.825329 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: clock source: unix Jun 01 17:23:56.825329 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: pcre jit disabled Jun 01 17:23:56.825329 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: detected number of CPU cores: 4 Jun 01 17:23:56.825329 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: current working directory: / Jun 01 17:23:56.825329 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: detected binary path: /usr/bin/uwsgi-core Jun 01 17:23:56.825329 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: your processes number limit is 47680 Jun 01 17:23:56.825940 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: your memory page size is 4096 bytes Jun 01 17:23:56.825940 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: detected max file descriptor number: 2048 Jun 01 17:23:56.825940 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: lock engine: pthread robust mutexes Jun 01 17:23:56.825940 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: thunder lock: enabled Jun 01 17:23:56.825940 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 01 17:23:56.825940 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 01 17:23:56.871585 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: Python main interpreter initialized at 0x55d85d9eb9c0 Jun 01 17:23:56.871585 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: python threads support enabled Jun 01 17:23:56.871585 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: your server socket listen backlog is limited to 100 connections Jun 01 17:23:56.871585 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: your mercy for graceful operations on workers is 90 seconds Jun 01 17:23:56.871950 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: mapped 403077 bytes (393 KB) for 2 cores Jun 01 17:23:56.872030 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: *** Operational MODE: preforking *** Jun 01 17:23:56.872271 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: *** uWSGI is running in multiple interpreter mode *** Jun 01 17:23:56.872271 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: spawned uWSGI master process (pid: 80411) Jun 01 17:23:56.872476 dv-cinder-797608-23-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 01 17:23:56.874029 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: spawned uWSGI worker 1 (pid: 80426, cores: 1) Jun 01 17:23:56.874029 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: spawned uWSGI worker 2 (pid: 80427, cores: 1) Jun 01 17:23:56.874029 dv-cinder-797608-23-iscsi devstack@keystone.service[80411]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 01 17:24:02.681063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 17:24:02.681063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: from cryptography.utils import int_from_bytes Jun 01 17:24:02.681857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 17:24:02.681857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: from cryptography.utils import int_from_bytes Jun 01 17:24:02.681970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 17:24:02.681970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: from cryptography.utils import int_from_bytes Jun 01 17:24:02.682379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 01 17:24:02.682379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: from cryptography.utils import int_from_bytes Jun 01 17:24:02.732086 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 01 17:24:02.732232 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 01 17:24:02.732311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 01 17:24:02.732390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] command line args: [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 01 17:24:02.732514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 01 17:24:02.732656 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 01 17:24:02.732747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] command line args: [] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 01 17:24:02.732830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ================================================================================ {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 01 17:24:02.732989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 01 17:24:02.733092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] admin_token = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.733175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ================================================================================ {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 01 17:24:02.733302 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] config_dir = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.733417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] admin_token = **** {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.733504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.733658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] config_source = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.733743 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] config_dir = [] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.733822 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] debug = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.733906 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.734019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] config_source = [] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.734103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.734728 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] debug = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.734805 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.734872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.734966 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.735033 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.735098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.735163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.735229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.735289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.735352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] list_limit = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.735417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.735481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] log_config_append = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.735541 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] list_limit = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.735606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.735671 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] log_config_append = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.735735 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] log_dir = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.735964 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.736074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] log_file = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.736182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] log_dir = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.736318 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.736402 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] log_file = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.736545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.736698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.736828 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.736979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.737121 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.737256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.737379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.737511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.737641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.737831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.737957 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.738079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.738208 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.738332 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.738464 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.738592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.738715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.738842 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.738963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.739090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.739808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.739993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.740115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.740191 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.740314 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.740397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.740481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.740600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.740600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.740776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.740776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] publish_errors = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.740924 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.741030 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.741108 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] publish_errors = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.741238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.741320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.741398 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.741476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.741548 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.741619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.741773 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.741858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.741939 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] standard_threads = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.742016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.742098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.742175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] standard_threads = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.742252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.742398 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.742527 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.742598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] use_journal = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.742672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.742756 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] use_json = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.742828 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.742894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] use_stderr = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.742959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] use_journal = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.743054 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] use_syslog = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.743146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] use_json = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.743286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.743365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] use_stderr = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.743443 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] use_syslog = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.743681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 01 17:24:02.743771 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.743944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.744023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.744190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.744271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.744455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.744542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.744699 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.744777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.744960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.745050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.745198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.745289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.745443 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.745523 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.745681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.745758 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.745926 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.746086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.746167 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.746246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.746391 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.746476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.746622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.746744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.746855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.746935 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.747096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.747181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.747330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.747417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.747579 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.747657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.747822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.747906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.748065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.748151 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.748300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.748389 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.748549 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.748628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.748787 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.748877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.749068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.749149 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.749314 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.749391 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.749543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.749634 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.749771 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.749857 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.749997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.750084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.750229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.750339 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.750476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.750581 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.750715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.750819 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.750934 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.751031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.751154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.751258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.751397 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.751481 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.751640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.751795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.751911 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.752026 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.752139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.752242 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.752362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.752477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.752587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.752701 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.752821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.752976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.753112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.753229 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.753363 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.753480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.753607 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.753723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.753847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.753963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.754077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.754191 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.754304 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.754408 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.754520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.754645 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.754762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.754877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.755573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.755698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.755814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.755928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.756044 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.756166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.756166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.756381 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.756381 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.756604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.756720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.756841 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.756967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.757089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.757211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.757341 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.757468 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.757585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.757699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.757813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.757927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.758050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.758166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.758281 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.758395 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.758516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.758631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.758753 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.758875 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.759089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.759291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.759417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.759534 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.759657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.759774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.759900 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.760021 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.760144 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.760260 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.760387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.760503 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.760619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.760732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.760846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.760973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.761107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.761230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.761358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.761481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.761608 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.761714 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.761840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.761967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.762091 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.762208 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.762322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.762437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.762557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.762672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.762798 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.762920 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.763036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.763151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.763275 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.763390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.763514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.763630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.763744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.763858 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.763972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.764086 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.764208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.764324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.764439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.764553 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.764667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.764781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.764904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.765084 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.765202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.765322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.765445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.765566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.765691 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.765808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.765923 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.766036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.766151 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.766264 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.766386 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.766503 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.766624 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.766740 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.766740 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.766953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.767079 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.767196 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.767310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.767428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.767543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.767664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.767664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.767889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.767889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.768109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.768109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.768338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.768460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.768575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.768689 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.768803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.768803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] auth.external = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.769050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.769167 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.769297 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.769297 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.769512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.769628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] auth.external = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.769753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.769753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] auth.password = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.770013 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.770136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] auth.token = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.770253 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.770368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.770503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.770623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.770747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] auth.password = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.770871 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.770987 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] auth.token = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.771102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.771217 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.771332 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.771455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.771579 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.771696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.771811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.771927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.772042 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] credential.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.772233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.772352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.772467 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.772583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.772705 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.772821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.772986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] credential.caching = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.773105 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.773221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.773336 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.773452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.773575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.773704 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.773822 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.773937 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.774053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.774169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.774284 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.774409 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.774526 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.774641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.774757 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.774872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.774986 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.775112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.775229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.775345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.775460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.775575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.775690 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.775814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.775931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.776046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.776162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.776278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.776399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.776525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.776642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.776758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] federation.caching = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.776873 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.777002 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.777133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.777261 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.777381 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.777498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.777614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.777730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.777844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.777968 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.778085 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.778201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.778316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.778464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.778589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.778707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.778822 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.778937 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.779059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.779176 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.779301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.779425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.779542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.779657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity.caching = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.779779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.779902 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.780027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.780027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.780246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.780361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.780476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.780476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.780699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.780816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.780932 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.781106 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.781223 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.781223 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.781449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.781566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.781682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.781796 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.781911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.782016 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.782138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.782255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.782372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.782486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.782601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.782716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.782840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.782840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.783057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.783057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.783271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.783387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.783510 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.783628 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.783749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.783866 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.783988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.784104 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.784228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.784345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.784461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.784576 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.784691 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.784806 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.784929 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.785066 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.785181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.785296 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.785411 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.785526 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.785653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.785771 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.785886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.786000 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.786642 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.786769 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.786894 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.787036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.787197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.787317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.787436 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.787551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.787677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.787795 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.787910 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.788025 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.788140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.788255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.788378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.788502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.788619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.788734 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.788850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.788983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.789114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.789232 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.789348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.789463 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.789578 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.789694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.789823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.789941 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.790056 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.790171 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.790285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.790400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.790524 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.790641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.790758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.790874 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.790988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.791112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.791229 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.791344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.791459 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.791573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.791689 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.791689 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.791916 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.792031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.792154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.792271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.792385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.792509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.792625 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.792625 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.792841 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.793010 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.793129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.793260 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.793378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.793493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.793607 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.793721 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.793835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.793959 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.794076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.794190 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.794305 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.794419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.794534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.794733 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.794851 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.794967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.795081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.795195 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.795310 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.795501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.795619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.795735 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.795849 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.795964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.796079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.796202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.796319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.796440 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.796556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.796670 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.796786 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.796908 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.797044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.797159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.797274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.797391 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.797506 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.797633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.797751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.797865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.797980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.798095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.798210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.798333 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.798456 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.798572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.798687 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.798801 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.798801 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.799024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.799024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.799241 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.799356 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.799469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.799469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.799692 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.799808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.799923 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.800038 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.800152 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.800266 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.800390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.800506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.800620 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.800733 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.800848 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.800848 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.801122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.801241 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] resource.caching = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.801356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.801356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.801571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.801685 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.801919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.802590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.802741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.802859 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.802975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.803090 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] role.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.803215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.803334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] role.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.803450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.803564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.803679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.803794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.803918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.804035 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.804151 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.804265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.804381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] role.caching = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.804381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] role.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.804604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.804722 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.804837 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.804996 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.805115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.805115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.805346 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.805469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.805586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.805700 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.805814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.805937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.806054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.806168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.806282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.806396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.806511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.806635 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.806751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.806751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.806965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.807079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.807193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.807320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.807448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.807566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.807680 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.807795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.807909 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.807909 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.808134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.808248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.808362 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.808477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.808593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.808716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.808832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.808965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.809083 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.809197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.809312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.809440 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.809556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.809672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.809786 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.809907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.810030 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.810146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.810261 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.810375 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.810488 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.810602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.810726 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.810842 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.810956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.811070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.811190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.811305 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] token.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.811413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.811528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.811643 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.811765 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.811888 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.812004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.812127 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.812244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.812359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.812473 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.812592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] token.caching = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.812708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.812831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.812966 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.813084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.813198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.813312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.813426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.813553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.813669 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.813784 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.813899 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.814013 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.814127 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.814127 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.814358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.814472 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.814586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.814701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.814826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.814952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.815068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.815068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.815282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.815396 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.815515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.connection = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.815644 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.815777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.815894 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.816010 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.816124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.816238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.816352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.816543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.816543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.816769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.816885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.817020 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.connection = **** {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.817149 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.817276 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.817683 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.817816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.817963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.818221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.818378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.818494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.818609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.818761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.818881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.818997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.819113 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.819228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.819343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.819467 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.819591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.819707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.819823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.819938 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.820053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.820178 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.820301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.820301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 01 17:24:02.820526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.820526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.820526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.820526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.820526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.820526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.820526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 01 17:24:02.820526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 01 17:24:02.847028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.847257 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.847489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.847631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.847868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.848101 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.856761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.857509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.886125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.886346 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.886519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.886756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.941755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.942547 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.991987 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.992160 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.992566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:02.992806 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.060560 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.060790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.060880 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.061041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.061128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.061266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.061351 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.061487 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.061571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.061702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.061785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.061917 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.085083 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.085321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.085425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.085552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.085636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.085779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.085863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.086003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.086087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.086218 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.086300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.086432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.086513 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.086645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.098276 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.098501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.111709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.111942 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.112098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.112187 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.112264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.112371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.112455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.112587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.112672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.112798 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.112882 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.113051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.113149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.113270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 01 17:24:03.130978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.131186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 01 17:24:03.131520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.131604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.131723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 01 17:24:03.131808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 01 17:24:03.131989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.132138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.132245 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.132337 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 01 17:24:03.132519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.132603 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.132768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.132850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.133122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.133380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.143812 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.144084 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.144350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.144434 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.144628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.144711 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.144900 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.145209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.153301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.153823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.156559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.156833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.157113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.157200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.157397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.157493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.157674 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.157758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.157955 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.158037 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.158237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.158321 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.158553 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.158634 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.158821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.158912 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.159092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.159179 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.159355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.159437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.159647 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.159917 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.185938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.186860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.187617 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.187892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.188580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.188864 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.193956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.194235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.194511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.194695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.194974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.195258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.201687 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.201963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.202511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.202798 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.206377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.206770 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.207051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.207279 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.207378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.207586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.207667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.207857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.207958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.208249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.208338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.208531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.208666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.208832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.209098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.209370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.226777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.227047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.228136 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.228417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.231846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.233361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.235424 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.235715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.237031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.237335 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.241255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.243012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.244763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.249784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.250082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.250359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.250633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.250902 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.251173 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.251692 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.251996 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.252286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.252585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.252866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.253174 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.270465 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.270742 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.271004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.271272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.272804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.273126 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.273399 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.273673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.279192 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.280889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.281186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.281608 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.283330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.283610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.284173 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.284458 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.284741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.285134 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.285408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.286796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.287081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.287375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.287674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.287970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.298788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.299064 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.299340 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.299617 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.299895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.300164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.300435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.301314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.301597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.302556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.302845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.303141 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.303420 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.303698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.319853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.322255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.323083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.325537 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.326409 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.327978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.328821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.329628 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.329903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.330179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.330457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.332106 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.332388 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.332671 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.337570 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.339168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.340398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.342050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.342334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.342621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.342902 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.343173 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.345255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.345549 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.345837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.346113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.352215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.352493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.352872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.355633 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.355922 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.356308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.361005 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.361287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.361587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.361865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.362130 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.362431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.362700 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.362966 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.363230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.363492 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.363755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.364030 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.364814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.365065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 01 17:24:03.365151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.365344 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.365628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.365907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.366184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.366492 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.366768 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.367042 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.367313 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.367584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.367856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.368139 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.368418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.368678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 01 17:24:03.407643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d85d9eb9c0 pid: 80427 (default app) Jun 01 17:24:03.410705 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d85d9eb9c0 pid: 80426 (default app) Jun 01 17:24:03.410990 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78a59b-22bf-4d97-9d7d-5c6a4ac17005 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:03.411865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78a59b-22bf-4d97-9d7d-5c6a4ac17005 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:03.412141 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78a59b-22bf-4d97-9d7d-5c6a4ac17005 None None] PATH_INFO: `/v3` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:03.416572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Wed Jun 1 17:24:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:12.487842 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c83b5-4539-4c34-9372-288d6000cb2f None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:12.488326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c83b5-4539-4c34-9372-288d6000cb2f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:12.488412 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c83b5-4539-4c34-9372-288d6000cb2f None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:12.492919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:24:12.498531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a14023-1243-46d8-a52f-fe53b6d39c00 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:12.498944 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a14023-1243-46d8-a52f-fe53b6d39c00 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:12.499080 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a14023-1243-46d8-a52f-fe53b6d39c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:12.566666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: INFO dbcounter [None req-26a14023-1243-46d8-a52f-fe53b6d39c00 None None] Registered counter for database keystone Jun 01 17:24:12.588906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG oslo_db.sqlalchemy.engines [None req-26a14023-1243-46d8-a52f-fe53b6d39c00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 17:24:12.594998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writer thread running {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 17:24:12.880319 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG passlib.handlers.bcrypt [None req-26a14023-1243-46d8-a52f-fe53b6d39c00 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80427) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 01 17:24:12.880855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG passlib.handlers.bcrypt [None req-26a14023-1243-46d8-a52f-fe53b6d39c00 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80427) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 01 17:24:12.936461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-26a14023-1243-46d8-a52f-fe53b6d39c00 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:12.938072 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-26a14023-1243-46d8-a52f-fe53b6d39c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:13.064234 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 567 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 01 17:24:13.237454 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c83b5-4539-4c34-9372-288d6000cb2f None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:13.308725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: INFO dbcounter [None req-854c83b5-4539-4c34-9372-288d6000cb2f None None] Registered counter for database keystone Jun 01 17:24:13.327919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG oslo_db.sqlalchemy.engines [None req-854c83b5-4539-4c34-9372-288d6000cb2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 01 17:24:13.334109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writer thread running {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 01 17:24:13.559720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c83b5-4539-4c34-9372-288d6000cb2f None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:13.564014 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8993a36-76dd-40e8-97d6-077861d05b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:13.564677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8993a36-76dd-40e8-97d6-077861d05b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:13.564989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8993a36-76dd-40e8-97d6-077861d05b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:13.565276 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8993a36-76dd-40e8-97d6-077861d05b6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:13.574072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8993a36-76dd-40e8-97d6-077861d05b6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:13.626164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c8993a36-76dd-40e8-97d6-077861d05b6e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 01 17:24:13.626510 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8993a36-76dd-40e8-97d6-077861d05b6e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:13.636598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Wed Jun 1 17:24:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 17:24:13.642711 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a14023-1243-46d8-a52f-fe53b6d39c00 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:13.657431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a14023-1243-46d8-a52f-fe53b6d39c00 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:13.661846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b877ca-7d94-46ae-8b9b-b7c531745167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:13.662961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b877ca-7d94-46ae-8b9b-b7c531745167 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:13.663245 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b877ca-7d94-46ae-8b9b-b7c531745167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:13.663527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b877ca-7d94-46ae-8b9b-b7c531745167 admin admin] PATH_INFO: `/v3/projects/5ab5b23ebc224a5b9dd9616b70ea67bd` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:13.665035 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b877ca-7d94-46ae-8b9b-b7c531745167 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ab5b23ebc224a5b9dd9616b70ea67bd)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:13.716635 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e0b877ca-7d94-46ae-8b9b-b7c531745167 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 01 17:24:13.716996 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b877ca-7d94-46ae-8b9b-b7c531745167 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:13.721586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Wed Jun 1 17:24:13 2022] GET /identity/v3/projects/5ab5b23ebc224a5b9dd9616b70ea67bd => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:15.929987 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a78d4-7a2c-48bc-9cf4-9c7940de20ac None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:15.930501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a78d4-7a2c-48bc-9cf4-9c7940de20ac None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:15.930608 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a78d4-7a2c-48bc-9cf4-9c7940de20ac None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:15.934730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:24:15.940201 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819c3e3-0042-484d-8588-b0c36741d835 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:15.940613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819c3e3-0042-484d-8588-b0c36741d835 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:15.940753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819c3e3-0042-484d-8588-b0c36741d835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:15.959808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d819c3e3-0042-484d-8588-b0c36741d835 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:15.961336 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d819c3e3-0042-484d-8588-b0c36741d835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:15.968973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 01 17:24:15.992029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a78d4-7a2c-48bc-9cf4-9c7940de20ac None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:16.004120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a78d4-7a2c-48bc-9cf4-9c7940de20ac None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:16.008974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7adcc5-bd5f-4c1e-afd3-f10d55bfcad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:16.009608 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7adcc5-bd5f-4c1e-afd3-f10d55bfcad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:16.009896 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7adcc5-bd5f-4c1e-afd3-f10d55bfcad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:16.010179 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7adcc5-bd5f-4c1e-afd3-f10d55bfcad6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:16.017764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7adcc5-bd5f-4c1e-afd3-f10d55bfcad6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:16.019653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7adcc5-bd5f-4c1e-afd3-f10d55bfcad6 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:16.028386 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Wed Jun 1 17:24:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 17:24:16.033778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819c3e3-0042-484d-8588-b0c36741d835 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:16.043040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819c3e3-0042-484d-8588-b0c36741d835 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:16.047431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db27b69-4a4e-45ed-9c3e-12b25ad33826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:16.048298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db27b69-4a4e-45ed-9c3e-12b25ad33826 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:16.048589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db27b69-4a4e-45ed-9c3e-12b25ad33826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:16.048872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db27b69-4a4e-45ed-9c3e-12b25ad33826 admin admin] PATH_INFO: `/v3/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:16.050287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db27b69-4a4e-45ed-9c3e-12b25ad33826 admin admin] RBAC: Authorizing `identity:get_user(user_id=e7e43dc5addf4a3b9b9bacb5e1aa59a0)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:16.052745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db27b69-4a4e-45ed-9c3e-12b25ad33826 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:16.054353 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Wed Jun 1 17:24:16 2022] GET /identity/v3/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:18.359961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b832a-9c78-444d-a20d-9807303e442e None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:18.360477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b832a-9c78-444d-a20d-9807303e442e None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:18.360559 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b832a-9c78-444d-a20d-9807303e442e None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:18.361902 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:18.367022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157b4e8-2814-4b0a-b147-31dda9b0d158 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:18.367441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157b4e8-2814-4b0a-b147-31dda9b0d158 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:18.367580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157b4e8-2814-4b0a-b147-31dda9b0d158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:18.383895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5157b4e8-2814-4b0a-b147-31dda9b0d158 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:18.385077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5157b4e8-2814-4b0a-b147-31dda9b0d158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:18.431018 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7724d2-b31d-4107-aa98-0329b48eafc7 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:18.431309 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7724d2-b31d-4107-aa98-0329b48eafc7 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:18.431592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7724d2-b31d-4107-aa98-0329b48eafc7 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:18.432973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:24:18.438017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326eb72-d390-415f-b384-4ddd20d9a7fa None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:18.438307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326eb72-d390-415f-b384-4ddd20d9a7fa None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:18.438582 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326eb72-d390-415f-b384-4ddd20d9a7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:18.464667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:18.480602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG passlib.handlers.bcrypt [None req-2326eb72-d390-415f-b384-4ddd20d9a7fa None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80426) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 01 17:24:18.481354 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG passlib.handlers.bcrypt [None req-2326eb72-d390-415f-b384-4ddd20d9a7fa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80426) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 01 17:24:18.488747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157b4e8-2814-4b0a-b147-31dda9b0d158 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:18.512550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:18.528749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-2326eb72-d390-415f-b384-4ddd20d9a7fa None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:18.530356 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-2326eb72-d390-415f-b384-4ddd20d9a7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:18.592966 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157b4e8-2814-4b0a-b147-31dda9b0d158 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:18.627534 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0009e5-9197-4eaa-a993-0904f6f6ceec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:18.628269 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0009e5-9197-4eaa-a993-0904f6f6ceec None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:18.628558 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0009e5-9197-4eaa-a993-0904f6f6ceec None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:18.628839 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0009e5-9197-4eaa-a993-0904f6f6ceec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:18.632998 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:24:18.640426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0009e5-9197-4eaa-a993-0904f6f6ceec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:18.651610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326eb72-d390-415f-b384-4ddd20d9a7fa None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-0f0009e5-9197-4eaa-a993-0904f6f6ceec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:18.651743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:18.652729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:18.653728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:18.653728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:18.653728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:18.653728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:18.653728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:18.653728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:18.653728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:18.653728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:18.653728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:18.653728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:18.653728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:18.653728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:18.653728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:24:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:24:18.658494 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0009e5-9197-4eaa-a993-0904f6f6ceec None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:18.740359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:18.759893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326eb72-d390-415f-b384-4ddd20d9a7fa None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:18.761340 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0009e5-9197-4eaa-a993-0904f6f6ceec None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:18.763145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:18.796494 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c1e4-c51b-4215-bcc4-afdeaa369366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:18.797188 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c1e4-c51b-4215-bcc4-afdeaa369366 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:18.797473 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c1e4-c51b-4215-bcc4-afdeaa369366 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:18.797752 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c1e4-c51b-4215-bcc4-afdeaa369366 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:18.798499 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5c1e4-c51b-4215-bcc4-afdeaa369366 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:18.798668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c7f97-183a-4ecb-ad9f-99f47808b31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:18.798828 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5c1e4-c51b-4215-bcc4-afdeaa369366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:18.799575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c7f97-183a-4ecb-ad9f-99f47808b31c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:18.799863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c7f97-183a-4ecb-ad9f-99f47808b31c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:18.800147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c7f97-183a-4ecb-ad9f-99f47808b31c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:18.800244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5c1e4-c51b-4215-bcc4-afdeaa369366 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:18.811382 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:18.817552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c1e4-c51b-4215-bcc4-afdeaa369366 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:18.872248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c7f97-183a-4ecb-ad9f-99f47808b31c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:18.873800 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c7f97-183a-4ecb-ad9f-99f47808b31c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:18.917181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c1e4-c51b-4215-bcc4-afdeaa369366 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:18.951277 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2a97e-0f80-4eb1-94e1-e030827338aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:18.952147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2a97e-0f80-4eb1-94e1-e030827338aa None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:18.952434 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2a97e-0f80-4eb1-94e1-e030827338aa None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:18.952707 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2a97e-0f80-4eb1-94e1-e030827338aa None admin] PATH_INFO: `/v3/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:18.953924 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2a97e-0f80-4eb1-94e1-e030827338aa None admin] RBAC: Authorizing `identity:get_user(user_id=e7e43dc5addf4a3b9b9bacb5e1aa59a0)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:18.955371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2a97e-0f80-4eb1-94e1-e030827338aa None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:18.956990 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 9/16] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:18 2022] GET /identity/v3/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:18.962565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2a97e-0f80-4eb1-94e1-e030827338aa None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:18.970512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 8/17] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 01 17:24:18.975924 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c7f97-183a-4ecb-ad9f-99f47808b31c None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:18.977205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:18.979367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:19.068433 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2a97e-0f80-4eb1-94e1-e030827338aa None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:19.076265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c7f97-183a-4ecb-ad9f-99f47808b31c None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:19.107462 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100fe0f-1fdd-456a-9826-7b254f43f6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:19.108265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100fe0f-1fdd-456a-9826-7b254f43f6ce None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:19.108550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100fe0f-1fdd-456a-9826-7b254f43f6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:19.108782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273311fd-2a7e-47f1-827d-ed85a6f36bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:19.108912 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100fe0f-1fdd-456a-9826-7b254f43f6ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:19.109612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273311fd-2a7e-47f1-827d-ed85a6f36bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:19.109901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273311fd-2a7e-47f1-827d-ed85a6f36bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:19.110014 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100fe0f-1fdd-456a-9826-7b254f43f6ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:19.110180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273311fd-2a7e-47f1-827d-ed85a6f36bc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:19.111501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100fe0f-1fdd-456a-9826-7b254f43f6ce None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:19.113123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 10/18] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:24:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:19.119263 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100fe0f-1fdd-456a-9826-7b254f43f6ce None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:19.129770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273311fd-2a7e-47f1-827d-ed85a6f36bc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:19.131493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273311fd-2a7e-47f1-827d-ed85a6f36bc3 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:19.152382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-273311fd-2a7e-47f1-827d-ed85a6f36bc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:24:19.152382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:19.152382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:19.152382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:19.152382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:19.152382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:19.152382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:19.152382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:19.152382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:19.152382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:19.152382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:19.152382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:19.152382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:24:19.152382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:24:19.152382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:19.153526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:19.154666 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:24:19.154666 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:24:19.154666 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:24:19.154666 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:24:19.154666 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 9/19] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:19.159338 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273311fd-2a7e-47f1-827d-ed85a6f36bc3 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:19.200985 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:19.216462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:19.219702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100fe0f-1fdd-456a-9826-7b254f43f6ce None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:19.254628 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1821c-a84c-444e-8744-a14d4e291382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:19.255291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1821c-a84c-444e-8744-a14d4e291382 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:19.255580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1821c-a84c-444e-8744-a14d4e291382 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:19.255857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1821c-a84c-444e-8744-a14d4e291382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:19.256716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1821c-a84c-444e-8744-a14d4e291382 None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.domain.id=default, user.id=e7e43dc5addf4a3b9b9bacb5e1aa59a0) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:19.257059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1821c-a84c-444e-8744-a14d4e291382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:19.258525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1821c-a84c-444e-8744-a14d4e291382 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:19.259536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273311fd-2a7e-47f1-827d-ed85a6f36bc3 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:19.265399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 11/20] 10.222.0.33 () {56 vars in 1322 bytes} [Wed Jun 1 17:24:19 2022] GET /identity/v3/role_assignments?user.id=e7e43dc5addf4a3b9b9bacb5e1aa59a0&scope.domain.id=default&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:19.294687 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d91327-7b1e-46aa-b21c-564812b12f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:19.295389 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d91327-7b1e-46aa-b21c-564812b12f86 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:19.295674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d91327-7b1e-46aa-b21c-564812b12f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:19.295955 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d91327-7b1e-46aa-b21c-564812b12f86 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:19.296714 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d91327-7b1e-46aa-b21c-564812b12f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:19.297054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d91327-7b1e-46aa-b21c-564812b12f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:19.298517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d91327-7b1e-46aa-b21c-564812b12f86 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:19.318379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 10/21] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:22.042147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c29739-23de-4f7c-8012-96b8b50afd05 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:22.043183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c29739-23de-4f7c-8012-96b8b50afd05 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:22.043673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c29739-23de-4f7c-8012-96b8b50afd05 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:22.045261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 12/22] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:22.058423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e177a7d-c860-4d16-b413-90341c95cbbf None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:22.059324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e177a7d-c860-4d16-b413-90341c95cbbf None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:22.059826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e177a7d-c860-4d16-b413-90341c95cbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:22.085952 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-9e177a7d-c860-4d16-b413-90341c95cbbf None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:22.087498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-9e177a7d-c860-4d16-b413-90341c95cbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:22.169987 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6622a-6000-4037-93fc-5122c311d935 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:22.170635 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6622a-6000-4037-93fc-5122c311d935 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:22.171139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6622a-6000-4037-93fc-5122c311d935 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:22.172705 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 13/23] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:24:22.180793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d947b1d-09da-4457-a3be-704f24c4601f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:22.180793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d947b1d-09da-4457-a3be-704f24c4601f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:22.180793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d947b1d-09da-4457-a3be-704f24c4601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:22.184982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 11/24] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:22.209239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-3d947b1d-09da-4457-a3be-704f24c4601f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:22.210807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3d947b1d-09da-4457-a3be-704f24c4601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:22.232322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e177a7d-c860-4d16-b413-90341c95cbbf None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:22.345118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:22.369273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 14/25] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:24:22.427486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae081f9-7238-4453-9a27-f8abe4846c28 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:22.428107 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae081f9-7238-4453-9a27-f8abe4846c28 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:22.428603 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae081f9-7238-4453-9a27-f8abe4846c28 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:22.430912 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 15/26] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:24:22.437197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b7763-d86c-4c2d-867d-8abd3560ed7f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:22.437489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b7763-d86c-4c2d-867d-8abd3560ed7f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:22.437775 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b7763-d86c-4c2d-867d-8abd3560ed7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:22.449831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e177a7d-c860-4d16-b413-90341c95cbbf None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:22.469202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-867b7763-d86c-4c2d-867d-8abd3560ed7f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:22.470726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-867b7763-d86c-4c2d-867d-8abd3560ed7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:22.517537 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6adf41-34f6-45a4-a904-55652ebb138a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:22.518348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6adf41-34f6-45a4-a904-55652ebb138a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:22.518645 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6adf41-34f6-45a4-a904-55652ebb138a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:22.518925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6adf41-34f6-45a4-a904-55652ebb138a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:22.535842 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6adf41-34f6-45a4-a904-55652ebb138a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:22.537503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6adf41-34f6-45a4-a904-55652ebb138a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:22.564326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-6b6adf41-34f6-45a4-a904-55652ebb138a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:24:22.564326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:22.564326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:22.564326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:22.564326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:22.564326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:22.564326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:22.564326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:22.564326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:22.564326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:22.564326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:22.564326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:22.564326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:24:22.564326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:24:22.564326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:22.565245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:22.566128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:24:22.566128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:24:22.566128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:24:22.566128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:24:22.566128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 12/27] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:22.566725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6adf41-34f6-45a4-a904-55652ebb138a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:22.626329 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 16/28] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:22.627124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b7763-d86c-4c2d-867d-8abd3560ed7f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:22.639568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:22.691283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6adf41-34f6-45a4-a904-55652ebb138a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:22.706062 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:22.730939 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3238c-9409-4f68-841e-69d9522aad4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:22.732131 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3238c-9409-4f68-841e-69d9522aad4a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:22.732566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3238c-9409-4f68-841e-69d9522aad4a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:22.733037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3238c-9409-4f68-841e-69d9522aad4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:22.747345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3238c-9409-4f68-841e-69d9522aad4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-ade3238c-9409-4f68-841e-69d9522aad4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:22.757903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:22.758930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:22.759889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:22.759889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:22.759889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:22.759889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:22.759889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:22.759889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:22.759889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:22.759889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:22.759889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:22.759889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:22.759889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:22.759889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:24:22.762106 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 13/29] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:24:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:22.763081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3238c-9409-4f68-841e-69d9522aad4a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:22.795810 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b7763-d86c-4c2d-867d-8abd3560ed7f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:22.841791 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f3804-b3d8-43f3-83e3-6af4c5ddea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:22.842465 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f3804-b3d8-43f3-83e3-6af4c5ddea48 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:22.843198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f3804-b3d8-43f3-83e3-6af4c5ddea48 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:22.843646 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f3804-b3d8-43f3-83e3-6af4c5ddea48 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:22.845078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f3804-b3d8-43f3-83e3-6af4c5ddea48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:22.845772 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f3804-b3d8-43f3-83e3-6af4c5ddea48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:22.847618 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f3804-b3d8-43f3-83e3-6af4c5ddea48 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:22.875087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 17/30] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:22.877400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c377ea-1f85-42db-b4d9-4614c1ae73fd None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:22.877829 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c377ea-1f85-42db-b4d9-4614c1ae73fd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:22.878680 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c377ea-1f85-42db-b4d9-4614c1ae73fd None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:22.882255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 18/31] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:22.883511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c377ea-1f85-42db-b4d9-4614c1ae73fd None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:22.885023 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3238c-9409-4f68-841e-69d9522aad4a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:22.931931 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a711c-6dc1-4431-860f-404f0e0514bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:22.932625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a711c-6dc1-4431-860f-404f0e0514bf None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:22.933132 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a711c-6dc1-4431-860f-404f0e0514bf None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:22.933559 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a711c-6dc1-4431-860f-404f0e0514bf None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:22.934489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a711c-6dc1-4431-860f-404f0e0514bf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:22.936034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a711c-6dc1-4431-860f-404f0e0514bf None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:22.967862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:23.008605 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c377ea-1f85-42db-b4d9-4614c1ae73fd None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:23.042594 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceee302-b3ae-4cc7-8c04-5fc031ffc062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:23.043408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceee302-b3ae-4cc7-8c04-5fc031ffc062 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:23.043601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceee302-b3ae-4cc7-8c04-5fc031ffc062 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:23.043881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceee302-b3ae-4cc7-8c04-5fc031ffc062 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:23.044630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceee302-b3ae-4cc7-8c04-5fc031ffc062 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:23.044951 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceee302-b3ae-4cc7-8c04-5fc031ffc062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:23.046350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceee302-b3ae-4cc7-8c04-5fc031ffc062 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:23.058247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 19/32] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:23.059343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceee302-b3ae-4cc7-8c04-5fc031ffc062 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:23.176606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceee302-b3ae-4cc7-8c04-5fc031ffc062 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:23.197963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 14/33] 10.222.0.33 () {60 vars in 1131 bytes} [Wed Jun 1 17:24:22 2022] POST /identity/v3/roles => generated 225 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:24:23.200791 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f7a2f-f9cf-4eb9-8c94-f7d2c5d6c053 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:23.201362 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f7a2f-f9cf-4eb9-8c94-f7d2c5d6c053 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:23.201786 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f7a2f-f9cf-4eb9-8c94-f7d2c5d6c053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:23.206460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:23.217818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe2454-aeab-412b-977a-62cfc83f870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:23.218849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe2454-aeab-412b-977a-62cfc83f870b None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:23.219387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe2454-aeab-412b-977a-62cfc83f870b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:23.219864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe2454-aeab-412b-977a-62cfc83f870b None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:23.220816 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe2454-aeab-412b-977a-62cfc83f870b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:23.223410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe2454-aeab-412b-977a-62cfc83f870b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:23.224058 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-100f7a2f-f9cf-4eb9-8c94-f7d2c5d6c053 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:23.225716 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-100f7a2f-f9cf-4eb9-8c94-f7d2c5d6c053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:23.242957 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:23.308473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 15/34] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:23.309604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f7a2f-f9cf-4eb9-8c94-f7d2c5d6c053 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:23.460492 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f7a2f-f9cf-4eb9-8c94-f7d2c5d6c053 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:23.498239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23963d27-65e5-450b-996d-637f47b63b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:23.499131 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23963d27-65e5-450b-996d-637f47b63b69 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:23.499419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23963d27-65e5-450b-996d-637f47b63b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:23.499703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23963d27-65e5-450b-996d-637f47b63b69 None admin] PATH_INFO: `/v3/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:23.501488 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23963d27-65e5-450b-996d-637f47b63b69 None admin] RBAC: Authorizing `identity:get_user(user_id=e7e43dc5addf4a3b9b9bacb5e1aa59a0)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:23.503062 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23963d27-65e5-450b-996d-637f47b63b69 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:23.506491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 16/35] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:23 2022] GET /identity/v3/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:23.507076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23963d27-65e5-450b-996d-637f47b63b69 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:23.508635 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 20/36] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jun 1 17:24:23 2022] POST /identity/v3/projects => generated 301 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:24:23.522611 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe2454-aeab-412b-977a-62cfc83f870b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:23.542915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:23.661233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23963d27-65e5-450b-996d-637f47b63b69 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:23.689072 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe2454-aeab-412b-977a-62cfc83f870b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:23.712713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f0152-2ec8-4c04-b4ce-831168f569b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:23.713414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f0152-2ec8-4c04-b4ce-831168f569b0 None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:23.713707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f0152-2ec8-4c04-b4ce-831168f569b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:23.714080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f0152-2ec8-4c04-b4ce-831168f569b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:23.714837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f0152-2ec8-4c04-b4ce-831168f569b0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:23.716489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f0152-2ec8-4c04-b4ce-831168f569b0 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:23.741783 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17399d46-07ad-416c-a257-09d53b3bc915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:23.742608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17399d46-07ad-416c-a257-09d53b3bc915 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:23.742897 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17399d46-07ad-416c-a257-09d53b3bc915 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:23.743183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17399d46-07ad-416c-a257-09d53b3bc915 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:23.744655 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17399d46-07ad-416c-a257-09d53b3bc915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:23.747968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17399d46-07ad-416c-a257-09d53b3bc915 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:23.748139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 21/37] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:24:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:23.749400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726ae4f-ffe4-48f1-837c-70e565553681 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:23.749692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726ae4f-ffe4-48f1-837c-70e565553681 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:23.750021 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726ae4f-ffe4-48f1-837c-70e565553681 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:23.751590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 22/38] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:23.754070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726ae4f-ffe4-48f1-837c-70e565553681 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:23.805907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:23.814451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 17/39] 10.222.0.33 () {60 vars in 1131 bytes} [Wed Jun 1 17:24:23 2022] POST /identity/v3/roles => generated 219 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:24:23.815864 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509baad3-ab17-4925-836e-54bfed496e24 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:23.816163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509baad3-ab17-4925-836e-54bfed496e24 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:23.816615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509baad3-ab17-4925-836e-54bfed496e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:23.835346 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-509baad3-ab17-4925-836e-54bfed496e24 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:23.836619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-509baad3-ab17-4925-836e-54bfed496e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:23.869646 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726ae4f-ffe4-48f1-837c-70e565553681 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:23.909883 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30851-4ff8-4cf0-8e44-a0cb6e68aaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:23.910826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30851-4ff8-4cf0-8e44-a0cb6e68aaee None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:23.911162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30851-4ff8-4cf0-8e44-a0cb6e68aaee None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:23.911399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30851-4ff8-4cf0-8e44-a0cb6e68aaee None admin] PATH_INFO: `/v3/domains/default/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:23.913778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c30851-4ff8-4cf0-8e44-a0cb6e68aaee None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e7e43dc5addf4a3b9b9bacb5e1aa59a0, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:23.915286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c30851-4ff8-4cf0-8e44-a0cb6e68aaee None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:23.924725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 18/40] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:23.924725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6e71b-6159-4306-80a7-f57cface8b57 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:23.924725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6e71b-6159-4306-80a7-f57cface8b57 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:23.924725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6e71b-6159-4306-80a7-f57cface8b57 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:23.924725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 19/41] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:23.926592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77196ff1-f9ab-4b27-ab10-7ba46d7f69c4 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:23.927070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77196ff1-f9ab-4b27-ab10-7ba46d7f69c4 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:23.927352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77196ff1-f9ab-4b27-ab10-7ba46d7f69c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:23.938806 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:23.946067 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-77196ff1-f9ab-4b27-ab10-7ba46d7f69c4 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:23.947413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-77196ff1-f9ab-4b27-ab10-7ba46d7f69c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:24.012150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 23/42] 10.222.0.33 () {58 vars in 1361 bytes} [Wed Jun 1 17:24:23 2022] PUT /identity/v3/domains/default/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:24:24.012778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30851-4ff8-4cf0-8e44-a0cb6e68aaee None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:24.040919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 20/43] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:24.057561 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77196ff1-f9ab-4b27-ab10-7ba46d7f69c4 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:24.155500 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30851-4ff8-4cf0-8e44-a0cb6e68aaee None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:24.164867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:24.179219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77196ff1-f9ab-4b27-ab10-7ba46d7f69c4 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:24.195425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488c1f7-b23e-43d8-a0be-cd465f4fee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:24.196240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488c1f7-b23e-43d8-a0be-cd465f4fee12 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:24.196527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488c1f7-b23e-43d8-a0be-cd465f4fee12 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:24.196810 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488c1f7-b23e-43d8-a0be-cd465f4fee12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:24.198297 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488c1f7-b23e-43d8-a0be-cd465f4fee12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:24.199852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488c1f7-b23e-43d8-a0be-cd465f4fee12 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:24.202372 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 24/44] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:24:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:24.214022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488c1f7-b23e-43d8-a0be-cd465f4fee12 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:24.216301 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8ea3e-4bd8-490a-b483-8ce18da25bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:24.217021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8ea3e-4bd8-490a-b483-8ce18da25bdd None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:24.217311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8ea3e-4bd8-490a-b483-8ce18da25bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:24.217593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8ea3e-4bd8-490a-b483-8ce18da25bdd None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:24.218355 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8ea3e-4bd8-490a-b483-8ce18da25bdd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:24.219777 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8ea3e-4bd8-490a-b483-8ce18da25bdd None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:24.224226 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:24.294739 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 21/45] 10.222.0.33 () {60 vars in 1131 bytes} [Wed Jun 1 17:24:24 2022] POST /identity/v3/roles => generated 223 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:24:24.337561 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488c1f7-b23e-43d8-a0be-cd465f4fee12 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:24.376973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403aea0-bf25-4cc2-b9ec-81ddf4e19850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:24.377711 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403aea0-bf25-4cc2-b9ec-81ddf4e19850 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:24.378007 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403aea0-bf25-4cc2-b9ec-81ddf4e19850 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:24.378294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403aea0-bf25-4cc2-b9ec-81ddf4e19850 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:24.379817 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403aea0-bf25-4cc2-b9ec-81ddf4e19850 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:24.381401 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403aea0-bf25-4cc2-b9ec-81ddf4e19850 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:24.470606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 25/46] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jun 1 17:24:24 2022] POST /identity/v3/projects => generated 312 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:24:26.354052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74178c7a-b634-4cb8-8b13-94a949f99675 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:26.354574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74178c7a-b634-4cb8-8b13-94a949f99675 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:26.354686 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74178c7a-b634-4cb8-8b13-94a949f99675 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:26.356266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 22/47] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:26.361535 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1a7fc-5f8f-4585-bf95-79614df2464e None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:26.361942 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1a7fc-5f8f-4585-bf95-79614df2464e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:26.362105 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1a7fc-5f8f-4585-bf95-79614df2464e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:26.381084 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-bff1a7fc-5f8f-4585-bf95-79614df2464e None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:26.382645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-bff1a7fc-5f8f-4585-bf95-79614df2464e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:26.405833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:26.455750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 26/48] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:26.479768 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74178c7a-b634-4cb8-8b13-94a949f99675 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:26.583825 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74178c7a-b634-4cb8-8b13-94a949f99675 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:26.617784 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeccc29-e96f-4da8-84af-9f198a4344e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:26.618511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeccc29-e96f-4da8-84af-9f198a4344e7 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:26.618801 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeccc29-e96f-4da8-84af-9f198a4344e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:26.619086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeccc29-e96f-4da8-84af-9f198a4344e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:26.629988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeccc29-e96f-4da8-84af-9f198a4344e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-ddeccc29-e96f-4da8-84af-9f198a4344e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:26.637631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:26.638606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:26.639553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:26.639553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:26.639553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:26.639553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:26.639553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:26.639553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:26.639553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:26.639553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:26.639553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:26.639553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:26.639553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:26.639553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:24:26.639553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 23/49] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:24:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:26.646693 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1a7fc-5f8f-4585-bf95-79614df2464e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:26.724886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20e820-b935-4d4f-aa05-68bfe6c12492 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:26.725209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20e820-b935-4d4f-aa05-68bfe6c12492 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:26.725501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20e820-b935-4d4f-aa05-68bfe6c12492 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:26.727111 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 24/50] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:24:26.732352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4b46b-94ed-404c-92ac-204e8cb181ce None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:26.732650 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4b46b-94ed-404c-92ac-204e8cb181ce None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:26.732947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4b46b-94ed-404c-92ac-204e8cb181ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:26.748543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1a7fc-5f8f-4585-bf95-79614df2464e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:26.750125 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-81f4b46b-94ed-404c-92ac-204e8cb181ce None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:26.751338 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-81f4b46b-94ed-404c-92ac-204e8cb181ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:26.783306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6ee2-b37e-48b2-abf4-376c7e1f6f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:26.783989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6ee2-b37e-48b2-abf4-376c7e1f6f5e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:26.784278 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6ee2-b37e-48b2-abf4-376c7e1f6f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:26.784558 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6ee2-b37e-48b2-abf4-376c7e1f6f5e None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:26.785921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c6ee2-b37e-48b2-abf4-376c7e1f6f5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:26.786237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c6ee2-b37e-48b2-abf4-376c7e1f6f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:26.787639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c6ee2-b37e-48b2-abf4-376c7e1f6f5e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:26.795715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 27/51] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:26.801806 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6ee2-b37e-48b2-abf4-376c7e1f6f5e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:26.804820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:26.820446 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:26.821450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 25/52] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:24:26.844547 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4b46b-94ed-404c-92ac-204e8cb181ce None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:26.900270 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6ee2-b37e-48b2-abf4-376c7e1f6f5e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:26.935129 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a527ef2-a285-4da0-a429-e6b9f16db28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:26.936017 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a527ef2-a285-4da0-a429-e6b9f16db28f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:26.936310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a527ef2-a285-4da0-a429-e6b9f16db28f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:26.936590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a527ef2-a285-4da0-a429-e6b9f16db28f None admin] PATH_INFO: `/v3/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:26.937843 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a527ef2-a285-4da0-a429-e6b9f16db28f None admin] RBAC: Authorizing `identity:get_user(user_id=e7e43dc5addf4a3b9b9bacb5e1aa59a0)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:26.939307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a527ef2-a285-4da0-a429-e6b9f16db28f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:26.940997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 28/53] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:26 2022] GET /identity/v3/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:26.945550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4b46b-94ed-404c-92ac-204e8cb181ce None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:26.946360 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a527ef2-a285-4da0-a429-e6b9f16db28f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:26.980661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e0325-81d0-4cab-97b9-12c6bddb6f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:26.981500 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e0325-81d0-4cab-97b9-12c6bddb6f42 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:26.981795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e0325-81d0-4cab-97b9-12c6bddb6f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:26.982074 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e0325-81d0-4cab-97b9-12c6bddb6f42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:26.983251 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e0325-81d0-4cab-97b9-12c6bddb6f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:26.984730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e0325-81d0-4cab-97b9-12c6bddb6f42 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:26.986373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 26/54] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:24:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:26.992892 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e0325-81d0-4cab-97b9-12c6bddb6f42 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:27.033384 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:27.048152 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:27.048455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a527ef2-a285-4da0-a429-e6b9f16db28f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:27.082408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e01cc9-6e6f-48dc-9012-47a771bd3684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:27.083773 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e01cc9-6e6f-48dc-9012-47a771bd3684 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:27.084059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e01cc9-6e6f-48dc-9012-47a771bd3684 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:27.084339 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e01cc9-6e6f-48dc-9012-47a771bd3684 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:27.085552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e01cc9-6e6f-48dc-9012-47a771bd3684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:27.087075 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e01cc9-6e6f-48dc-9012-47a771bd3684 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:27.088687 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 29/55] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:24:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:27.092548 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e0325-81d0-4cab-97b9-12c6bddb6f42 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:27.094386 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e01cc9-6e6f-48dc-9012-47a771bd3684 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:27.127614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0897d-9319-475d-9753-3be4c20e0545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:27.128288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0897d-9319-475d-9753-3be4c20e0545 None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:27.128579 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0897d-9319-475d-9753-3be4c20e0545 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:27.130021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0897d-9319-475d-9753-3be4c20e0545 None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:27.130747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0897d-9319-475d-9753-3be4c20e0545 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:27.132198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0897d-9319-475d-9753-3be4c20e0545 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:27.193669 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e01cc9-6e6f-48dc-9012-47a771bd3684 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:27.224328 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 27/56] 10.222.0.33 () {60 vars in 1140 bytes} [Wed Jun 1 17:24:26 2022] POST /identity/v3/projects => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:24:27.227016 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130945d0-888f-4848-a28f-1a796b61b519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:27.227808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130945d0-888f-4848-a28f-1a796b61b519 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:27.228103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130945d0-888f-4848-a28f-1a796b61b519 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:27.228389 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130945d0-888f-4848-a28f-1a796b61b519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:27.229292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130945d0-888f-4848-a28f-1a796b61b519 None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.domain.id=default, user.id=e7e43dc5addf4a3b9b9bacb5e1aa59a0) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:27.229614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130945d0-888f-4848-a28f-1a796b61b519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:27.231375 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130945d0-888f-4848-a28f-1a796b61b519 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:27.252987 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 30/57] 10.222.0.33 () {56 vars in 1322 bytes} [Wed Jun 1 17:24:27 2022] GET /identity/v3/role_assignments?user.id=e7e43dc5addf4a3b9b9bacb5e1aa59a0&scope.domain.id=default&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:29.493989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db0083-ab30-4265-8f2e-8fb16ce56d0f None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:29.494436 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db0083-ab30-4265-8f2e-8fb16ce56d0f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:29.494556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db0083-ab30-4265-8f2e-8fb16ce56d0f None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:29.495932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 28/58] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:29.501253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adfeae-fcf3-45c6-b624-69c8c4c39137 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:29.501679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adfeae-fcf3-45c6-b624-69c8c4c39137 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:29.501821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adfeae-fcf3-45c6-b624-69c8c4c39137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:29.518930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-39adfeae-fcf3-45c6-b624-69c8c4c39137 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:29.520134 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-39adfeae-fcf3-45c6-b624-69c8c4c39137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:29.532826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:29.584765 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 31/59] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:29.608671 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db0083-ab30-4265-8f2e-8fb16ce56d0f None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:29.707754 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db0083-ab30-4265-8f2e-8fb16ce56d0f None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:29.714406 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:29.741972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1ffa3-b371-4e17-bb64-23f269c2f4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:29.742705 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1ffa3-b371-4e17-bb64-23f269c2f4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:29.743009 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1ffa3-b371-4e17-bb64-23f269c2f4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:29.743289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1ffa3-b371-4e17-bb64-23f269c2f4c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:29.744456 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1ffa3-b371-4e17-bb64-23f269c2f4c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:29.745952 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1ffa3-b371-4e17-bb64-23f269c2f4c5 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:29.747586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 29/60] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:24:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:29.753112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adfeae-fcf3-45c6-b624-69c8c4c39137 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:29.852359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adfeae-fcf3-45c6-b624-69c8c4c39137 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:29.886483 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11e7bb-2b91-463a-a1ed-ba0d6c2d6408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:29.887162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11e7bb-2b91-463a-a1ed-ba0d6c2d6408 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:29.887453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11e7bb-2b91-463a-a1ed-ba0d6c2d6408 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:29.887739 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11e7bb-2b91-463a-a1ed-ba0d6c2d6408 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:29.888452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11e7bb-2b91-463a-a1ed-ba0d6c2d6408 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:29.889948 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11e7bb-2b91-463a-a1ed-ba0d6c2d6408 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:29.994793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 32/61] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:24:29 2022] POST /identity/v3/users => generated 275 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:24:33.388606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8a74c-70c4-4ec6-bb80-376db4c79a23 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:33.389649 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8a74c-70c4-4ec6-bb80-376db4c79a23 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:33.390199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8a74c-70c4-4ec6-bb80-376db4c79a23 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:33.391793 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 30/62] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:33.399247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df7f63-a8d5-48ac-aa9b-6f52bbe5ea3d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:33.400114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df7f63-a8d5-48ac-aa9b-6f52bbe5ea3d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:33.400607 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df7f63-a8d5-48ac-aa9b-6f52bbe5ea3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:33.410247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:33.421982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a6df7f63-a8d5-48ac-aa9b-6f52bbe5ea3d None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:33.423218 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a6df7f63-a8d5-48ac-aa9b-6f52bbe5ea3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:33.441546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b75ece-09eb-4c42-b1aa-857d4310be17 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:33.442352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b75ece-09eb-4c42-b1aa-857d4310be17 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:33.442858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b75ece-09eb-4c42-b1aa-857d4310be17 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:33.444457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:24:33.450164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09486fb-f8cb-47b4-b83c-dfd4d0fe5fd9 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:33.450730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09486fb-f8cb-47b4-b83c-dfd4d0fe5fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:33.451221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09486fb-f8cb-47b4-b83c-dfd4d0fe5fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:33.502010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-d09486fb-f8cb-47b4-b83c-dfd4d0fe5fd9 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:33.504281 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d09486fb-f8cb-47b4-b83c-dfd4d0fe5fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:33.506343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 33/64] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:33.508060 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d117428-0a0a-45ca-9345-b8d7a1b5f2e0 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:33.508542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d117428-0a0a-45ca-9345-b8d7a1b5f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:33.509036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d117428-0a0a-45ca-9345-b8d7a1b5f2e0 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:33.510793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 34/65] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:33.516339 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f997ace-a378-42e4-8f46-b177f9b39f21 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:33.516878 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f997ace-a378-42e4-8f46-b177f9b39f21 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:33.517392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f997ace-a378-42e4-8f46-b177f9b39f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:33.534477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7f997ace-a378-42e4-8f46-b177f9b39f21 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:33.536753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7f997ace-a378-42e4-8f46-b177f9b39f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:33.580306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 32/66] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:24:33.581584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09486fb-f8cb-47b4-b83c-dfd4d0fe5fd9 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:33.611052 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 35/67] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:33.621710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f997ace-a378-42e4-8f46-b177f9b39f21 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:33.703288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09486fb-f8cb-47b4-b83c-dfd4d0fe5fd9 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:33.707675 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:33.710859 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:33.751071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f997ace-a378-42e4-8f46-b177f9b39f21 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:33.752158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfd6b3-089c-482d-b65a-cd11a089c1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:33.753958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfd6b3-089c-482d-b65a-cd11a089c1cc None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:33.755192 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfd6b3-089c-482d-b65a-cd11a089c1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:33.755645 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfd6b3-089c-482d-b65a-cd11a089c1cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:33.770524 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfd6b3-089c-482d-b65a-cd11a089c1cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-6ccfd6b3-089c-482d-b65a-cd11a089c1cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:33.782426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:33.783532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:33.785069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:33.785069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:33.785069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:33.785069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:33.785069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:33.785069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:33.785069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:33.785069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:33.785069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:33.785069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:33.785069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:33.785069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:24:33.787658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 33/68] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:33.789527 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfd6b3-089c-482d-b65a-cd11a089c1cc None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:33.793495 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24089a9d-d8f5-4d9a-bfee-cf88aa2be592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:33.794817 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24089a9d-d8f5-4d9a-bfee-cf88aa2be592 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:33.794817 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24089a9d-d8f5-4d9a-bfee-cf88aa2be592 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:33.795216 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24089a9d-d8f5-4d9a-bfee-cf88aa2be592 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:33.807050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24089a9d-d8f5-4d9a-bfee-cf88aa2be592 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-24089a9d-d8f5-4d9a-bfee-cf88aa2be592 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:33.815390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:33.816892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:33.817695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:33.817695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:33.817695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:33.817695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:33.817695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:33.817695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:33.817695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:33.817695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:33.817695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:33.817695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:33.817695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:33.817695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:33.823992 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 36/69] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:24:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:33.823992 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24089a9d-d8f5-4d9a-bfee-cf88aa2be592 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:33.934626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfd6b3-089c-482d-b65a-cd11a089c1cc None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:33.948191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24089a9d-d8f5-4d9a-bfee-cf88aa2be592 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:33.978038 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:33.979781 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0f112-c93f-4da8-af23-32555df46f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:33.981845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0f112-c93f-4da8-af23-32555df46f00 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:33.982315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0f112-c93f-4da8-af23-32555df46f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:33.983086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0f112-c93f-4da8-af23-32555df46f00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:33.991159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe509e4-70ee-4ecb-abaf-43d8fcc2fc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:33.992141 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe509e4-70ee-4ecb-abaf-43d8fcc2fc06 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:33.992544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe509e4-70ee-4ecb-abaf-43d8fcc2fc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:33.993051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe509e4-70ee-4ecb-abaf-43d8fcc2fc06 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:33.993811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe509e4-70ee-4ecb-abaf-43d8fcc2fc06 None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:33.994218 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe509e4-70ee-4ecb-abaf-43d8fcc2fc06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:33.996043 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe509e4-70ee-4ecb-abaf-43d8fcc2fc06 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:33.999604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0f112-c93f-4da8-af23-32555df46f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:34.004829 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 37/70] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:24:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:34.005689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe509e4-70ee-4ecb-abaf-43d8fcc2fc06 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-50a0f112-c93f-4da8-af23-32555df46f00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:34.010405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:34.011268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:34.012043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:34.012043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:34.012043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:34.012043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:34.012043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:34.012043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:34.012043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:34.012043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:34.012043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:34.012043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:34.012043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:24:34.012043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:24:34.012043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 34/71] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:24:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:34.013626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721ad2b-4616-4066-8997-ab4d0c1a4e5a None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:34.013626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721ad2b-4616-4066-8997-ab4d0c1a4e5a None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:34.013626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721ad2b-4616-4066-8997-ab4d0c1a4e5a None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:34.015033 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 35/72] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:34.015592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721ad2b-4616-4066-8997-ab4d0c1a4e5a None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:34.048197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:34.115202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe509e4-70ee-4ecb-abaf-43d8fcc2fc06 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:34.130426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721ad2b-4616-4066-8997-ab4d0c1a4e5a None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:34.150997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdab92-b54c-4727-bbf9-2629d6afe09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:34.151686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdab92-b54c-4727-bbf9-2629d6afe09e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:34.151982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdab92-b54c-4727-bbf9-2629d6afe09e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:34.152265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdab92-b54c-4727-bbf9-2629d6afe09e None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:34.153076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdab92-b54c-4727-bbf9-2629d6afe09e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:34.153377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdab92-b54c-4727-bbf9-2629d6afe09e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:34.154783 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdab92-b54c-4727-bbf9-2629d6afe09e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:34.162993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 38/73] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:34.163810 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdab92-b54c-4727-bbf9-2629d6afe09e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:34.170745 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d0ff9-8e9f-459f-97e5-5528c9a49e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:34.171865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d0ff9-8e9f-459f-97e5-5528c9a49e88 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:34.172333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d0ff9-8e9f-459f-97e5-5528c9a49e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:34.172800 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d0ff9-8e9f-459f-97e5-5528c9a49e88 None admin] PATH_INFO: `/v3/users/a52d7d11a1784629a115d5e9c42434a1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:34.191867 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d0ff9-8e9f-459f-97e5-5528c9a49e88 None admin] RBAC: Authorizing `identity:get_user(user_id=a52d7d11a1784629a115d5e9c42434a1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:34.193392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d0ff9-8e9f-459f-97e5-5528c9a49e88 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:34.195104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 36/74] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:34 2022] GET /identity/v3/users/a52d7d11a1784629a115d5e9c42434a1 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:34.196565 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b45a34-5b5f-4b2f-91f7-b01d6bf500f1 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:34.196857 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b45a34-5b5f-4b2f-91f7-b01d6bf500f1 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:34.197157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b45a34-5b5f-4b2f-91f7-b01d6bf500f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:34.213775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-23b45a34-5b5f-4b2f-91f7-b01d6bf500f1 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:34.215007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-23b45a34-5b5f-4b2f-91f7-b01d6bf500f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:34.220229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:34.271243 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdab92-b54c-4727-bbf9-2629d6afe09e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:34.282210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 37/75] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:34.283048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b45a34-5b5f-4b2f-91f7-b01d6bf500f1 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:34.297956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:34.317282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891e054-3deb-4859-8454-53b8d984db10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:34.318078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891e054-3deb-4859-8454-53b8d984db10 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:34.318371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891e054-3deb-4859-8454-53b8d984db10 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:34.318678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891e054-3deb-4859-8454-53b8d984db10 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:34.319437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891e054-3deb-4859-8454-53b8d984db10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:34.319751 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891e054-3deb-4859-8454-53b8d984db10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:34.321166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891e054-3deb-4859-8454-53b8d984db10 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:34.329201 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 39/76] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:24:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:34.330435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592abc4-330f-4c38-9133-c0f3f07e8f24 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:34.330733 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592abc4-330f-4c38-9133-c0f3f07e8f24 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:34.331016 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592abc4-330f-4c38-9133-c0f3f07e8f24 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:34.333065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 40/77] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:34.335604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592abc4-330f-4c38-9133-c0f3f07e8f24 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:34.393215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b45a34-5b5f-4b2f-91f7-b01d6bf500f1 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:34.427265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fe11e-efd0-4199-8d40-f97f611894dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:34.428140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fe11e-efd0-4199-8d40-f97f611894dd None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:34.428424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fe11e-efd0-4199-8d40-f97f611894dd None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:34.428711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fe11e-efd0-4199-8d40-f97f611894dd None admin] PATH_INFO: `/v3/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:34.429918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fe11e-efd0-4199-8d40-f97f611894dd None admin] RBAC: Authorizing `identity:get_user(user_id=e7e43dc5addf4a3b9b9bacb5e1aa59a0)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:34.431541 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fe11e-efd0-4199-8d40-f97f611894dd None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:34.433193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 38/78] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:34 2022] GET /identity/v3/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:34.433941 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fe11e-efd0-4199-8d40-f97f611894dd None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:34.442359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592abc4-330f-4c38-9133-c0f3f07e8f24 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:34.452538 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:34.476162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a348f67-8bca-473d-84db-5d05d959ee09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:34.476830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a348f67-8bca-473d-84db-5d05d959ee09 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:34.477182 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a348f67-8bca-473d-84db-5d05d959ee09 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:34.477776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a348f67-8bca-473d-84db-5d05d959ee09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:34.519126 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:34.537113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fe11e-efd0-4199-8d40-f97f611894dd None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:34.546606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a348f67-8bca-473d-84db-5d05d959ee09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:34.548092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a348f67-8bca-473d-84db-5d05d959ee09 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:34.571121 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb4be6-fb4a-4fd0-9eb1-64ebde2f4e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:34.572298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb4be6-fb4a-4fd0-9eb1-64ebde2f4e79 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:34.572579 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb4be6-fb4a-4fd0-9eb1-64ebde2f4e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:34.572857 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb4be6-fb4a-4fd0-9eb1-64ebde2f4e79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:34.583375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb4be6-fb4a-4fd0-9eb1-64ebde2f4e79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-8beb4be6-fb4a-4fd0-9eb1-64ebde2f4e79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:34.591115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:34.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:34.593147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:34.593147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:34.593147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:34.593147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:34.593147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:34.593147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:34.593147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:34.593147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:34.593147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:34.593147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:34.593147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:34.593147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:24:34.593147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 39/79] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:34.593147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb4be6-fb4a-4fd0-9eb1-64ebde2f4e79 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:34.652951 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 41/80] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:24:34.654399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53641e90-d625-43ba-98fa-3ea582a6cb8f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:34.654698 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53641e90-d625-43ba-98fa-3ea582a6cb8f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:34.654977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53641e90-d625-43ba-98fa-3ea582a6cb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:34.675555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-53641e90-d625-43ba-98fa-3ea582a6cb8f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:34.676763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-53641e90-d625-43ba-98fa-3ea582a6cb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:34.680501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:34.703831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb4be6-fb4a-4fd0-9eb1-64ebde2f4e79 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:34.738750 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a63426-8a88-4c17-a848-23c930a21622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:34.739627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a63426-8a88-4c17-a848-23c930a21622 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:34.739913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a63426-8a88-4c17-a848-23c930a21622 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:34.740194 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a63426-8a88-4c17-a848-23c930a21622 None admin] PATH_INFO: `/v3/users/a52d7d11a1784629a115d5e9c42434a1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:34.741535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a63426-8a88-4c17-a848-23c930a21622 None admin] RBAC: Authorizing `identity:get_user(user_id=a52d7d11a1784629a115d5e9c42434a1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:34.742999 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a63426-8a88-4c17-a848-23c930a21622 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:34.748913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 40/81] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:34 2022] GET /identity/v3/users/a52d7d11a1784629a115d5e9c42434a1 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:34.748913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a63426-8a88-4c17-a848-23c930a21622 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:34.760959 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 42/82] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:34.760959 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53641e90-d625-43ba-98fa-3ea582a6cb8f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:34.761193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:34.843160 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a63426-8a88-4c17-a848-23c930a21622 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:34.851443 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53641e90-d625-43ba-98fa-3ea582a6cb8f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:34.877084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece9c7c-684b-403c-886a-f22535371cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:34.877744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece9c7c-684b-403c-886a-f22535371cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:34.878036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece9c7c-684b-403c-886a-f22535371cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:34.878323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece9c7c-684b-403c-886a-f22535371cd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:34.885339 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cdb31-a6df-4966-8b31-16f51cb049bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:34.886008 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cdb31-a6df-4966-8b31-16f51cb049bf None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:34.886293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cdb31-a6df-4966-8b31-16f51cb049bf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:34.886569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cdb31-a6df-4966-8b31-16f51cb049bf None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:34.887352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cdb31-a6df-4966-8b31-16f51cb049bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:34.887657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cdb31-a6df-4966-8b31-16f51cb049bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:34.889094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cdb31-a6df-4966-8b31-16f51cb049bf None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:34.897608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 43/83] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:24:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:34.898392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cdb31-a6df-4966-8b31-16f51cb049bf None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:34.900837 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:34.947179 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece9c7c-684b-403c-886a-f22535371cd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:34.948659 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece9c7c-684b-403c-886a-f22535371cd7 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:34.958605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:35.001568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cdb31-a6df-4966-8b31-16f51cb049bf None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:35.040955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030bf6-2f3d-46f1-9b65-66860365b506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:35.041851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030bf6-2f3d-46f1-9b65-66860365b506 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:35.042136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030bf6-2f3d-46f1-9b65-66860365b506 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:35.042414 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030bf6-2f3d-46f1-9b65-66860365b506 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:35.043633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a030bf6-2f3d-46f1-9b65-66860365b506 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:35.045123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a030bf6-2f3d-46f1-9b65-66860365b506 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:35.046833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 44/84] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:34 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:35.047609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030bf6-2f3d-46f1-9b65-66860365b506 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:35.053108 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 41/85] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:24:35.053867 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece9c7c-684b-403c-886a-f22535371cd7 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:35.122482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:35.151085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece9c7c-684b-403c-886a-f22535371cd7 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:35.153390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030bf6-2f3d-46f1-9b65-66860365b506 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:35.160513 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:35.184735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cccf81-dabd-45e0-bb89-74bcd08ef906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:35.185562 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cccf81-dabd-45e0-bb89-74bcd08ef906 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:35.185854 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cccf81-dabd-45e0-bb89-74bcd08ef906 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:35.186139 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cccf81-dabd-45e0-bb89-74bcd08ef906 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:35.187188 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16e64d-aef7-4b15-91cf-3b15dc515cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:35.187350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cccf81-dabd-45e0-bb89-74bcd08ef906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:35.187844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16e64d-aef7-4b15-91cf-3b15dc515cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:35.188130 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16e64d-aef7-4b15-91cf-3b15dc515cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:35.188410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16e64d-aef7-4b15-91cf-3b15dc515cc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:35.188826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cccf81-dabd-45e0-bb89-74bcd08ef906 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:35.190562 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 42/86] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:24:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:35.191877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cccf81-dabd-45e0-bb89-74bcd08ef906 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:35.260614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16e64d-aef7-4b15-91cf-3b15dc515cc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:35.262160 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16e64d-aef7-4b15-91cf-3b15dc515cc5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:35.291041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cccf81-dabd-45e0-bb89-74bcd08ef906 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:35.328299 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f33a7-53d8-4c91-9ed3-ac4ff1186e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:35.329224 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f33a7-53d8-4c91-9ed3-ac4ff1186e7f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:35.329516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f33a7-53d8-4c91-9ed3-ac4ff1186e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:35.329809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f33a7-53d8-4c91-9ed3-ac4ff1186e7f None admin] PATH_INFO: `/v3/users/a52d7d11a1784629a115d5e9c42434a1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:35.331054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f33a7-53d8-4c91-9ed3-ac4ff1186e7f None admin] RBAC: Authorizing `identity:get_user(user_id=a52d7d11a1784629a115d5e9c42434a1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:35.333216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f33a7-53d8-4c91-9ed3-ac4ff1186e7f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:35.334868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 43/87] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:35 2022] GET /identity/v3/users/a52d7d11a1784629a115d5e9c42434a1 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:35.335054 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:35.335774 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f33a7-53d8-4c91-9ed3-ac4ff1186e7f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:35.369673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 45/88] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:24:35.370533 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16e64d-aef7-4b15-91cf-3b15dc515cc5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:35.386957 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:35.442853 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f33a7-53d8-4c91-9ed3-ac4ff1186e7f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:35.475049 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16e64d-aef7-4b15-91cf-3b15dc515cc5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:35.475554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5f490-c356-4ad1-855e-d0c78ae851a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:35.476161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5f490-c356-4ad1-855e-d0c78ae851a2 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:35.476489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5f490-c356-4ad1-855e-d0c78ae851a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:35.476720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5f490-c356-4ad1-855e-d0c78ae851a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:35.478140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5f490-c356-4ad1-855e-d0c78ae851a2 None admin] RBAC: Adding query filter params (role.id=e8531ae972c749c0a8ea8a73601c5cd1, scope.project.id=0bc23eb82d084bf399415f38e4538aab, user.id=a52d7d11a1784629a115d5e9c42434a1) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:35.478140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5f490-c356-4ad1-855e-d0c78ae851a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:35.479679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5f490-c356-4ad1-855e-d0c78ae851a2 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:35.488667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 44/89] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:24:35 2022] GET /identity/v3/role_assignments?user.id=a52d7d11a1784629a115d5e9c42434a1&scope.project.id=0bc23eb82d084bf399415f38e4538aab&role.id=e8531ae972c749c0a8ea8a73601c5cd1 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:35.489491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5f490-c356-4ad1-855e-d0c78ae851a2 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:35.513949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea19bc3-1354-462c-a5b0-61f4535d9900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:35.514894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea19bc3-1354-462c-a5b0-61f4535d9900 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:35.515192 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea19bc3-1354-462c-a5b0-61f4535d9900 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:35.515479 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea19bc3-1354-462c-a5b0-61f4535d9900 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:35.517280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea19bc3-1354-462c-a5b0-61f4535d9900 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:35.519202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea19bc3-1354-462c-a5b0-61f4535d9900 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:35.525799 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 46/90] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:35 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:35.525799 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea19bc3-1354-462c-a5b0-61f4535d9900 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:35.569665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:35.627713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5f490-c356-4ad1-855e-d0c78ae851a2 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:35.634739 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea19bc3-1354-462c-a5b0-61f4535d9900 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:35.640662 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:35.670504 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b9bbc-b4bc-4525-ad74-500fd8229eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:35.671672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b9bbc-b4bc-4525-ad74-500fd8229eb3 None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:35.672173 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b9bbc-b4bc-4525-ad74-500fd8229eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:35.672673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b9bbc-b4bc-4525-ad74-500fd8229eb3 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:35.673595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f18d8b-fe77-4dfd-9a03-3494d6d9354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:35.674084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b9bbc-b4bc-4525-ad74-500fd8229eb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:35.674413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f18d8b-fe77-4dfd-9a03-3494d6d9354f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:35.674702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f18d8b-fe77-4dfd-9a03-3494d6d9354f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:35.674982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f18d8b-fe77-4dfd-9a03-3494d6d9354f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:35.677372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b9bbc-b4bc-4525-ad74-500fd8229eb3 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:35.751517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f18d8b-fe77-4dfd-9a03-3494d6d9354f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:35.753077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f18d8b-fe77-4dfd-9a03-3494d6d9354f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:35.775677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 45/91] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:24:35 2022] POST /identity/v3/users => generated 289 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:24:35.776873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b9bbc-b4bc-4525-ad74-500fd8229eb3 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:35.813209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:35.891442 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 47/92] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:24:35.891442 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f18d8b-fe77-4dfd-9a03-3494d6d9354f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:35.935956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b9bbc-b4bc-4525-ad74-500fd8229eb3 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:35.978243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461be974-0d59-4449-9231-c5fc8a5b1719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:35.979350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461be974-0d59-4449-9231-c5fc8a5b1719 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:35.979744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461be974-0d59-4449-9231-c5fc8a5b1719 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:35.980389 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461be974-0d59-4449-9231-c5fc8a5b1719 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:35.981895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461be974-0d59-4449-9231-c5fc8a5b1719 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:35.983635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461be974-0d59-4449-9231-c5fc8a5b1719 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:35.985712 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 46/93] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:35 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:35.986632 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461be974-0d59-4449-9231-c5fc8a5b1719 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:36.022182 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f18d8b-fe77-4dfd-9a03-3494d6d9354f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:36.028674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:36.070620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b0a23-b72a-4321-b64e-6cd3e0afbf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:36.072327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b0a23-b72a-4321-b64e-6cd3e0afbf32 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:36.072620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b0a23-b72a-4321-b64e-6cd3e0afbf32 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:36.072906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b0a23-b72a-4321-b64e-6cd3e0afbf32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:36.073797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b0a23-b72a-4321-b64e-6cd3e0afbf32 None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=0bc23eb82d084bf399415f38e4538aab, user.id=e7e43dc5addf4a3b9b9bacb5e1aa59a0) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:36.074117 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b0a23-b72a-4321-b64e-6cd3e0afbf32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:36.075666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b0a23-b72a-4321-b64e-6cd3e0afbf32 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:36.083708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 48/94] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:24:35 2022] GET /identity/v3/role_assignments?user.id=e7e43dc5addf4a3b9b9bacb5e1aa59a0&scope.project.id=0bc23eb82d084bf399415f38e4538aab&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:36.085600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b0a23-b72a-4321-b64e-6cd3e0afbf32 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:36.093036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:36.139258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461be974-0d59-4449-9231-c5fc8a5b1719 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:36.183868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dec96-2631-47b9-9830-a2c17f6cd343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:36.185244 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dec96-2631-47b9-9830-a2c17f6cd343 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:36.185541 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dec96-2631-47b9-9830-a2c17f6cd343 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:36.185831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dec96-2631-47b9-9830-a2c17f6cd343 None admin] PATH_INFO: `/v3/projects/3aaa354cd3344a538fdf602af5898fed` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:36.187102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dec96-2631-47b9-9830-a2c17f6cd343 None admin] RBAC: Authorizing `identity:get_project(project_id=3aaa354cd3344a538fdf602af5898fed)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:36.188708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dec96-2631-47b9-9830-a2c17f6cd343 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:36.191621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 47/95] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:35 2022] GET /identity/v3/projects/3aaa354cd3344a538fdf602af5898fed => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:36.197881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dec96-2631-47b9-9830-a2c17f6cd343 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:36.234076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b0a23-b72a-4321-b64e-6cd3e0afbf32 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:36.273670 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97cafe-a181-4b8b-90ed-8e839e15929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:36.274419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97cafe-a181-4b8b-90ed-8e839e15929d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:36.274715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97cafe-a181-4b8b-90ed-8e839e15929d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:36.275000 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97cafe-a181-4b8b-90ed-8e839e15929d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:36.276097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97cafe-a181-4b8b-90ed-8e839e15929d None admin] RBAC: Adding query filter params (role.id=58b5b157099e42bcb4ee3eff9aaf2064, scope.project.id=0bc23eb82d084bf399415f38e4538aab, user.id=a52d7d11a1784629a115d5e9c42434a1) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:36.276211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97cafe-a181-4b8b-90ed-8e839e15929d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:36.277866 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97cafe-a181-4b8b-90ed-8e839e15929d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:36.285961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 49/96] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:24:36 2022] GET /identity/v3/role_assignments?user.id=a52d7d11a1784629a115d5e9c42434a1&scope.project.id=0bc23eb82d084bf399415f38e4538aab&role.id=58b5b157099e42bcb4ee3eff9aaf2064 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:36.322656 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:36.326597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dec96-2631-47b9-9830-a2c17f6cd343 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:36.391516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ad624-c896-4aef-befd-0b7e326b2aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:36.391720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ad624-c896-4aef-befd-0b7e326b2aff None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:36.391935 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ad624-c896-4aef-befd-0b7e326b2aff None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:36.395076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ad624-c896-4aef-befd-0b7e326b2aff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:36.398915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ad624-c896-4aef-befd-0b7e326b2aff None admin] RBAC: Adding query filter params (role.id=e8531ae972c749c0a8ea8a73601c5cd1, scope.project.id=3aaa354cd3344a538fdf602af5898fed, user.id=a52d7d11a1784629a115d5e9c42434a1) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:36.399225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ad624-c896-4aef-befd-0b7e326b2aff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:36.404587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ad624-c896-4aef-befd-0b7e326b2aff None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:36.416088 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 48/97] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:24:36 2022] GET /identity/v3/role_assignments?user.id=a52d7d11a1784629a115d5e9c42434a1&scope.project.id=3aaa354cd3344a538fdf602af5898fed&role.id=e8531ae972c749c0a8ea8a73601c5cd1 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:38.523060 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e32fa-3386-45ae-9941-ac09e8d0baca None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:38.523562 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e32fa-3386-45ae-9941-ac09e8d0baca None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:38.523635 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e32fa-3386-45ae-9941-ac09e8d0baca None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:38.525156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 50/98] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:38.530800 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d6405-3ff3-4d3e-894a-66023f7d0a3f None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:38.531618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d6405-3ff3-4d3e-894a-66023f7d0a3f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:38.532113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d6405-3ff3-4d3e-894a-66023f7d0a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:38.566186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-906d6405-3ff3-4d3e-894a-66023f7d0a3f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:38.567767 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-906d6405-3ff3-4d3e-894a-66023f7d0a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:38.667060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 49/99] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:38.702868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e32fa-3386-45ae-9941-ac09e8d0baca None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:38.889422 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:38.936931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e32fa-3386-45ae-9941-ac09e8d0baca None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:38.984093 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0117d-d689-45f4-9ccf-d8f97d6c803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:38.984988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0117d-d689-45f4-9ccf-d8f97d6c803b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:38.985288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0117d-d689-45f4-9ccf-d8f97d6c803b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:38.985573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0117d-d689-45f4-9ccf-d8f97d6c803b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:39.004346 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0117d-d689-45f4-9ccf-d8f97d6c803b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-afb0117d-d689-45f4-9ccf-d8f97d6c803b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:39.012374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:39.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:39.014089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:39.014089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:39.014089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:39.014089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:39.014089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:39.014089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:39.014089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:39.014089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:39.014089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:39.014089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:39.014089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:39.014089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:39.014089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 51/100] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:39.020277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d6405-3ff3-4d3e-894a-66023f7d0a3f None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:39.142626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:39.149864 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d6405-3ff3-4d3e-894a-66023f7d0a3f None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:39.195175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9fb31-d6a1-4cbc-99c0-db795c9367fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:39.195867 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9fb31-d6a1-4cbc-99c0-db795c9367fd None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:39.196158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9fb31-d6a1-4cbc-99c0-db795c9367fd None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:39.196446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9fb31-d6a1-4cbc-99c0-db795c9367fd None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:39.197237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9fb31-d6a1-4cbc-99c0-db795c9367fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:39.197553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9fb31-d6a1-4cbc-99c0-db795c9367fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:39.198953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9fb31-d6a1-4cbc-99c0-db795c9367fd None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:39.216311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 50/101] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:24:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:39.223091 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0117d-d689-45f4-9ccf-d8f97d6c803b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:39.303130 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379b1bf-41f5-4cdd-a30b-770080a47e55 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:39.303529 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379b1bf-41f5-4cdd-a30b-770080a47e55 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:39.303883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379b1bf-41f5-4cdd-a30b-770080a47e55 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:39.305373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 51/102] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:39.312224 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be602d-dcef-49df-b649-8fbfa1e02e86 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:39.312600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be602d-dcef-49df-b649-8fbfa1e02e86 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:39.312993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be602d-dcef-49df-b649-8fbfa1e02e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:39.347067 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-c0be602d-dcef-49df-b649-8fbfa1e02e86 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:39.348298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-c0be602d-dcef-49df-b649-8fbfa1e02e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:39.445440 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0117d-d689-45f4-9ccf-d8f97d6c803b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:39.521994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:39.545741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8187f-311e-4193-a4cd-890a894e2120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:39.546660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8187f-311e-4193-a4cd-890a894e2120 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:39.546956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8187f-311e-4193-a4cd-890a894e2120 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:39.547240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8187f-311e-4193-a4cd-890a894e2120 None admin] PATH_INFO: `/v3/users/a52d7d11a1784629a115d5e9c42434a1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:39.548556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8187f-311e-4193-a4cd-890a894e2120 None admin] RBAC: Authorizing `identity:get_user(user_id=a52d7d11a1784629a115d5e9c42434a1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:39.550158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8187f-311e-4193-a4cd-890a894e2120 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:39.551821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 52/103] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:39 2022] GET /identity/v3/users/a52d7d11a1784629a115d5e9c42434a1 => generated 275 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:39.558061 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8187f-311e-4193-a4cd-890a894e2120 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:39.559662 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 52/104] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:24:39.596775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be602d-dcef-49df-b649-8fbfa1e02e86 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:39.756899 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8187f-311e-4193-a4cd-890a894e2120 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:39.803578 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:39.840802 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be602d-dcef-49df-b649-8fbfa1e02e86 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:39.852819 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba53d53-df00-40f7-8bac-c5ae8e4ea5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:39.853748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba53d53-df00-40f7-8bac-c5ae8e4ea5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:39.854043 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba53d53-df00-40f7-8bac-c5ae8e4ea5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:39.854330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba53d53-df00-40f7-8bac-c5ae8e4ea5b1 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:39.861756 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba53d53-df00-40f7-8bac-c5ae8e4ea5b1 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:39.864045 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba53d53-df00-40f7-8bac-c5ae8e4ea5b1 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:39.865879 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 53/105] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:39 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:39.867229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aa206-6de8-4aff-ab51-72b5608023b6 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:39.867529 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aa206-6de8-4aff-ab51-72b5608023b6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:39.867813 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aa206-6de8-4aff-ab51-72b5608023b6 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:39.869404 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 54/106] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:39.875137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aa206-6de8-4aff-ab51-72b5608023b6 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:39.885697 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e157f4-3b9d-45a7-8cd9-33b7620db88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:39.886798 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e157f4-3b9d-45a7-8cd9-33b7620db88f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:39.887272 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e157f4-3b9d-45a7-8cd9-33b7620db88f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:39.887735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e157f4-3b9d-45a7-8cd9-33b7620db88f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:39.913899 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e157f4-3b9d-45a7-8cd9-33b7620db88f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-b4e157f4-3b9d-45a7-8cd9-33b7620db88f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:39.927203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:39.928154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:39.928916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:39.928916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:39.928916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:39.928916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:39.928916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:39.928916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:39.928916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:39.928916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:39.928916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:39.928916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:39.928916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:24:39.928916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:24:39.935372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 53/107] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:24:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:24:39.937669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e59f1b-bb17-4eb3-9bac-56d22dca407a None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:39.940100 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e59f1b-bb17-4eb3-9bac-56d22dca407a None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:39.942497 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e59f1b-bb17-4eb3-9bac-56d22dca407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:39.963367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-83e59f1b-bb17-4eb3-9bac-56d22dca407a None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:39.964555 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-83e59f1b-bb17-4eb3-9bac-56d22dca407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:39.977538 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:40.018248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aa206-6de8-4aff-ab51-72b5608023b6 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:40.032099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 54/108] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:40.032974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e59f1b-bb17-4eb3-9bac-56d22dca407a None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:40.054388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7349830-ee52-4e1a-8b03-efdaa7bc6739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:40.055442 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7349830-ee52-4e1a-8b03-efdaa7bc6739 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:40.056063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7349830-ee52-4e1a-8b03-efdaa7bc6739 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:40.056063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7349830-ee52-4e1a-8b03-efdaa7bc6739 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab/users/a52d7d11a1784629a115d5e9c42434a1/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:40.058145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7349830-ee52-4e1a-8b03-efdaa7bc6739 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc23eb82d084bf399415f38e4538aab, user_id=a52d7d11a1784629a115d5e9c42434a1, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:40.059604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7349830-ee52-4e1a-8b03-efdaa7bc6739 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:40.117083 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:40.139914 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e59f1b-bb17-4eb3-9bac-56d22dca407a None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:40.144702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 55/109] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:24:39 2022] PUT /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab/users/a52d7d11a1784629a115d5e9c42434a1/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:24:40.146142 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bf22b-f5ec-4917-9512-59e1227976b8 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:40.146436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bf22b-f5ec-4917-9512-59e1227976b8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:40.146717 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bf22b-f5ec-4917-9512-59e1227976b8 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:40.148057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 56/110] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:40.156551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826ab07-9df1-471b-a4b4-1429d080b157 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:40.156551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826ab07-9df1-471b-a4b4-1429d080b157 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:40.156551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826ab07-9df1-471b-a4b4-1429d080b157 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:40.156551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 57/111] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:40.157275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4a15e-1c6c-4803-b1c8-fb4f55cf5c41 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:40.157575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4a15e-1c6c-4803-b1c8-fb4f55cf5c41 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:40.157865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4a15e-1c6c-4803-b1c8-fb4f55cf5c41 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:40.159632 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 58/112] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:40.160469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4a15e-1c6c-4803-b1c8-fb4f55cf5c41 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:40.196778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2953f4c-d0d8-4281-8a5a-a6f6449d9f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:40.197885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2953f4c-d0d8-4281-8a5a-a6f6449d9f6c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:40.198180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2953f4c-d0d8-4281-8a5a-a6f6449d9f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:40.198466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2953f4c-d0d8-4281-8a5a-a6f6449d9f6c None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:40.199338 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2953f4c-d0d8-4281-8a5a-a6f6449d9f6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:40.199819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2953f4c-d0d8-4281-8a5a-a6f6449d9f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:40.201238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2953f4c-d0d8-4281-8a5a-a6f6449d9f6c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:40.216114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 55/113] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:24:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:40.216114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9184c0-5fb9-4d71-9bb7-e9d9857e827b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:40.216114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9184c0-5fb9-4d71-9bb7-e9d9857e827b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:40.216114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9184c0-5fb9-4d71-9bb7-e9d9857e827b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:40.234083 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-0f9184c0-5fb9-4d71-9bb7-e9d9857e827b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:40.235353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0f9184c0-5fb9-4d71-9bb7-e9d9857e827b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:40.285508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4a15e-1c6c-4803-b1c8-fb4f55cf5c41 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:40.310884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:40.321126 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 56/114] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:40.322937 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a868829-b016-41f7-9d4f-9e4c1840ff5c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:40.324918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a868829-b016-41f7-9d4f-9e4c1840ff5c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:40.324918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a868829-b016-41f7-9d4f-9e4c1840ff5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:40.327957 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbd47b-75e9-4b33-9ad8-512990abf083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:40.329342 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbd47b-75e9-4b33-9ad8-512990abf083 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:40.329818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbd47b-75e9-4b33-9ad8-512990abf083 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:40.331244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbd47b-75e9-4b33-9ad8-512990abf083 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:40.343136 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-0a868829-b016-41f7-9d4f-9e4c1840ff5c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:40.344436 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0a868829-b016-41f7-9d4f-9e4c1840ff5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:40.345459 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbd47b-75e9-4b33-9ad8-512990abf083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-3dfbd47b-75e9-4b33-9ad8-512990abf083 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:40.356361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:40.357292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:40.358067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:40.358067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:40.358067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:40.358067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:40.358067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:40.358067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:40.358067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:40.358067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:40.358067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:40.358067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:40.358067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:40.358067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:40.360387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 59/115] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:40.361820 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332f902-4f39-4782-a8c0-336afb25d29a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:40.362258 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332f902-4f39-4782-a8c0-336afb25d29a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:40.363241 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332f902-4f39-4782-a8c0-336afb25d29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:40.380698 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d332f902-4f39-4782-a8c0-336afb25d29a None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:40.381393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d332f902-4f39-4782-a8c0-336afb25d29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:40.419059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:40.427239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 57/116] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:40.428353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a868829-b016-41f7-9d4f-9e4c1840ff5c None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:40.463614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 60/117] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:40.469870 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332f902-4f39-4782-a8c0-336afb25d29a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:40.550498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a868829-b016-41f7-9d4f-9e4c1840ff5c None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:40.584736 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332f902-4f39-4782-a8c0-336afb25d29a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:40.589323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e10d5-8027-426d-a7fd-021d0ced845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:40.590241 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e10d5-8027-426d-a7fd-021d0ced845b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:40.590528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e10d5-8027-426d-a7fd-021d0ced845b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:40.590805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e10d5-8027-426d-a7fd-021d0ced845b None admin] PATH_INFO: `/v3/users/a52d7d11a1784629a115d5e9c42434a1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:40.592012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e10d5-8027-426d-a7fd-021d0ced845b None admin] RBAC: Authorizing `identity:get_user(user_id=a52d7d11a1784629a115d5e9c42434a1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:40.593520 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e10d5-8027-426d-a7fd-021d0ced845b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:40.600682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 58/118] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:40 2022] GET /identity/v3/users/a52d7d11a1784629a115d5e9c42434a1 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:40.600682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e10d5-8027-426d-a7fd-021d0ced845b None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:40.604092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:40.626849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7419cf-c4a9-4b50-96f8-ff3b30573dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:40.627656 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7419cf-c4a9-4b50-96f8-ff3b30573dac None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:40.627975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7419cf-c4a9-4b50-96f8-ff3b30573dac None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:40.628331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7419cf-c4a9-4b50-96f8-ff3b30573dac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:40.638665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7419cf-c4a9-4b50-96f8-ff3b30573dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-6f7419cf-c4a9-4b50-96f8-ff3b30573dac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:40.647116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:40.648193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:40.649291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:40.649291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:40.649291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:40.649291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:40.649291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:40.649291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:40.649291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:40.649291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:40.649291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:40.649291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:40.649291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:40.649291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:40.649291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 61/119] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:24:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:40.654363 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7419cf-c4a9-4b50-96f8-ff3b30573dac None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:40.689261 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:40.734932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e10d5-8027-426d-a7fd-021d0ced845b None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:40.772558 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7419cf-c4a9-4b50-96f8-ff3b30573dac None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:40.777227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafb160-7012-4795-9ea4-8d3680bf9520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:40.777921 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafb160-7012-4795-9ea4-8d3680bf9520 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:40.778209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafb160-7012-4795-9ea4-8d3680bf9520 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:40.778493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafb160-7012-4795-9ea4-8d3680bf9520 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:40.779246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafb160-7012-4795-9ea4-8d3680bf9520 None admin] RBAC: Adding query filter params (name=member) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:40.779560 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafb160-7012-4795-9ea4-8d3680bf9520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:40.780986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafb160-7012-4795-9ea4-8d3680bf9520 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:40.795803 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 59/120] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:24:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:40.795803 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafb160-7012-4795-9ea4-8d3680bf9520 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:40.810474 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e5187-eec7-43ec-ae1a-93b092dbd2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:40.811225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e5187-eec7-43ec-ae1a-93b092dbd2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:40.811521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e5187-eec7-43ec-ae1a-93b092dbd2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:40.811806 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e5187-eec7-43ec-ae1a-93b092dbd2f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:40.822542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e5187-eec7-43ec-ae1a-93b092dbd2f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-e22e5187-eec7-43ec-ae1a-93b092dbd2f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:40.832273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:40.833419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:40.834460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:40.834460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:40.834460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:40.834460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:40.834460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:40.834460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:40.834460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:40.834460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:40.834460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:40.834460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:40.834460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:24:40.834460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:40.834460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 62/121] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:40.834460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e5187-eec7-43ec-ae1a-93b092dbd2f4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:40.870914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:40.923270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafb160-7012-4795-9ea4-8d3680bf9520 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:40.957073 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:40.957648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e5187-eec7-43ec-ae1a-93b092dbd2f4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:40.965501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942f3fb-ec43-4eb3-87a7-14227d21d500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:40.966741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942f3fb-ec43-4eb3-87a7-14227d21d500 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:40.967029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942f3fb-ec43-4eb3-87a7-14227d21d500 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:40.967314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942f3fb-ec43-4eb3-87a7-14227d21d500 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:40.969049 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942f3fb-ec43-4eb3-87a7-14227d21d500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:40.971646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942f3fb-ec43-4eb3-87a7-14227d21d500 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:40.982618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 60/122] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:24:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:40.982618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942f3fb-ec43-4eb3-87a7-14227d21d500 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:41.011432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a931ed-27ce-46e9-b9d9-6186f499b272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:41.012479 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a931ed-27ce-46e9-b9d9-6186f499b272 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:41.012851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a931ed-27ce-46e9-b9d9-6186f499b272 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:41.013167 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a931ed-27ce-46e9-b9d9-6186f499b272 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:41.014403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a931ed-27ce-46e9-b9d9-6186f499b272 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:41.015895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a931ed-27ce-46e9-b9d9-6186f499b272 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:41.024794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 63/123] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:40 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:41.027623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a931ed-27ce-46e9-b9d9-6186f499b272 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:41.108435 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942f3fb-ec43-4eb3-87a7-14227d21d500 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:41.151698 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:41.155610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a931ed-27ce-46e9-b9d9-6186f499b272 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:41.155727 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89289a-0105-4d79-ad3a-fac1d4db1d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:41.156360 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89289a-0105-4d79-ad3a-fac1d4db1d94 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:41.156876 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89289a-0105-4d79-ad3a-fac1d4db1d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:41.157449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89289a-0105-4d79-ad3a-fac1d4db1d94 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:41.158221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89289a-0105-4d79-ad3a-fac1d4db1d94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:41.158566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89289a-0105-4d79-ad3a-fac1d4db1d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:41.161163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89289a-0105-4d79-ad3a-fac1d4db1d94 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:41.176424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 61/124] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:41.176424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89289a-0105-4d79-ad3a-fac1d4db1d94 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:41.225934 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcb79a-16fa-4837-8590-dbd3b5019577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:41.226757 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcb79a-16fa-4837-8590-dbd3b5019577 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:41.227038 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcb79a-16fa-4837-8590-dbd3b5019577 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:41.227315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcb79a-16fa-4837-8590-dbd3b5019577 None admin] PATH_INFO: `/v3/users/a52d7d11a1784629a115d5e9c42434a1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:41.228689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcb79a-16fa-4837-8590-dbd3b5019577 None admin] RBAC: Authorizing `identity:get_user(user_id=a52d7d11a1784629a115d5e9c42434a1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:41.230473 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcb79a-16fa-4837-8590-dbd3b5019577 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:41.233462 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 64/125] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:41 2022] GET /identity/v3/users/a52d7d11a1784629a115d5e9c42434a1 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:41.233462 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcb79a-16fa-4837-8590-dbd3b5019577 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:41.261440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:41.321864 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89289a-0105-4d79-ad3a-fac1d4db1d94 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:41.357403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcb79a-16fa-4837-8590-dbd3b5019577 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:41.360593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08222871-d986-430c-b7d5-b09d0fa24774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:41.361236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08222871-d986-430c-b7d5-b09d0fa24774 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:41.361527 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08222871-d986-430c-b7d5-b09d0fa24774 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:41.363242 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08222871-d986-430c-b7d5-b09d0fa24774 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:41.363242 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08222871-d986-430c-b7d5-b09d0fa24774 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:41.363518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08222871-d986-430c-b7d5-b09d0fa24774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:41.364952 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08222871-d986-430c-b7d5-b09d0fa24774 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:41.378708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 62/126] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:24:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:41.378708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08222871-d986-430c-b7d5-b09d0fa24774 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:41.403364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a3640-3366-4063-b399-91a90414fa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:41.404235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a3640-3366-4063-b399-91a90414fa5a None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:41.404580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a3640-3366-4063-b399-91a90414fa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:41.405051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a3640-3366-4063-b399-91a90414fa5a None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:41.405832 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a3640-3366-4063-b399-91a90414fa5a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:41.407460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a3640-3366-4063-b399-91a90414fa5a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:41.512982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 65/127] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jun 1 17:24:41 2022] POST /identity/v3/projects => generated 302 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:24:41.512982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a3640-3366-4063-b399-91a90414fa5a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:41.520275 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08222871-d986-430c-b7d5-b09d0fa24774 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:41.544248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:41.567056 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:41.580235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d25941-bb3f-46e0-98a3-3b595bef3343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:41.582556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d25941-bb3f-46e0-98a3-3b595bef3343 None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:41.582931 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d25941-bb3f-46e0-98a3-3b595bef3343 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:41.583288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d25941-bb3f-46e0-98a3-3b595bef3343 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab/users/a52d7d11a1784629a115d5e9c42434a1/roles/58b5b157099e42bcb4ee3eff9aaf2064` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:41.592361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d25941-bb3f-46e0-98a3-3b595bef3343 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc23eb82d084bf399415f38e4538aab, user_id=a52d7d11a1784629a115d5e9c42434a1, role_id=58b5b157099e42bcb4ee3eff9aaf2064)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:41.594328 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d25941-bb3f-46e0-98a3-3b595bef3343 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:41.663029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a3640-3366-4063-b399-91a90414fa5a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:41.704597 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc821d-e86a-431a-a84e-911ce8c4dfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:41.705532 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc821d-e86a-431a-a84e-911ce8c4dfb6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:41.705827 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc821d-e86a-431a-a84e-911ce8c4dfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:41.706740 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc821d-e86a-431a-a84e-911ce8c4dfb6 None admin] PATH_INFO: `/v3/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:41.708028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc821d-e86a-431a-a84e-911ce8c4dfb6 None admin] RBAC: Authorizing `identity:get_user(user_id=e7e43dc5addf4a3b9b9bacb5e1aa59a0)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:41.709584 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc821d-e86a-431a-a84e-911ce8c4dfb6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:41.715946 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 66/128] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:41 2022] GET /identity/v3/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0 => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:41.715946 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc821d-e86a-431a-a84e-911ce8c4dfb6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:41.728202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 63/129] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:24:41 2022] PUT /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab/users/a52d7d11a1784629a115d5e9c42434a1/roles/58b5b157099e42bcb4ee3eff9aaf2064 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:24:41.729446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d25941-bb3f-46e0-98a3-3b595bef3343 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:41.845318 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:41.856835 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc821d-e86a-431a-a84e-911ce8c4dfb6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:41.877851 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d25941-bb3f-46e0-98a3-3b595bef3343 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:41.904879 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135a3b5-f15b-4a2c-9303-6835007d7ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:41.905818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135a3b5-f15b-4a2c-9303-6835007d7ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:41.906247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135a3b5-f15b-4a2c-9303-6835007d7ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:41.906660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135a3b5-f15b-4a2c-9303-6835007d7ad2 None admin] PATH_INFO: `/v3/projects/3aaa354cd3344a538fdf602af5898fed` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:41.908038 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135a3b5-f15b-4a2c-9303-6835007d7ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=3aaa354cd3344a538fdf602af5898fed)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:41.909886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135a3b5-f15b-4a2c-9303-6835007d7ad2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:41.912237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 67/130] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:41 2022] GET /identity/v3/projects/3aaa354cd3344a538fdf602af5898fed => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:41.912983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135a3b5-f15b-4a2c-9303-6835007d7ad2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:41.927867 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0c338-6067-47f1-bcf9-bd3126de0240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:41.928692 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c338-6067-47f1-bcf9-bd3126de0240 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:41.929066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c338-6067-47f1-bcf9-bd3126de0240 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:41.929354 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c338-6067-47f1-bcf9-bd3126de0240 None admin] PATH_INFO: `/v3/users/3967241dee3d4a4bbe4bc5b48ecb0532` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:41.953476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0c338-6067-47f1-bcf9-bd3126de0240 None admin] RBAC: Authorizing `identity:get_user(user_id=3967241dee3d4a4bbe4bc5b48ecb0532)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:41.955837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0c338-6067-47f1-bcf9-bd3126de0240 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:41.957353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 64/131] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:41 2022] GET /identity/v3/users/3967241dee3d4a4bbe4bc5b48ecb0532 => generated 289 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:41.958309 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0c338-6067-47f1-bcf9-bd3126de0240 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:42.014446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:42.069994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135a3b5-f15b-4a2c-9303-6835007d7ad2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:42.096926 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0c338-6067-47f1-bcf9-bd3126de0240 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:42.110117 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef2b22-8b7f-46a2-8b88-38e1b55d4680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:42.111410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef2b22-8b7f-46a2-8b88-38e1b55d4680 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:42.111899 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef2b22-8b7f-46a2-8b88-38e1b55d4680 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:42.112963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef2b22-8b7f-46a2-8b88-38e1b55d4680 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:42.114570 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef2b22-8b7f-46a2-8b88-38e1b55d4680 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:42.116301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef2b22-8b7f-46a2-8b88-38e1b55d4680 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:42.118375 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 68/132] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:41 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:42.119381 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef2b22-8b7f-46a2-8b88-38e1b55d4680 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:42.171014 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e9daa-0dce-44c3-94bd-69e7a1c8b840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:42.173419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e9daa-0dce-44c3-94bd-69e7a1c8b840 None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:42.177624 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e9daa-0dce-44c3-94bd-69e7a1c8b840 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:42.178319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e9daa-0dce-44c3-94bd-69e7a1c8b840 None admin] PATH_INFO: `/v3/projects/3aaa354cd3344a538fdf602af5898fed/users/a52d7d11a1784629a115d5e9c42434a1/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:42.181044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e9daa-0dce-44c3-94bd-69e7a1c8b840 None admin] RBAC: Authorizing `identity:create_grant(project_id=3aaa354cd3344a538fdf602af5898fed, user_id=a52d7d11a1784629a115d5e9c42434a1, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:42.182953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e9daa-0dce-44c3-94bd-69e7a1c8b840 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:42.189570 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:42.268135 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 65/133] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:24:41 2022] PUT /identity/v3/projects/3aaa354cd3344a538fdf602af5898fed/users/a52d7d11a1784629a115d5e9c42434a1/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:24:42.269342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e9daa-0dce-44c3-94bd-69e7a1c8b840 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:42.300809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef2b22-8b7f-46a2-8b88-38e1b55d4680 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:42.372712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e05d5-6641-4d67-a279-b87bb5ccf704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:42.373831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e05d5-6641-4d67-a279-b87bb5ccf704 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:42.374321 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e05d5-6641-4d67-a279-b87bb5ccf704 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:42.374802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e05d5-6641-4d67-a279-b87bb5ccf704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:42.498303 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:42.504254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e9daa-0dce-44c3-94bd-69e7a1c8b840 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:42.536361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e05d5-6641-4d67-a279-b87bb5ccf704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:42.538108 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e05d5-6641-4d67-a279-b87bb5ccf704 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:42.542791 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc4130-0c89-492e-bfae-1ac2102c5a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:42.543714 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc4130-0c89-492e-bfae-1ac2102c5a39 None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:42.544127 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc4130-0c89-492e-bfae-1ac2102c5a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:42.544419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc4130-0c89-492e-bfae-1ac2102c5a39 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:42.546602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc4130-0c89-492e-bfae-1ac2102c5a39 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc23eb82d084bf399415f38e4538aab, user_id=e7e43dc5addf4a3b9b9bacb5e1aa59a0, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:42.548133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc4130-0c89-492e-bfae-1ac2102c5a39 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:42.576302 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:42.656020 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 66/134] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:24:42 2022] PUT /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:24:42.657393 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81a319-dd85-42b9-b6a9-e041453bb9df None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:42.657688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81a319-dd85-42b9-b6a9-e041453bb9df None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:42.657969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81a319-dd85-42b9-b6a9-e041453bb9df None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:42.665373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 67/135] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:42.669939 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 69/136] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:24:42.671408 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf7fb-5c6b-487b-bc6e-c5455ded49fb None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:42.671710 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf7fb-5c6b-487b-bc6e-c5455ded49fb None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:42.671995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf7fb-5c6b-487b-bc6e-c5455ded49fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:42.678064 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e05d5-6641-4d67-a279-b87bb5ccf704 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:42.705371 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-e79cf7fb-5c6b-487b-bc6e-c5455ded49fb None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:42.706737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e79cf7fb-5c6b-487b-bc6e-c5455ded49fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:42.827103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e05d5-6641-4d67-a279-b87bb5ccf704 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:42.857754 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 68/137] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:24:42.877364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:42.885386 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a271b4-ce78-4609-8329-7ba067be584a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:42.886709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a271b4-ce78-4609-8329-7ba067be584a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:42.887175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a271b4-ce78-4609-8329-7ba067be584a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:42.887640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a271b4-ce78-4609-8329-7ba067be584a None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:42.889339 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a271b4-ce78-4609-8329-7ba067be584a None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:42.891141 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a271b4-ce78-4609-8329-7ba067be584a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:42.896381 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 70/138] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:42 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:42.900377 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cf7fb-5c6b-487b-bc6e-c5455ded49fb None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:42.912018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a271b4-ce78-4609-8329-7ba067be584a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:43.018747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:43.031937 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cf7fb-5c6b-487b-bc6e-c5455ded49fb None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:43.052312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a271b4-ce78-4609-8329-7ba067be584a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:43.069641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339e94d-2429-4cda-9f5c-b01a664dd542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:43.070608 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339e94d-2429-4cda-9f5c-b01a664dd542 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:43.071048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339e94d-2429-4cda-9f5c-b01a664dd542 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:43.071476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339e94d-2429-4cda-9f5c-b01a664dd542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:43.091154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339e94d-2429-4cda-9f5c-b01a664dd542 None admin] RBAC: Adding query filter params (role.id=98b5f1ee87964b378ac55b7e47ba10f6, scope.project.id=0bc23eb82d084bf399415f38e4538aab, user.id=3967241dee3d4a4bbe4bc5b48ecb0532) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:43.091154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339e94d-2429-4cda-9f5c-b01a664dd542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:43.091154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339e94d-2429-4cda-9f5c-b01a664dd542 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:43.091154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 69/139] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:24:42 2022] GET /identity/v3/role_assignments?user.id=3967241dee3d4a4bbe4bc5b48ecb0532&scope.project.id=0bc23eb82d084bf399415f38e4538aab&role.id=98b5f1ee87964b378ac55b7e47ba10f6 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:43.116510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b814efe-7543-4cd7-af4e-d1c941563078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:43.117364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814efe-7543-4cd7-af4e-d1c941563078 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:43.117655 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814efe-7543-4cd7-af4e-d1c941563078 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:43.117938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814efe-7543-4cd7-af4e-d1c941563078 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:43.135785 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b814efe-7543-4cd7-af4e-d1c941563078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-3b814efe-7543-4cd7-af4e-d1c941563078 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:43.143803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:43.144767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:43.145560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:43.145560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:43.145560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:43.145560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:43.145560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:43.145560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:43.145560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:43.145560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:43.145560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:43.145560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:43.145560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:43.145560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:43.145560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 71/140] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:43.151542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339e94d-2429-4cda-9f5c-b01a664dd542 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:43.301199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339e94d-2429-4cda-9f5c-b01a664dd542 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:43.359090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7dee9-775f-4a01-b012-671ac3632557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:43.359702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7dee9-775f-4a01-b012-671ac3632557 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:43.359989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7dee9-775f-4a01-b012-671ac3632557 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:43.360269 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7dee9-775f-4a01-b012-671ac3632557 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:43.361046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7dee9-775f-4a01-b012-671ac3632557 None admin] RBAC: Adding query filter params (name=member) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:43.361364 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7dee9-775f-4a01-b012-671ac3632557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:43.362796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7dee9-775f-4a01-b012-671ac3632557 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:43.376790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 70/141] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:24:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:43.382972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b814efe-7543-4cd7-af4e-d1c941563078 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:43.442247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:43.501188 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b814efe-7543-4cd7-af4e-d1c941563078 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:43.545830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f65df2-45f2-4d0c-8da2-244fd46367ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:43.546727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f65df2-45f2-4d0c-8da2-244fd46367ce None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:43.547014 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f65df2-45f2-4d0c-8da2-244fd46367ce None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:43.547295 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f65df2-45f2-4d0c-8da2-244fd46367ce None admin] PATH_INFO: `/v3/users/a52d7d11a1784629a115d5e9c42434a1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:43.549347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f65df2-45f2-4d0c-8da2-244fd46367ce None admin] RBAC: Authorizing `identity:get_user(user_id=a52d7d11a1784629a115d5e9c42434a1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:43.551644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f65df2-45f2-4d0c-8da2-244fd46367ce None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:43.557392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 72/142] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:43 2022] GET /identity/v3/users/a52d7d11a1784629a115d5e9c42434a1 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:43.562972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7dee9-775f-4a01-b012-671ac3632557 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:43.590093 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:43.728497 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7dee9-775f-4a01-b012-671ac3632557 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:43.783466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e9e52-7e47-4049-8446-a8bbadbfb1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:43.784977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e9e52-7e47-4049-8446-a8bbadbfb1db None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:43.785291 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e9e52-7e47-4049-8446-a8bbadbfb1db None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:43.785713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e9e52-7e47-4049-8446-a8bbadbfb1db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:43.870612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e9e52-7e47-4049-8446-a8bbadbfb1db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:43.872080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e9e52-7e47-4049-8446-a8bbadbfb1db None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:43.896253 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:44.003891 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 71/143] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:24:44.014054 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f65df2-45f2-4d0c-8da2-244fd46367ce None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:44.177806 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f65df2-45f2-4d0c-8da2-244fd46367ce None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:44.214218 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:44.231519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164d85f-ceb2-4cf3-b13a-6111e89943b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:44.232395 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164d85f-ceb2-4cf3-b13a-6111e89943b4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:44.232686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164d85f-ceb2-4cf3-b13a-6111e89943b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:44.232986 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164d85f-ceb2-4cf3-b13a-6111e89943b4 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:44.238241 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164d85f-ceb2-4cf3-b13a-6111e89943b4 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:44.239885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164d85f-ceb2-4cf3-b13a-6111e89943b4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:44.241704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 73/144] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:44 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:44.247613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e9e52-7e47-4049-8446-a8bbadbfb1db None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:44.387515 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e9e52-7e47-4049-8446-a8bbadbfb1db None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:44.402511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:44.423324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674f7d2-d9c2-4325-9555-511785c0be9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:44.423991 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674f7d2-d9c2-4325-9555-511785c0be9b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:44.424276 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674f7d2-d9c2-4325-9555-511785c0be9b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:44.424554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674f7d2-d9c2-4325-9555-511785c0be9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:44.425980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674f7d2-d9c2-4325-9555-511785c0be9b None admin] RBAC: Adding query filter params (role.id=e8531ae972c749c0a8ea8a73601c5cd1, scope.project.id=0bc23eb82d084bf399415f38e4538aab, user.id=a52d7d11a1784629a115d5e9c42434a1) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:44.426292 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674f7d2-d9c2-4325-9555-511785c0be9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:44.427771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674f7d2-d9c2-4325-9555-511785c0be9b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:44.437585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 72/145] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:24:44 2022] GET /identity/v3/role_assignments?user.id=a52d7d11a1784629a115d5e9c42434a1&scope.project.id=0bc23eb82d084bf399415f38e4538aab&role.id=e8531ae972c749c0a8ea8a73601c5cd1 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:45.277001 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa69ade-d75c-4d26-ae1a-c082b9534ce8 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:45.277543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa69ade-d75c-4d26-ae1a-c082b9534ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:45.277620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa69ade-d75c-4d26-ae1a-c082b9534ce8 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:45.279080 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 74/146] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:45.284684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e74f0-eff9-45a6-b0a4-f8da85826016 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:45.285140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e74f0-eff9-45a6-b0a4-f8da85826016 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:45.285334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e74f0-eff9-45a6-b0a4-f8da85826016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:45.295428 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acb19f-1898-4cf6-9314-6858daa47273 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:45.295722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acb19f-1898-4cf6-9314-6858daa47273 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:45.296008 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acb19f-1898-4cf6-9314-6858daa47273 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:45.297406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 75/147] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:24:45.302989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669829c-bc0d-4fee-8f83-0fea30d8aa80 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:45.303290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669829c-bc0d-4fee-8f83-0fea30d8aa80 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:45.303575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669829c-bc0d-4fee-8f83-0fea30d8aa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:45.312915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-695e74f0-eff9-45a6-b0a4-f8da85826016 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:45.314188 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-695e74f0-eff9-45a6-b0a4-f8da85826016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:45.337954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0669829c-bc0d-4fee-8f83-0fea30d8aa80 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:45.339163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0669829c-bc0d-4fee-8f83-0fea30d8aa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:45.412836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 73/148] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:45.455230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 76/149] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:24:45.468136 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e74f0-eff9-45a6-b0a4-f8da85826016 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:45.496578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669829c-bc0d-4fee-8f83-0fea30d8aa80 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:45.627487 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669829c-bc0d-4fee-8f83-0fea30d8aa80 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:45.628793 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e74f0-eff9-45a6-b0a4-f8da85826016 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:45.646881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:45.665315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:45.665548 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c7c87-9140-4a3c-a6e6-bbdbefbada3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:45.666592 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c7c87-9140-4a3c-a6e6-bbdbefbada3c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:45.666877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c7c87-9140-4a3c-a6e6-bbdbefbada3c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:45.667155 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c7c87-9140-4a3c-a6e6-bbdbefbada3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:45.669157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c7c87-9140-4a3c-a6e6-bbdbefbada3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:45.671181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c7c87-9140-4a3c-a6e6-bbdbefbada3c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:45.673349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 77/150] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:24:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:45.673849 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8cf59-a11c-4f35-96d9-27705c01eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:45.674666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc196f1-0c74-44a4-b3ea-7aac76a55e4c None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:45.675073 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc196f1-0c74-44a4-b3ea-7aac76a55e4c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:45.675430 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc196f1-0c74-44a4-b3ea-7aac76a55e4c None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:45.675851 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8cf59-a11c-4f35-96d9-27705c01eaaf None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:45.676329 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8cf59-a11c-4f35-96d9-27705c01eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:45.676667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 78/151] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:45.677045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8cf59-a11c-4f35-96d9-27705c01eaaf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:45.681847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc196f1-0c74-44a4-b3ea-7aac76a55e4c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:45.692604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8cf59-a11c-4f35-96d9-27705c01eaaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-41f8cf59-a11c-4f35-96d9-27705c01eaaf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:45.701271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:45.702138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:45.702897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:45.702897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:45.702897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:45.702897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:45.702897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:45.702897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:45.702897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:45.702897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:45.702897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:45.702897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:45.702897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:24:45.702897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:24:45.705423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 74/152] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:24:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:45.707782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9ef6f-15b0-42a9-92ff-b6601b2a089c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:45.708274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9ef6f-15b0-42a9-92ff-b6601b2a089c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:45.708762 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9ef6f-15b0-42a9-92ff-b6601b2a089c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:45.731214 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-34d9ef6f-15b0-42a9-92ff-b6601b2a089c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:45.732416 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-34d9ef6f-15b0-42a9-92ff-b6601b2a089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:45.806035 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc196f1-0c74-44a4-b3ea-7aac76a55e4c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:45.826294 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 75/153] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:45.827158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9ef6f-15b0-42a9-92ff-b6601b2a089c None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:45.857333 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39078958-2631-4321-93af-768e31c2f8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:45.858019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39078958-2631-4321-93af-768e31c2f8c3 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:45.858808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39078958-2631-4321-93af-768e31c2f8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:45.859103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39078958-2631-4321-93af-768e31c2f8c3 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:45.859827 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39078958-2631-4321-93af-768e31c2f8c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:45.861638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39078958-2631-4321-93af-768e31c2f8c3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:45.949306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:45.953025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9ef6f-15b0-42a9-92ff-b6601b2a089c None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:45.986503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea5899-3169-4ede-8850-8512fea5f6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:45.987700 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea5899-3169-4ede-8850-8512fea5f6ee None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:45.987979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea5899-3169-4ede-8850-8512fea5f6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:45.988254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea5899-3169-4ede-8850-8512fea5f6ee None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:45.989029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea5899-3169-4ede-8850-8512fea5f6ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:45.989343 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea5899-3169-4ede-8850-8512fea5f6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:45.990736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea5899-3169-4ede-8850-8512fea5f6ee None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:45.996502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 79/154] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:24:45 2022] POST /identity/v3/users => generated 283 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:24:45.997734 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39078958-2631-4321-93af-768e31c2f8c3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:46.012612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 76/155] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:24:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:46.012612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b6528-6256-4e76-909f-acd059810f3b None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:46.012612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b6528-6256-4e76-909f-acd059810f3b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:46.012612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b6528-6256-4e76-909f-acd059810f3b None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:46.012612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 77/156] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:46.017342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b6528-6256-4e76-909f-acd059810f3b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:46.062128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:46.149765 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39078958-2631-4321-93af-768e31c2f8c3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:46.158535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b6528-6256-4e76-909f-acd059810f3b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:46.198561 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce3c56-e6b4-4132-9bce-3548f64a4c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:46.199448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce3c56-e6b4-4132-9bce-3548f64a4c67 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:46.199677 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce3c56-e6b4-4132-9bce-3548f64a4c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:46.199960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce3c56-e6b4-4132-9bce-3548f64a4c67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:46.200146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ed1dd-e190-4c7b-a788-c3157f530ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:46.201293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ed1dd-e190-4c7b-a788-c3157f530ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:46.201791 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ed1dd-e190-4c7b-a788-c3157f530ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:46.202277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ed1dd-e190-4c7b-a788-c3157f530ce7 None admin] PATH_INFO: `/v3/users/a52d7d11a1784629a115d5e9c42434a1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:46.204162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ed1dd-e190-4c7b-a788-c3157f530ce7 None admin] RBAC: Authorizing `identity:get_user(user_id=a52d7d11a1784629a115d5e9c42434a1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:46.206251 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ed1dd-e190-4c7b-a788-c3157f530ce7 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:46.213083 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 78/157] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:46 2022] GET /identity/v3/users/a52d7d11a1784629a115d5e9c42434a1 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:46.213857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce3c56-e6b4-4132-9bce-3548f64a4c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:46.214982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f83f1-87eb-4a9e-9fac-a55cc802d245 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:46.215275 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f83f1-87eb-4a9e-9fac-a55cc802d245 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:46.215559 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f83f1-87eb-4a9e-9fac-a55cc802d245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-c4ce3c56-e6b4-4132-9bce-3548f64a4c67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:46.223517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:46.224426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:46.225316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:46.225316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:46.225316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:46.225316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:46.225316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:46.225316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:46.225316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:46.225316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:46.225316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:46.225316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:46.225316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:46.225316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:46.225316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 80/158] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:46.225989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce3c56-e6b4-4132-9bce-3548f64a4c67 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:46.236262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-952f83f1-87eb-4a9e-9fac-a55cc802d245 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:46.239088 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-952f83f1-87eb-4a9e-9fac-a55cc802d245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:46.265354 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:46.322397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 79/159] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:46.323259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f83f1-87eb-4a9e-9fac-a55cc802d245 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:46.355766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce3c56-e6b4-4132-9bce-3548f64a4c67 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:46.358964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:46.398446 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af069e-9a01-46a5-9292-d479b8dae697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:46.399936 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af069e-9a01-46a5-9292-d479b8dae697 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:46.400726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af069e-9a01-46a5-9292-d479b8dae697 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:46.401225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af069e-9a01-46a5-9292-d479b8dae697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:46.453393 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f83f1-87eb-4a9e-9fac-a55cc802d245 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:46.502310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af069e-9a01-46a5-9292-d479b8dae697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:46.504650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af069e-9a01-46a5-9292-d479b8dae697 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:46.513398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8aea6-46d7-4782-8fc2-d1c18b41f122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:46.514306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8aea6-46d7-4782-8fc2-d1c18b41f122 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:46.514593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8aea6-46d7-4782-8fc2-d1c18b41f122 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:46.515315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8aea6-46d7-4782-8fc2-d1c18b41f122 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:46.516083 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8aea6-46d7-4782-8fc2-d1c18b41f122 None admin] RBAC: Adding query filter params (name=member) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:46.516400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8aea6-46d7-4782-8fc2-d1c18b41f122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:46.519111 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8aea6-46d7-4782-8fc2-d1c18b41f122 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:46.533745 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 80/160] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:46.535013 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d2d7d-fcd0-45a1-9194-9802b77ba8b0 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:46.535375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d2d7d-fcd0-45a1-9194-9802b77ba8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:46.535659 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d2d7d-fcd0-45a1-9194-9802b77ba8b0 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:46.537191 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 81/161] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:46.538080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d2d7d-fcd0-45a1-9194-9802b77ba8b0 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:46.567375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:46.637914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 81/162] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:24:46.638991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af069e-9a01-46a5-9292-d479b8dae697 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:46.642516 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:46.687472 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d2d7d-fcd0-45a1-9194-9802b77ba8b0 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:46.736587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad234e-6532-4476-9463-de55167f8982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:46.738291 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad234e-6532-4476-9463-de55167f8982 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:46.738757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad234e-6532-4476-9463-de55167f8982 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:46.739096 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad234e-6532-4476-9463-de55167f8982 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:46.756039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad234e-6532-4476-9463-de55167f8982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:46.763207 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af069e-9a01-46a5-9292-d479b8dae697 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-ccad234e-6532-4476-9463-de55167f8982 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:46.765077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:46.765958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:46.767045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:46.767045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:46.767045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:46.767045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:46.767045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:46.767045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:46.767045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:46.767045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:46.767045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:46.767045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:46.767045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:46.767045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:24:46.767045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 82/163] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:24:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:46.773172 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777330d-cc35-4972-b00c-ea6299fe2413 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:46.773577 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777330d-cc35-4972-b00c-ea6299fe2413 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:46.773935 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777330d-cc35-4972-b00c-ea6299fe2413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:46.794714 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-4777330d-cc35-4972-b00c-ea6299fe2413 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:46.796140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4777330d-cc35-4972-b00c-ea6299fe2413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:46.809121 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8be1c-0114-4de1-b9c7-8c9bb0f2a3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:46.810580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8be1c-0114-4de1-b9c7-8c9bb0f2a3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:46.811048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8be1c-0114-4de1-b9c7-8c9bb0f2a3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:46.811746 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8be1c-0114-4de1-b9c7-8c9bb0f2a3e4 None admin] PATH_INFO: `/v3/users/a52d7d11a1784629a115d5e9c42434a1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:46.814000 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8be1c-0114-4de1-b9c7-8c9bb0f2a3e4 None admin] RBAC: Authorizing `identity:get_user(user_id=a52d7d11a1784629a115d5e9c42434a1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:46.816015 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8be1c-0114-4de1-b9c7-8c9bb0f2a3e4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:46.818297 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 82/164] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:46 2022] GET /identity/v3/users/a52d7d11a1784629a115d5e9c42434a1 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:46.823652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8be1c-0114-4de1-b9c7-8c9bb0f2a3e4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:46.899629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 83/165] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:46.901063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777330d-cc35-4972-b00c-ea6299fe2413 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:46.913815 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:46.978848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:47.015631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777330d-cc35-4972-b00c-ea6299fe2413 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:47.056736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410aed10-51cb-4942-9fd0-52a13e60cc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:47.057450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aed10-51cb-4942-9fd0-52a13e60cc9b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:47.057731 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aed10-51cb-4942-9fd0-52a13e60cc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:47.058004 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aed10-51cb-4942-9fd0-52a13e60cc9b None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:47.058763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410aed10-51cb-4942-9fd0-52a13e60cc9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:47.059071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410aed10-51cb-4942-9fd0-52a13e60cc9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:47.060476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410aed10-51cb-4942-9fd0-52a13e60cc9b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:47.064917 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8be1c-0114-4de1-b9c7-8c9bb0f2a3e4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:47.081019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 84/166] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:47.082210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410aed10-51cb-4942-9fd0-52a13e60cc9b None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:47.134828 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d59050-7194-4de2-913d-a0f9fe641879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:47.135694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d59050-7194-4de2-913d-a0f9fe641879 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:47.135982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d59050-7194-4de2-913d-a0f9fe641879 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:47.136261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d59050-7194-4de2-913d-a0f9fe641879 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:47.138133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d59050-7194-4de2-913d-a0f9fe641879 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:47.139598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d59050-7194-4de2-913d-a0f9fe641879 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:47.142083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 83/167] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:46 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:47.142861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d59050-7194-4de2-913d-a0f9fe641879 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:47.233732 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:47.278681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410aed10-51cb-4942-9fd0-52a13e60cc9b None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:47.316271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d60dfc-cfb1-4d4e-b210-2217792eaa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:47.316929 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d60dfc-cfb1-4d4e-b210-2217792eaa46 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:47.317254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d60dfc-cfb1-4d4e-b210-2217792eaa46 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:47.317530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d60dfc-cfb1-4d4e-b210-2217792eaa46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:47.380001 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d59050-7194-4de2-913d-a0f9fe641879 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:47.393135 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d60dfc-cfb1-4d4e-b210-2217792eaa46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:47.395137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d60dfc-cfb1-4d4e-b210-2217792eaa46 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:47.473297 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:47.498486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48062ab8-524e-4d29-88dd-b98a67feb8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:47.499312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48062ab8-524e-4d29-88dd-b98a67feb8fc None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:47.499600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48062ab8-524e-4d29-88dd-b98a67feb8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:47.499877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48062ab8-524e-4d29-88dd-b98a67feb8fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:47.507053 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 85/168] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:24:47.508385 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d60dfc-cfb1-4d4e-b210-2217792eaa46 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:47.511783 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:47.521868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48062ab8-524e-4d29-88dd-b98a67feb8fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-48062ab8-524e-4d29-88dd-b98a67feb8fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:47.534400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:47.535627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:47.536423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:47.536423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:47.536423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:47.536423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:47.536423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:47.536423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:47.536423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:47.536423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:47.536423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:47.536423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:47.536423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:24:47.536423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:47.542962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 84/169] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:47.544045 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48062ab8-524e-4d29-88dd-b98a67feb8fc None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:47.693735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d60dfc-cfb1-4d4e-b210-2217792eaa46 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:47.743239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48062ab8-524e-4d29-88dd-b98a67feb8fc None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:47.766960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f4845-e8a2-49d6-80f3-cbbe2c1b296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:47.768215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f4845-e8a2-49d6-80f3-cbbe2c1b296b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:47.769281 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f4845-e8a2-49d6-80f3-cbbe2c1b296b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:47.772446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f4845-e8a2-49d6-80f3-cbbe2c1b296b None admin] PATH_INFO: `/v3/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:47.774832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f4845-e8a2-49d6-80f3-cbbe2c1b296b None admin] RBAC: Authorizing `identity:get_user(user_id=e7e43dc5addf4a3b9b9bacb5e1aa59a0)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:47.776538 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f4845-e8a2-49d6-80f3-cbbe2c1b296b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:47.778416 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 86/170] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:47 2022] GET /identity/v3/users/e7e43dc5addf4a3b9b9bacb5e1aa59a0 => generated 247 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:47.779543 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f4845-e8a2-49d6-80f3-cbbe2c1b296b None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:47.806440 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83466525-149b-448c-8602-a673d379432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:47.807470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83466525-149b-448c-8602-a673d379432c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:47.807958 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83466525-149b-448c-8602-a673d379432c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:47.808432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83466525-149b-448c-8602-a673d379432c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:47.809504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83466525-149b-448c-8602-a673d379432c None admin] RBAC: Adding query filter params (role.id=58b5b157099e42bcb4ee3eff9aaf2064, scope.project.id=0bc23eb82d084bf399415f38e4538aab, user.id=a52d7d11a1784629a115d5e9c42434a1) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:47.810041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83466525-149b-448c-8602-a673d379432c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:47.811721 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83466525-149b-448c-8602-a673d379432c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:47.821421 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 85/171] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:24:47 2022] GET /identity/v3/role_assignments?user.id=a52d7d11a1784629a115d5e9c42434a1&scope.project.id=0bc23eb82d084bf399415f38e4538aab&role.id=58b5b157099e42bcb4ee3eff9aaf2064 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:47.824577 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83466525-149b-448c-8602-a673d379432c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:47.865299 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:47.969009 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:48.011901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f4845-e8a2-49d6-80f3-cbbe2c1b296b None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:48.076976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2e821-03e0-4092-aae6-1f740f70ab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:48.077785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2e821-03e0-4092-aae6-1f740f70ab26 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:48.078070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2e821-03e0-4092-aae6-1f740f70ab26 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:48.080414 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83466525-149b-448c-8602-a673d379432c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:48.082038 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2e821-03e0-4092-aae6-1f740f70ab26 None admin] PATH_INFO: `/v3/projects/3aaa354cd3344a538fdf602af5898fed` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:48.083337 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2e821-03e0-4092-aae6-1f740f70ab26 None admin] RBAC: Authorizing `identity:get_project(project_id=3aaa354cd3344a538fdf602af5898fed)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:48.084795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2e821-03e0-4092-aae6-1f740f70ab26 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:48.086749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 87/172] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:47 2022] GET /identity/v3/projects/3aaa354cd3344a538fdf602af5898fed => generated 312 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:48.087359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2e821-03e0-4092-aae6-1f740f70ab26 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:48.153700 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440bab3-84d4-466b-ba87-d39b530fd59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:48.155405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440bab3-84d4-466b-ba87-d39b530fd59e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:48.155693 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440bab3-84d4-466b-ba87-d39b530fd59e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:48.155972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440bab3-84d4-466b-ba87-d39b530fd59e None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:48.156734 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440bab3-84d4-466b-ba87-d39b530fd59e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:48.157071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440bab3-84d4-466b-ba87-d39b530fd59e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:48.158484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440bab3-84d4-466b-ba87-d39b530fd59e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:48.181762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 86/173] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:24:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:48.182626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440bab3-84d4-466b-ba87-d39b530fd59e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:48.315183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2e821-03e0-4092-aae6-1f740f70ab26 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:48.344008 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:48.393601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fa19e-137d-48cf-ae74-3acb8342a3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:48.394335 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fa19e-137d-48cf-ae74-3acb8342a3cb None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:48.394553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fa19e-137d-48cf-ae74-3acb8342a3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:48.394844 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fa19e-137d-48cf-ae74-3acb8342a3cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:48.404604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440bab3-84d4-466b-ba87-d39b530fd59e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:48.466325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:48.496040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fa19e-137d-48cf-ae74-3acb8342a3cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:48.497569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fa19e-137d-48cf-ae74-3acb8342a3cb None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:48.505815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22496970-9e64-4c7c-a3a6-8d7e97b3fbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:48.506517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22496970-9e64-4c7c-a3a6-8d7e97b3fbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:48.506802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22496970-9e64-4c7c-a3a6-8d7e97b3fbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:48.507081 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22496970-9e64-4c7c-a3a6-8d7e97b3fbf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:48.508617 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22496970-9e64-4c7c-a3a6-8d7e97b3fbf8 None admin] RBAC: Adding query filter params (role.id=e8531ae972c749c0a8ea8a73601c5cd1, scope.project.id=3aaa354cd3344a538fdf602af5898fed, user.id=a52d7d11a1784629a115d5e9c42434a1) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:48.509210 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22496970-9e64-4c7c-a3a6-8d7e97b3fbf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:48.511231 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22496970-9e64-4c7c-a3a6-8d7e97b3fbf8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:48.525115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 87/174] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:24:48 2022] GET /identity/v3/role_assignments?user.id=a52d7d11a1784629a115d5e9c42434a1&scope.project.id=3aaa354cd3344a538fdf602af5898fed&role.id=e8531ae972c749c0a8ea8a73601c5cd1 => generated 608 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:48.525984 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22496970-9e64-4c7c-a3a6-8d7e97b3fbf8 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:48.630844 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 88/175] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:24:48.637131 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fa19e-137d-48cf-ae74-3acb8342a3cb None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:48.656302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:48.674552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22496970-9e64-4c7c-a3a6-8d7e97b3fbf8 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:48.710933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1d883-1e5a-49f1-a435-12fe29cf45b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:48.712441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1d883-1e5a-49f1-a435-12fe29cf45b7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:48.712727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1d883-1e5a-49f1-a435-12fe29cf45b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:48.713040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1d883-1e5a-49f1-a435-12fe29cf45b7 None admin] PATH_INFO: `/v3/users/3967241dee3d4a4bbe4bc5b48ecb0532` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:48.714739 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1d883-1e5a-49f1-a435-12fe29cf45b7 None admin] RBAC: Authorizing `identity:get_user(user_id=3967241dee3d4a4bbe4bc5b48ecb0532)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:48.716495 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1d883-1e5a-49f1-a435-12fe29cf45b7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:48.718428 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 88/176] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:48 2022] GET /identity/v3/users/3967241dee3d4a4bbe4bc5b48ecb0532 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:48.724400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1d883-1e5a-49f1-a435-12fe29cf45b7 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:48.761524 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fa19e-137d-48cf-ae74-3acb8342a3cb None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:48.784503 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:48.801661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f841b7-d71e-41be-8b28-4b60efc3d7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:48.802812 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f841b7-d71e-41be-8b28-4b60efc3d7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:48.803298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f841b7-d71e-41be-8b28-4b60efc3d7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:48.803718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f841b7-d71e-41be-8b28-4b60efc3d7b4 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:48.805538 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f841b7-d71e-41be-8b28-4b60efc3d7b4 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:48.807225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f841b7-d71e-41be-8b28-4b60efc3d7b4 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:48.809290 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 89/177] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:48 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:48.816140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f841b7-d71e-41be-8b28-4b60efc3d7b4 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:48.875152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1d883-1e5a-49f1-a435-12fe29cf45b7 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:48.919559 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:48.948095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f841b7-d71e-41be-8b28-4b60efc3d7b4 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:48.975063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623249c-0c52-4749-9f7d-eed298b11e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:48.975946 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623249c-0c52-4749-9f7d-eed298b11e49 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:48.976286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623249c-0c52-4749-9f7d-eed298b11e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:48.976502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623249c-0c52-4749-9f7d-eed298b11e49 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:48.981771 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623249c-0c52-4749-9f7d-eed298b11e49 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:48.983151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623249c-0c52-4749-9f7d-eed298b11e49 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:48.988966 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 89/178] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:48 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:48.990862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12b6c1-3612-4f55-a50e-c0eaaf802cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:48.991702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12b6c1-3612-4f55-a50e-c0eaaf802cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:48.992126 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12b6c1-3612-4f55-a50e-c0eaaf802cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:48.992594 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12b6c1-3612-4f55-a50e-c0eaaf802cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:48.993684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12b6c1-3612-4f55-a50e-c0eaaf802cb4 None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=0bc23eb82d084bf399415f38e4538aab, user.id=e7e43dc5addf4a3b9b9bacb5e1aa59a0) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:48.994138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12b6c1-3612-4f55-a50e-c0eaaf802cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:48.995802 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12b6c1-3612-4f55-a50e-c0eaaf802cb4 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:49.002892 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 90/179] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:24:48 2022] GET /identity/v3/role_assignments?user.id=e7e43dc5addf4a3b9b9bacb5e1aa59a0&scope.project.id=0bc23eb82d084bf399415f38e4538aab&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:49.008417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623249c-0c52-4749-9f7d-eed298b11e49 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:49.071031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dead95-2933-4fda-9b72-ba1f9ae815af None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:49.072146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dead95-2933-4fda-9b72-ba1f9ae815af None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:49.072575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dead95-2933-4fda-9b72-ba1f9ae815af None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:49.075107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 91/180] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:49.080491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84feb62-7c32-4a32-9a1e-424d11f18210 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:49.081615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84feb62-7c32-4a32-9a1e-424d11f18210 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:49.082090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84feb62-7c32-4a32-9a1e-424d11f18210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:49.123859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-d84feb62-7c32-4a32-9a1e-424d11f18210 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:49.125588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d84feb62-7c32-4a32-9a1e-424d11f18210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:49.137992 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623249c-0c52-4749-9f7d-eed298b11e49 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:49.159662 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:49.173358 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ece1f-d8dc-4b05-97e0-2567aba0ef17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:49.174191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ece1f-d8dc-4b05-97e0-2567aba0ef17 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:49.175091 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ece1f-d8dc-4b05-97e0-2567aba0ef17 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:49.175840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ece1f-d8dc-4b05-97e0-2567aba0ef17 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab/users/3967241dee3d4a4bbe4bc5b48ecb0532/roles/98b5f1ee87964b378ac55b7e47ba10f6` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:49.177682 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ece1f-d8dc-4b05-97e0-2567aba0ef17 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc23eb82d084bf399415f38e4538aab, user_id=3967241dee3d4a4bbe4bc5b48ecb0532, role_id=98b5f1ee87964b378ac55b7e47ba10f6)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:49.179185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ece1f-d8dc-4b05-97e0-2567aba0ef17 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:49.243601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 92/181] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:24:49.245169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747e89-3aac-45b9-9bf8-dadc3632fd49 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:49.245466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747e89-3aac-45b9-9bf8-dadc3632fd49 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:49.245799 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747e89-3aac-45b9-9bf8-dadc3632fd49 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:49.247107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 93/182] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:49.253302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720763-d32a-4f69-8a16-dc5b83bec721 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:49.253602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720763-d32a-4f69-8a16-dc5b83bec721 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:49.254072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720763-d32a-4f69-8a16-dc5b83bec721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:49.267459 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 90/183] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:24:49 2022] PUT /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab/users/3967241dee3d4a4bbe4bc5b48ecb0532/roles/98b5f1ee87964b378ac55b7e47ba10f6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:24:49.273433 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-aa720763-d32a-4f69-8a16-dc5b83bec721 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:49.274714 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-aa720763-d32a-4f69-8a16-dc5b83bec721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:49.276816 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ece1f-d8dc-4b05-97e0-2567aba0ef17 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:49.367755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:49.375749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 94/184] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:24:49.404748 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa720763-d32a-4f69-8a16-dc5b83bec721 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:49.417885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ece1f-d8dc-4b05-97e0-2567aba0ef17 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:49.456959 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e07a3-9717-4608-9142-9bb8749c8f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:49.457726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e07a3-9717-4608-9142-9bb8749c8f0e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:49.458006 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e07a3-9717-4608-9142-9bb8749c8f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:49.458282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e07a3-9717-4608-9142-9bb8749c8f0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:49.470252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e07a3-9717-4608-9142-9bb8749c8f0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-019e07a3-9717-4608-9142-9bb8749c8f0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:49.479764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:49.480728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:49.482937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:49.482937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:49.482937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:49.482937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:49.482937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:49.482937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:49.482937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:49.482937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:49.482937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:49.482937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:49.482937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:24:49.482937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:49.482937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 91/185] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:24:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:24:49.488971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e07a3-9717-4608-9142-9bb8749c8f0e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:49.527531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa720763-d32a-4f69-8a16-dc5b83bec721 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:49.540018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:49.574089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc4c33-883f-4b4d-b0bc-680ff1c888d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:49.574904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc4c33-883f-4b4d-b0bc-680ff1c888d0 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:49.575197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc4c33-883f-4b4d-b0bc-680ff1c888d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:49.575475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc4c33-883f-4b4d-b0bc-680ff1c888d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:49.587984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc4c33-883f-4b4d-b0bc-680ff1c888d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-68dc4c33-883f-4b4d-b0bc-680ff1c888d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:49.595657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:49.597536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:49.598445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:49.598445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:49.598445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:49.598445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:49.598445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:49.598445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:49.598445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:49.598445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:49.598445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:49.598445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:49.598445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:49.598445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:24:49.598445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 95/186] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:24:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:49.599099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d345c4-9305-49c7-90df-e828b93df051 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:49.599099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d345c4-9305-49c7-90df-e828b93df051 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:49.600047 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d345c4-9305-49c7-90df-e828b93df051 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:49.600777 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 96/187] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:49.605625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d345c4-9305-49c7-90df-e828b93df051 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:49.610163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e07a3-9717-4608-9142-9bb8749c8f0e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:49.649581 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8631f-2c67-4d0d-a2bf-a73e3b8d64bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:49.650767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8631f-2c67-4d0d-a2bf-a73e3b8d64bb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:49.657145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8631f-2c67-4d0d-a2bf-a73e3b8d64bb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:49.657145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8631f-2c67-4d0d-a2bf-a73e3b8d64bb None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:49.657145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8631f-2c67-4d0d-a2bf-a73e3b8d64bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:49.657145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8631f-2c67-4d0d-a2bf-a73e3b8d64bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:49.657145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8631f-2c67-4d0d-a2bf-a73e3b8d64bb None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:49.664127 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 92/188] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:24:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:49.665535 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca6eeb-ac30-4313-83e6-33c6a791636f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:49.665833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca6eeb-ac30-4313-83e6-33c6a791636f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:49.666114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca6eeb-ac30-4313-83e6-33c6a791636f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:49.670968 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:49.684129 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-edca6eeb-ac30-4313-83e6-33c6a791636f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:49.685399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-edca6eeb-ac30-4313-83e6-33c6a791636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:49.716979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d345c4-9305-49c7-90df-e828b93df051 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:49.753493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a662c80-f2fa-48cb-8ed3-8c51325e1c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:49.754407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a662c80-f2fa-48cb-8ed3-8c51325e1c1b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:49.754687 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a662c80-f2fa-48cb-8ed3-8c51325e1c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:49.754963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a662c80-f2fa-48cb-8ed3-8c51325e1c1b None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:49.755728 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a662c80-f2fa-48cb-8ed3-8c51325e1c1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:49.756034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a662c80-f2fa-48cb-8ed3-8c51325e1c1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:49.757448 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a662c80-f2fa-48cb-8ed3-8c51325e1c1b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:49.757918 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 93/189] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:49.758786 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca6eeb-ac30-4313-83e6-33c6a791636f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:49.777640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 97/190] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:49.780674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a662c80-f2fa-48cb-8ed3-8c51325e1c1b None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:49.803111 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:49.874805 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca6eeb-ac30-4313-83e6-33c6a791636f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:49.885454 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a662c80-f2fa-48cb-8ed3-8c51325e1c1b None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:49.913211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159235e4-f16c-43ba-8e35-cf0e32292070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:49.914095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159235e4-f16c-43ba-8e35-cf0e32292070 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:49.914380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159235e4-f16c-43ba-8e35-cf0e32292070 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:49.914659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159235e4-f16c-43ba-8e35-cf0e32292070 None admin] PATH_INFO: `/v3/users/de93b6776a9b42e0b82ea8d023fd8127` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:49.919149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:49.935496 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd5964-df8c-4670-9f75-dca5defdcea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:49.936015 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159235e4-f16c-43ba-8e35-cf0e32292070 None admin] RBAC: Authorizing `identity:get_user(user_id=de93b6776a9b42e0b82ea8d023fd8127)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:49.936887 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd5964-df8c-4670-9f75-dca5defdcea9 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:49.937356 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd5964-df8c-4670-9f75-dca5defdcea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:49.937872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd5964-df8c-4670-9f75-dca5defdcea9 None admin] PATH_INFO: `/v3/users/de93b6776a9b42e0b82ea8d023fd8127` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:49.938571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159235e4-f16c-43ba-8e35-cf0e32292070 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:49.939769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd5964-df8c-4670-9f75-dca5defdcea9 None admin] RBAC: Authorizing `identity:get_user(user_id=de93b6776a9b42e0b82ea8d023fd8127)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:49.941721 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 94/191] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:49 2022] GET /identity/v3/users/de93b6776a9b42e0b82ea8d023fd8127 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:49.942579 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd5964-df8c-4670-9f75-dca5defdcea9 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:49.942753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159235e4-f16c-43ba-8e35-cf0e32292070 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:49.950865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 98/192] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:49 2022] GET /identity/v3/users/de93b6776a9b42e0b82ea8d023fd8127 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:49.951722 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd5964-df8c-4670-9f75-dca5defdcea9 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:50.055781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:50.063160 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159235e4-f16c-43ba-8e35-cf0e32292070 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:50.065698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd5964-df8c-4670-9f75-dca5defdcea9 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:50.100872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41805b42-2234-45dc-b679-eba72fd2b35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:50.101526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b7d07-01f2-4916-9930-2b4c29b2106a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:50.102101 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41805b42-2234-45dc-b679-eba72fd2b35a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:50.102236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b7d07-01f2-4916-9930-2b4c29b2106a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:50.102449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b7d07-01f2-4916-9930-2b4c29b2106a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:50.102728 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b7d07-01f2-4916-9930-2b4c29b2106a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:50.102948 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41805b42-2234-45dc-b679-eba72fd2b35a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:50.103361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41805b42-2234-45dc-b679-eba72fd2b35a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:50.105070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41805b42-2234-45dc-b679-eba72fd2b35a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:50.106901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41805b42-2234-45dc-b679-eba72fd2b35a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:50.108546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 95/193] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:24:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:50.108546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41805b42-2234-45dc-b679-eba72fd2b35a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:50.179233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:50.189427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b7d07-01f2-4916-9930-2b4c29b2106a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:50.191146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b7d07-01f2-4916-9930-2b4c29b2106a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:50.220808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41805b42-2234-45dc-b679-eba72fd2b35a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:50.266936 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129d19f-a2ed-46de-90bb-9d8f0ce3c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:50.267602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129d19f-a2ed-46de-90bb-9d8f0ce3c1cb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:50.267894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129d19f-a2ed-46de-90bb-9d8f0ce3c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:50.268326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129d19f-a2ed-46de-90bb-9d8f0ce3c1cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:50.302058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:50.309863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 99/194] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:24:50.309863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b7d07-01f2-4916-9930-2b4c29b2106a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:50.345268 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129d19f-a2ed-46de-90bb-9d8f0ce3c1cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:50.347407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129d19f-a2ed-46de-90bb-9d8f0ce3c1cb None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:50.402963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:50.413037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b7d07-01f2-4916-9930-2b4c29b2106a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:50.449963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24613ce-0c3d-49bd-91ba-a099d3390707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:50.450638 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24613ce-0c3d-49bd-91ba-a099d3390707 None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:50.450918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24613ce-0c3d-49bd-91ba-a099d3390707 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:50.451193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24613ce-0c3d-49bd-91ba-a099d3390707 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:50.456186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 96/195] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:24:50.456649 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24613ce-0c3d-49bd-91ba-a099d3390707 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:50.456727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129d19f-a2ed-46de-90bb-9d8f0ce3c1cb None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:50.456817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24613ce-0c3d-49bd-91ba-a099d3390707 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:50.532256 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:50.557440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 100/196] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:24:50 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:24:50.559017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24613ce-0c3d-49bd-91ba-a099d3390707 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:50.590922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129d19f-a2ed-46de-90bb-9d8f0ce3c1cb None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:50.634581 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8360574-abd6-4d2f-a48b-076b9f359f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:50.635493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8360574-abd6-4d2f-a48b-076b9f359f01 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:50.635779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8360574-abd6-4d2f-a48b-076b9f359f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:50.636059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8360574-abd6-4d2f-a48b-076b9f359f01 None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:50.637590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8360574-abd6-4d2f-a48b-076b9f359f01 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:50.639177 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8360574-abd6-4d2f-a48b-076b9f359f01 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:50.641116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 97/197] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:50 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:50.646927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8360574-abd6-4d2f-a48b-076b9f359f01 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:50.695696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24613ce-0c3d-49bd-91ba-a099d3390707 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:50.735077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e070d40-90fa-4fcd-9de7-669a334e7a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:50.735969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e070d40-90fa-4fcd-9de7-669a334e7a9f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:50.736245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e070d40-90fa-4fcd-9de7-669a334e7a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:50.736517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e070d40-90fa-4fcd-9de7-669a334e7a9f None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:50.738510 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e070d40-90fa-4fcd-9de7-669a334e7a9f None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:50.739978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e070d40-90fa-4fcd-9de7-669a334e7a9f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:50.741970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 101/198] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:50 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:50.748058 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e070d40-90fa-4fcd-9de7-669a334e7a9f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:50.760192 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8360574-abd6-4d2f-a48b-076b9f359f01 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:50.765752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:50.792679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:50.797764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c807efe-b745-4059-8a54-262ffb2f8e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:50.798596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c807efe-b745-4059-8a54-262ffb2f8e27 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:50.799032 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c807efe-b745-4059-8a54-262ffb2f8e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:50.800135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c807efe-b745-4059-8a54-262ffb2f8e27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:50.801302 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c807efe-b745-4059-8a54-262ffb2f8e27 None admin] RBAC: Adding query filter params (role.id=58b5b157099e42bcb4ee3eff9aaf2064, scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1, user.id=de93b6776a9b42e0b82ea8d023fd8127) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:50.801761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c807efe-b745-4059-8a54-262ffb2f8e27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:50.803365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c807efe-b745-4059-8a54-262ffb2f8e27 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:50.809311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 98/199] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:24:50 2022] GET /identity/v3/role_assignments?user.id=de93b6776a9b42e0b82ea8d023fd8127&scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1&role.id=58b5b157099e42bcb4ee3eff9aaf2064 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:50.869793 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e070d40-90fa-4fcd-9de7-669a334e7a9f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:50.912120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49f3a5-2751-4a58-a896-f194db211626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:50.913248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49f3a5-2751-4a58-a896-f194db211626 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:50.913921 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49f3a5-2751-4a58-a896-f194db211626 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:50.914528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49f3a5-2751-4a58-a896-f194db211626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:50.916038 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49f3a5-2751-4a58-a896-f194db211626 None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1, user.id=de93b6776a9b42e0b82ea8d023fd8127) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:50.916680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49f3a5-2751-4a58-a896-f194db211626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:50.919224 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49f3a5-2751-4a58-a896-f194db211626 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:50.927859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 102/200] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:24:50 2022] GET /identity/v3/role_assignments?user.id=de93b6776a9b42e0b82ea8d023fd8127&scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:51.747204 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c060f-84f7-4a5c-a34c-659b63adb691 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:51.747689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c060f-84f7-4a5c-a34c-659b63adb691 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:51.747689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c060f-84f7-4a5c-a34c-659b63adb691 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:51.749103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 99/201] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:51.756215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d10a0-cc8c-43db-aeb6-aa07f1fad424 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:51.756643 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d10a0-cc8c-43db-aeb6-aa07f1fad424 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:51.756832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d10a0-cc8c-43db-aeb6-aa07f1fad424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:51.778718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b38d10a0-cc8c-43db-aeb6-aa07f1fad424 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:51.779940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b38d10a0-cc8c-43db-aeb6-aa07f1fad424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:51.859668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 103/202] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:51.900489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c060f-84f7-4a5c-a34c-659b63adb691 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:52.038388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c060f-84f7-4a5c-a34c-659b63adb691 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:52.083583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6e02f-049e-49ec-a1cd-82bc43da7199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:52.084396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6e02f-049e-49ec-a1cd-82bc43da7199 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:52.084682 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6e02f-049e-49ec-a1cd-82bc43da7199 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:52.084985 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6e02f-049e-49ec-a1cd-82bc43da7199 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:52.095379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6e02f-049e-49ec-a1cd-82bc43da7199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-d7d6e02f-049e-49ec-a1cd-82bc43da7199 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:52.103974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:52.105147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:52.105927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:52.105927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:52.105927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:52.105927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:52.105927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:52.105927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:52.105927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:52.105927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:52.105927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:52.105927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:52.105927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:24:52.105927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:52.105927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 100/203] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:52.113214 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d10a0-cc8c-43db-aeb6-aa07f1fad424 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:52.123390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:52.239783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d10a0-cc8c-43db-aeb6-aa07f1fad424 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:52.275781 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362f85b-4152-4faf-af55-4306c5c509fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:52.276475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362f85b-4152-4faf-af55-4306c5c509fc None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:52.276763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362f85b-4152-4faf-af55-4306c5c509fc None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:52.277074 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362f85b-4152-4faf-af55-4306c5c509fc None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:52.277834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362f85b-4152-4faf-af55-4306c5c509fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:52.278146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362f85b-4152-4faf-af55-4306c5c509fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:52.279561 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362f85b-4152-4faf-af55-4306c5c509fc None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:52.292862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 104/204] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:24:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:52.298718 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6e02f-049e-49ec-a1cd-82bc43da7199 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:52.367918 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:52.415298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6e02f-049e-49ec-a1cd-82bc43da7199 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:52.451585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc071e83-4070-46a2-9068-b35cf0734753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:52.452505 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc071e83-4070-46a2-9068-b35cf0734753 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:52.452794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc071e83-4070-46a2-9068-b35cf0734753 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:52.453103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc071e83-4070-46a2-9068-b35cf0734753 None admin] PATH_INFO: `/v3/users/3967241dee3d4a4bbe4bc5b48ecb0532` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:52.454452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc071e83-4070-46a2-9068-b35cf0734753 None admin] RBAC: Authorizing `identity:get_user(user_id=3967241dee3d4a4bbe4bc5b48ecb0532)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:52.456018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc071e83-4070-46a2-9068-b35cf0734753 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:52.463243 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 101/205] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:52 2022] GET /identity/v3/users/3967241dee3d4a4bbe4bc5b48ecb0532 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:52.468745 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362f85b-4152-4faf-af55-4306c5c509fc None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:52.554703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:52.580174 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362f85b-4152-4faf-af55-4306c5c509fc None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:52.616103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b60c82-806e-4594-94e4-c16a0dafadf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:52.616770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60c82-806e-4594-94e4-c16a0dafadf1 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:52.617087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60c82-806e-4594-94e4-c16a0dafadf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:52.617366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60c82-806e-4594-94e4-c16a0dafadf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:52.691511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b60c82-806e-4594-94e4-c16a0dafadf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:52.693017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b60c82-806e-4594-94e4-c16a0dafadf1 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:52.805249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:52.837125 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 105/206] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:24:52.842769 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc071e83-4070-46a2-9068-b35cf0734753 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:52.974562 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc071e83-4070-46a2-9068-b35cf0734753 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:53.001369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:53.024266 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5c185-c063-4175-974c-50f9ad5de518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:53.025177 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5c185-c063-4175-974c-50f9ad5de518 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:53.025466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5c185-c063-4175-974c-50f9ad5de518 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:53.025743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5c185-c063-4175-974c-50f9ad5de518 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:53.026943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5c185-c063-4175-974c-50f9ad5de518 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:53.028431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5c185-c063-4175-974c-50f9ad5de518 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:53.033103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 102/207] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:52 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:53.036638 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b60c82-806e-4594-94e4-c16a0dafadf1 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:53.154382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b60c82-806e-4594-94e4-c16a0dafadf1 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:53.191507 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f8099-3aba-46f0-a503-e4d46e8eeb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:53.192177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f8099-3aba-46f0-a503-e4d46e8eeb76 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:53.192465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f8099-3aba-46f0-a503-e4d46e8eeb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:53.192747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f8099-3aba-46f0-a503-e4d46e8eeb76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:53.193617 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f8099-3aba-46f0-a503-e4d46e8eeb76 None admin] RBAC: Adding query filter params (role.id=98b5f1ee87964b378ac55b7e47ba10f6, scope.project.id=0bc23eb82d084bf399415f38e4538aab, user.id=3967241dee3d4a4bbe4bc5b48ecb0532) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:53.193930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f8099-3aba-46f0-a503-e4d46e8eeb76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:53.195440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f8099-3aba-46f0-a503-e4d46e8eeb76 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:53.201835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 106/208] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:24:53 2022] GET /identity/v3/role_assignments?user.id=3967241dee3d4a4bbe4bc5b48ecb0532&scope.project.id=0bc23eb82d084bf399415f38e4538aab&role.id=98b5f1ee87964b378ac55b7e47ba10f6 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:53.697518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76549d88-3b1b-4994-b3be-a554d8809646 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:53.698223 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76549d88-3b1b-4994-b3be-a554d8809646 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:53.698712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76549d88-3b1b-4994-b3be-a554d8809646 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:53.700291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 103/209] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:53.705966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbd80d-691e-492e-a2c5-777b63d4fddb None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:53.706588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbd80d-691e-492e-a2c5-777b63d4fddb None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:53.707094 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbd80d-691e-492e-a2c5-777b63d4fddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:53.725678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198ab2e-389a-46e8-8aea-388850874a2d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:53.725862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-89fbd80d-691e-492e-a2c5-777b63d4fddb None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:53.726403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198ab2e-389a-46e8-8aea-388850874a2d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:53.726886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-89fbd80d-691e-492e-a2c5-777b63d4fddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:53.727104 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198ab2e-389a-46e8-8aea-388850874a2d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:53.728675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 104/210] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:53.735514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a4088-1cfe-4344-95a5-5e4a092cb5f6 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:53.736070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a4088-1cfe-4344-95a5-5e4a092cb5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:53.736546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a4088-1cfe-4344-95a5-5e4a092cb5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:53.765022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-145a4088-1cfe-4344-95a5-5e4a092cb5f6 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:53.766652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-145a4088-1cfe-4344-95a5-5e4a092cb5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:53.769411 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:53.821146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 107/211] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:53.827037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85312cb-6e26-4910-b223-9062c15d4055 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:53.827539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85312cb-6e26-4910-b223-9062c15d4055 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:53.828257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85312cb-6e26-4910-b223-9062c15d4055 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:53.830188 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 108/212] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:53.835657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d05cb-ab77-4b8b-831f-5e42b82109ff None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:53.836189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d05cb-ab77-4b8b-831f-5e42b82109ff None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:53.837310 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d05cb-ab77-4b8b-831f-5e42b82109ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:53.851939 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 105/213] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:24:53.853005 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a4088-1cfe-4344-95a5-5e4a092cb5f6 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:53.856229 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-f50d05cb-ab77-4b8b-831f-5e42b82109ff None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:53.857445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f50d05cb-ab77-4b8b-831f-5e42b82109ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:53.932110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 109/214] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:24:53.932995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d05cb-ab77-4b8b-831f-5e42b82109ff None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:53.956599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a4088-1cfe-4344-95a5-5e4a092cb5f6 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:53.976569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:53.992677 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a4069-5e89-4879-add4-2ff826fd7f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:53.993452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a4069-5e89-4879-add4-2ff826fd7f84 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:53.993736 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a4069-5e89-4879-add4-2ff826fd7f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:53.994006 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a4069-5e89-4879-add4-2ff826fd7f84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:54.003979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a4069-5e89-4879-add4-2ff826fd7f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-ea2a4069-5e89-4879-add4-2ff826fd7f84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:54.012031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:54.012975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:54.013780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:54.013780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:54.013780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:54.013780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:54.013780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:54.013780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:54.013780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:54.013780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:54.013780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:54.013780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:54.013780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:24:54.013780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:54.013780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 106/215] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:24:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:54.014438 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e9639-609c-4e08-b0f0-83e1ca5266ac None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:54.014968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e9639-609c-4e08-b0f0-83e1ca5266ac None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:54.014968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e9639-609c-4e08-b0f0-83e1ca5266ac None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:54.020099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 107/216] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:54.020099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e9639-609c-4e08-b0f0-83e1ca5266ac None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:54.026163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:54.032832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d05cb-ab77-4b8b-831f-5e42b82109ff None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:54.068315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403625d0-8db0-495b-b287-762dcb8ea24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:54.069145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403625d0-8db0-495b-b287-762dcb8ea24b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:54.069421 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403625d0-8db0-495b-b287-762dcb8ea24b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:54.069695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403625d0-8db0-495b-b287-762dcb8ea24b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:54.070838 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403625d0-8db0-495b-b287-762dcb8ea24b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:54.072291 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403625d0-8db0-495b-b287-762dcb8ea24b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:54.073927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 110/217] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:24:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:54.074677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403625d0-8db0-495b-b287-762dcb8ea24b None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:54.128382 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e9639-609c-4e08-b0f0-83e1ca5266ac None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:54.162850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937d601-4af0-4d8e-935b-84567e8848da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:54.163645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937d601-4af0-4d8e-935b-84567e8848da None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:54.163933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937d601-4af0-4d8e-935b-84567e8848da None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:54.164210 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937d601-4af0-4d8e-935b-84567e8848da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:54.171698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403625d0-8db0-495b-b287-762dcb8ea24b None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:54.174257 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937d601-4af0-4d8e-935b-84567e8848da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-5937d601-4af0-4d8e-935b-84567e8848da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:54.182246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:54.183282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:54.184068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:54.184068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:54.184068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:54.184068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:54.184068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:54.184068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:54.184068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:54.184068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:54.184068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:54.184068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:54.184068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:54.184068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:54.184068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 108/218] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:54.184731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695491dd-14a4-4154-8b9c-38347e5057fd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:54.185141 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695491dd-14a4-4154-8b9c-38347e5057fd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:54.185303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695491dd-14a4-4154-8b9c-38347e5057fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:54.201964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-695491dd-14a4-4154-8b9c-38347e5057fd None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:54.203144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-695491dd-14a4-4154-8b9c-38347e5057fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:54.211370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b48a62-f35a-435d-ab64-2d3701c68cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:54.212041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b48a62-f35a-435d-ab64-2d3701c68cad None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:54.212322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b48a62-f35a-435d-ab64-2d3701c68cad None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:54.212598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b48a62-f35a-435d-ab64-2d3701c68cad None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:54.213387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b48a62-f35a-435d-ab64-2d3701c68cad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:54.213690 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b48a62-f35a-435d-ab64-2d3701c68cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:54.215137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b48a62-f35a-435d-ab64-2d3701c68cad None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:54.223377 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 111/219] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:24:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:54.224143 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b48a62-f35a-435d-ab64-2d3701c68cad None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:54.238778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:54.250906 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:54.271558 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 109/220] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:54.272397 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695491dd-14a4-4154-8b9c-38347e5057fd None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:54.325609 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b48a62-f35a-435d-ab64-2d3701c68cad None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:54.359501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d0454-769c-41f7-85ca-4a4b8f830bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:54.360180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d0454-769c-41f7-85ca-4a4b8f830bb0 None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:54.360466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d0454-769c-41f7-85ca-4a4b8f830bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:54.360745 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d0454-769c-41f7-85ca-4a4b8f830bb0 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:54.361482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d0454-769c-41f7-85ca-4a4b8f830bb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:54.363466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d0454-769c-41f7-85ca-4a4b8f830bb0 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:54.373787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695491dd-14a4-4154-8b9c-38347e5057fd None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:54.407666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9434a79-0b6a-49eb-b29f-534c546fcdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:54.408334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9434a79-0b6a-49eb-b29f-534c546fcdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:54.408741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9434a79-0b6a-49eb-b29f-534c546fcdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:54.409057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9434a79-0b6a-49eb-b29f-534c546fcdf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:54.409809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9434a79-0b6a-49eb-b29f-534c546fcdf6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:54.410117 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9434a79-0b6a-49eb-b29f-534c546fcdf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:54.411506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9434a79-0b6a-49eb-b29f-534c546fcdf6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:54.419448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 110/221] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:24:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:54.420225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9434a79-0b6a-49eb-b29f-534c546fcdf6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:54.452447 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:54.456020 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 112/222] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:24:54 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:24:54.456746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d0454-769c-41f7-85ca-4a4b8f830bb0 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:54.539356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9434a79-0b6a-49eb-b29f-534c546fcdf6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:54.563603 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:54.580889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661e4b2-5107-455e-95cd-7eec40f5fac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:54.581908 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661e4b2-5107-455e-95cd-7eec40f5fac5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:54.582200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661e4b2-5107-455e-95cd-7eec40f5fac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:54.582481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661e4b2-5107-455e-95cd-7eec40f5fac5 None admin] PATH_INFO: `/v3/users/de93b6776a9b42e0b82ea8d023fd8127` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:54.583902 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661e4b2-5107-455e-95cd-7eec40f5fac5 None admin] RBAC: Authorizing `identity:get_user(user_id=de93b6776a9b42e0b82ea8d023fd8127)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:54.584556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d0454-769c-41f7-85ca-4a4b8f830bb0 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:54.585439 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661e4b2-5107-455e-95cd-7eec40f5fac5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:54.587206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 111/223] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:54 2022] GET /identity/v3/users/de93b6776a9b42e0b82ea8d023fd8127 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:54.592687 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661e4b2-5107-455e-95cd-7eec40f5fac5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:54.624845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934029c-ef02-4846-9995-65b813213163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:54.625694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934029c-ef02-4846-9995-65b813213163 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:54.625987 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934029c-ef02-4846-9995-65b813213163 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:54.626269 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934029c-ef02-4846-9995-65b813213163 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:54.638918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934029c-ef02-4846-9995-65b813213163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-e934029c-ef02-4846-9995-65b813213163 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:54.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:54.648260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:54.649063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:54.649063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:54.649063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:54.649063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:54.649063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:54.649063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:54.649063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:54.649063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:54.649063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:54.649063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:54.649063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:54.649063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:24:54.649063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 113/224] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:24:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:54.654975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934029c-ef02-4846-9995-65b813213163 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:54.723715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:54.728973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661e4b2-5107-455e-95cd-7eec40f5fac5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:54.776185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d3164-fe93-4ea5-a00f-0ae37e37a43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:54.776389 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934029c-ef02-4846-9995-65b813213163 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:54.777132 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d3164-fe93-4ea5-a00f-0ae37e37a43a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:54.777407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d3164-fe93-4ea5-a00f-0ae37e37a43a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:54.777686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d3164-fe93-4ea5-a00f-0ae37e37a43a None admin] PATH_INFO: `/v3/users/4f23865c8d604e7daaaa43d509357cb7` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:54.798197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d3164-fe93-4ea5-a00f-0ae37e37a43a None admin] RBAC: Authorizing `identity:get_user(user_id=4f23865c8d604e7daaaa43d509357cb7)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:54.799718 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d3164-fe93-4ea5-a00f-0ae37e37a43a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:54.801553 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 112/225] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:54 2022] GET /identity/v3/users/4f23865c8d604e7daaaa43d509357cb7 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:54.802347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d3164-fe93-4ea5-a00f-0ae37e37a43a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:54.825061 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dd03d-9c4b-41c9-87bd-51d0544c31a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:54.827081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dd03d-9c4b-41c9-87bd-51d0544c31a9 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:54.827081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dd03d-9c4b-41c9-87bd-51d0544c31a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:54.827081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dd03d-9c4b-41c9-87bd-51d0544c31a9 None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:54.827886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502dd03d-9c4b-41c9-87bd-51d0544c31a9 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:54.829797 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502dd03d-9c4b-41c9-87bd-51d0544c31a9 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:54.832142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 114/226] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:54 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:54.833041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dd03d-9c4b-41c9-87bd-51d0544c31a9 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:54.847324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:54.931834 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d3164-fe93-4ea5-a00f-0ae37e37a43a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:54.940448 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dd03d-9c4b-41c9-87bd-51d0544c31a9 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:54.966718 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c4e65-bb70-471a-81e8-c0f411389518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:54.967402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c4e65-bb70-471a-81e8-c0f411389518 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:54.967694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c4e65-bb70-471a-81e8-c0f411389518 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:54.967975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c4e65-bb70-471a-81e8-c0f411389518 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:54.968737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c4e65-bb70-471a-81e8-c0f411389518 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:54.969161 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c4e65-bb70-471a-81e8-c0f411389518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:54.970479 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c4e65-bb70-471a-81e8-c0f411389518 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:54.977585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d00f45-447e-4cee-aadd-b0d135591a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:54.978449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d00f45-447e-4cee-aadd-b0d135591a8d None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:54.978954 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d00f45-447e-4cee-aadd-b0d135591a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:54.979621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d00f45-447e-4cee-aadd-b0d135591a8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:54.980014 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 113/227] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:54.980627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c4e65-bb70-471a-81e8-c0f411389518 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:55.025321 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:55.052152 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d00f45-447e-4cee-aadd-b0d135591a8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:55.053721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d00f45-447e-4cee-aadd-b0d135591a8d None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:55.073331 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:55.083808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c4e65-bb70-471a-81e8-c0f411389518 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:55.121418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abd653-bd92-4503-ae3e-56511c0c4a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:55.122328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abd653-bd92-4503-ae3e-56511c0c4a8e None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:55.122615 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abd653-bd92-4503-ae3e-56511c0c4a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:55.122900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abd653-bd92-4503-ae3e-56511c0c4a8e None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1/users/de93b6776a9b42e0b82ea8d023fd8127/roles/58b5b157099e42bcb4ee3eff9aaf2064` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:55.125205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abd653-bd92-4503-ae3e-56511c0c4a8e None admin] RBAC: Authorizing `identity:create_grant(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1, user_id=de93b6776a9b42e0b82ea8d023fd8127, role_id=58b5b157099e42bcb4ee3eff9aaf2064)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:55.126676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abd653-bd92-4503-ae3e-56511c0c4a8e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:55.162253 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 115/228] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:24:55.165836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d00f45-447e-4cee-aadd-b0d135591a8d None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:55.202065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 114/229] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:24:54 2022] PUT /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1/users/de93b6776a9b42e0b82ea8d023fd8127/roles/58b5b157099e42bcb4ee3eff9aaf2064 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:24:55.203019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abd653-bd92-4503-ae3e-56511c0c4a8e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:55.291214 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d00f45-447e-4cee-aadd-b0d135591a8d None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:55.302599 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:55.327503 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:55.334575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ac837-8c29-473b-9a0b-03a44fa33058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:55.335553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac837-8c29-473b-9a0b-03a44fa33058 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:55.335843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac837-8c29-473b-9a0b-03a44fa33058 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:55.336120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac837-8c29-473b-9a0b-03a44fa33058 None admin] PATH_INFO: `/v3/users/de93b6776a9b42e0b82ea8d023fd8127` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:55.337378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ac837-8c29-473b-9a0b-03a44fa33058 None admin] RBAC: Authorizing `identity:get_user(user_id=de93b6776a9b42e0b82ea8d023fd8127)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:55.339500 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ac837-8c29-473b-9a0b-03a44fa33058 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:55.342190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 116/230] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:55 2022] GET /identity/v3/users/de93b6776a9b42e0b82ea8d023fd8127 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:55.349625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ac837-8c29-473b-9a0b-03a44fa33058 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:55.365350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abd653-bd92-4503-ae3e-56511c0c4a8e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:55.448358 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc8ad1-66a3-40e0-a42c-f974f842f685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:55.449429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc8ad1-66a3-40e0-a42c-f974f842f685 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:55.449718 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc8ad1-66a3-40e0-a42c-f974f842f685 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:55.450258 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc8ad1-66a3-40e0-a42c-f974f842f685 None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:55.452660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc8ad1-66a3-40e0-a42c-f974f842f685 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:55.457989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc8ad1-66a3-40e0-a42c-f974f842f685 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:55.460109 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 115/231] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:55 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:55.466778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc8ad1-66a3-40e0-a42c-f974f842f685 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:55.528211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ac837-8c29-473b-9a0b-03a44fa33058 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:55.565994 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04bd21-ae78-4c6b-bda9-4cbada13ee99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:55.566788 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04bd21-ae78-4c6b-bda9-4cbada13ee99 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:55.567074 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04bd21-ae78-4c6b-bda9-4cbada13ee99 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:55.567353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04bd21-ae78-4c6b-bda9-4cbada13ee99 None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:55.568806 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04bd21-ae78-4c6b-bda9-4cbada13ee99 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:55.570289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04bd21-ae78-4c6b-bda9-4cbada13ee99 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:55.572170 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 117/232] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:55 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:55.577478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04bd21-ae78-4c6b-bda9-4cbada13ee99 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:55.602316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc8ad1-66a3-40e0-a42c-f974f842f685 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:55.628993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:55.647829 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06fafd-3361-43f1-9a10-93e081993bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:55.648875 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06fafd-3361-43f1-9a10-93e081993bab None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:55.649392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06fafd-3361-43f1-9a10-93e081993bab None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:55.649935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06fafd-3361-43f1-9a10-93e081993bab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:55.650970 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06fafd-3361-43f1-9a10-93e081993bab None admin] RBAC: Adding query filter params (role.id=e8531ae972c749c0a8ea8a73601c5cd1, scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1, user.id=4f23865c8d604e7daaaa43d509357cb7) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:55.651498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06fafd-3361-43f1-9a10-93e081993bab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:55.653239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06fafd-3361-43f1-9a10-93e081993bab None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:55.659748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 116/233] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:24:55 2022] GET /identity/v3/role_assignments?user.id=4f23865c8d604e7daaaa43d509357cb7&scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1&role.id=e8531ae972c749c0a8ea8a73601c5cd1 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:55.699284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04bd21-ae78-4c6b-bda9-4cbada13ee99 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:55.748747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bfca2-8a04-4a86-84e4-3f211c15a290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:55.749699 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bfca2-8a04-4a86-84e4-3f211c15a290 None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:55.749981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bfca2-8a04-4a86-84e4-3f211c15a290 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:55.750259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bfca2-8a04-4a86-84e4-3f211c15a290 None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1/users/de93b6776a9b42e0b82ea8d023fd8127/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:55.752307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bfca2-8a04-4a86-84e4-3f211c15a290 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1, user_id=de93b6776a9b42e0b82ea8d023fd8127, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:55.754293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bfca2-8a04-4a86-84e4-3f211c15a290 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:55.853773 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 118/234] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:24:55 2022] PUT /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1/users/de93b6776a9b42e0b82ea8d023fd8127/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:24:57.138286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00efb81-ab7a-46d6-aea9-7cecaa32a843 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:57.138849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00efb81-ab7a-46d6-aea9-7cecaa32a843 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:57.138849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00efb81-ab7a-46d6-aea9-7cecaa32a843 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:57.140211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 117/235] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:57.145787 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53bcac-ff08-40e1-8027-858e2083500f None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:57.146198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53bcac-ff08-40e1-8027-858e2083500f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:57.146382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53bcac-ff08-40e1-8027-858e2083500f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:57.166569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-5f53bcac-ff08-40e1-8027-858e2083500f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:57.167743 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-5f53bcac-ff08-40e1-8027-858e2083500f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:57.201750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4711d8-8053-4d2c-b33a-1c1eec58581f None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:57.202070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4711d8-8053-4d2c-b33a-1c1eec58581f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:57.202309 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4711d8-8053-4d2c-b33a-1c1eec58581f None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:57.203737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 118/236] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:57.209994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa31646-3ca4-4356-9119-0bfe8b189f0d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:57.210279 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa31646-3ca4-4356-9119-0bfe8b189f0d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:57.210560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa31646-3ca4-4356-9119-0bfe8b189f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:57.239097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6fa31646-3ca4-4356-9119-0bfe8b189f0d None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:57.240303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6fa31646-3ca4-4356-9119-0bfe8b189f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:57.253939 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:57.264161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 119/237] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:57.292600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53bcac-ff08-40e1-8027-858e2083500f None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:57.340059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 119/238] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:24:57.353841 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:57.390017 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa31646-3ca4-4356-9119-0bfe8b189f0d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:57.488582 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53bcac-ff08-40e1-8027-858e2083500f None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:57.555193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1a493-51cb-40ac-a31f-0a4c43c936a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:57.557406 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1a493-51cb-40ac-a31f-0a4c43c936a0 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:57.558569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1a493-51cb-40ac-a31f-0a4c43c936a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:57.559038 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1a493-51cb-40ac-a31f-0a4c43c936a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:57.561141 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1a493-51cb-40ac-a31f-0a4c43c936a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:57.563826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1a493-51cb-40ac-a31f-0a4c43c936a0 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:57.566355 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 120/239] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:24:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:57.572993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa31646-3ca4-4356-9119-0bfe8b189f0d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:57.574213 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1a493-51cb-40ac-a31f-0a4c43c936a0 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:57.647283 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af8143-6e75-4d8c-b4ae-8de73937a190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:57.648322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af8143-6e75-4d8c-b4ae-8de73937a190 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:57.648756 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af8143-6e75-4d8c-b4ae-8de73937a190 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:57.649221 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af8143-6e75-4d8c-b4ae-8de73937a190 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:57.671328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af8143-6e75-4d8c-b4ae-8de73937a190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-e6af8143-6e75-4d8c-b4ae-8de73937a190 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:57.680403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:57.681542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:57.682554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:57.682554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:57.682554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:57.682554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:57.682554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:57.682554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:57.682554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:57.682554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:57.682554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:57.682554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:57.682554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:24:57.682554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:57.689906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 120/240] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:24:57.700056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af8143-6e75-4d8c-b4ae-8de73937a190 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:57.700531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:57.831133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1a493-51cb-40ac-a31f-0a4c43c936a0 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:57.833131 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:57.879073 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365083a6-07ed-432b-a75d-af54044ff19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:57.881439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365083a6-07ed-432b-a75d-af54044ff19a None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:57.881896 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365083a6-07ed-432b-a75d-af54044ff19a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:57.882311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365083a6-07ed-432b-a75d-af54044ff19a None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:57.883469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365083a6-07ed-432b-a75d-af54044ff19a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:57.888833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365083a6-07ed-432b-a75d-af54044ff19a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:57.966041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af8143-6e75-4d8c-b4ae-8de73937a190 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:57.987873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 121/241] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:24:57 2022] POST /identity/v3/users => generated 293 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:24:57.992981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc100f61-3d9d-433b-844a-e6137e1f8bd2 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:57.993698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc100f61-3d9d-433b-844a-e6137e1f8bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:57.994144 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc100f61-3d9d-433b-844a-e6137e1f8bd2 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:57.995711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 122/242] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:58.003224 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740659a-50ce-4b55-89e6-8e9620d2c146 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:58.003811 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740659a-50ce-4b55-89e6-8e9620d2c146 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:58.004285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740659a-50ce-4b55-89e6-8e9620d2c146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:58.023376 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91dd3ea-56df-4f3f-945e-bd8c10b524b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:58.024156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dd3ea-56df-4f3f-945e-bd8c10b524b1 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:58.024504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dd3ea-56df-4f3f-945e-bd8c10b524b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:58.024842 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dd3ea-56df-4f3f-945e-bd8c10b524b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:58.025696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91dd3ea-56df-4f3f-945e-bd8c10b524b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:58.026012 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91dd3ea-56df-4f3f-945e-bd8c10b524b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:58.027634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91dd3ea-56df-4f3f-945e-bd8c10b524b1 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:58.039889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 121/243] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:24:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:58.045460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-c740659a-50ce-4b55-89e6-8e9620d2c146 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:58.045684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91dd3ea-56df-4f3f-945e-bd8c10b524b1 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:58.047071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-c740659a-50ce-4b55-89e6-8e9620d2c146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:58.129238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:58.179151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91dd3ea-56df-4f3f-945e-bd8c10b524b1 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:58.226607 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a0788-826e-4cc7-aaa0-45cf083536a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:58.228076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a0788-826e-4cc7-aaa0-45cf083536a2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:58.228550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a0788-826e-4cc7-aaa0-45cf083536a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:58.229522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a0788-826e-4cc7-aaa0-45cf083536a2 None admin] PATH_INFO: `/v3/users/d07974d9ca354abeae7565421ad82761` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:58.247321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 123/244] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:58.248268 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a0788-826e-4cc7-aaa0-45cf083536a2 None admin] RBAC: Authorizing `identity:get_user(user_id=d07974d9ca354abeae7565421ad82761)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:58.254301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a0788-826e-4cc7-aaa0-45cf083536a2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:58.256480 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 122/245] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:58 2022] GET /identity/v3/users/d07974d9ca354abeae7565421ad82761 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:58.262222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740659a-50ce-4b55-89e6-8e9620d2c146 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:58.286511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a0788-826e-4cc7-aaa0-45cf083536a2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:58.389573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:58.404523 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740659a-50ce-4b55-89e6-8e9620d2c146 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:58.425020 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a0788-826e-4cc7-aaa0-45cf083536a2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:58.444705 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a10d45-1137-4308-a9ea-5a268ee85186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:58.445757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a10d45-1137-4308-a9ea-5a268ee85186 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:58.446264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a10d45-1137-4308-a9ea-5a268ee85186 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:58.446730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a10d45-1137-4308-a9ea-5a268ee85186 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:58.456140 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:58.471748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf7cd8-ea0e-4748-9c8b-63a5c6996a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:58.472406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf7cd8-ea0e-4748-9c8b-63a5c6996a21 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:58.472864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf7cd8-ea0e-4748-9c8b-63a5c6996a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:58.473497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf7cd8-ea0e-4748-9c8b-63a5c6996a21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:58.489196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf7cd8-ea0e-4748-9c8b-63a5c6996a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-87bf7cd8-ea0e-4748-9c8b-63a5c6996a21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:58.500307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:58.501506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:58.502599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:58.502599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:58.502599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:58.502599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:58.502599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:58.502599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:58.502599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:58.502599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:58.502599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:58.502599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:58.502599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:24:58.502599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:58.505203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 123/246] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:24:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:24:58.511214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf7cd8-ea0e-4748-9c8b-63a5c6996a21 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:58.543723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a10d45-1137-4308-a9ea-5a268ee85186 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:58.545493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a10d45-1137-4308-a9ea-5a268ee85186 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:58.636533 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf7cd8-ea0e-4748-9c8b-63a5c6996a21 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:58.665294 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:58.678640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 124/247] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:24:58.682859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14b6df-0465-4832-a351-a75eeab74253 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:58.683361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14b6df-0465-4832-a351-a75eeab74253 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:58.683571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379e71c-5baa-4cc8-9fb6-274fd1b257be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:58.684078 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14b6df-0465-4832-a351-a75eeab74253 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:58.684250 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379e71c-5baa-4cc8-9fb6-274fd1b257be None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:58.684533 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379e71c-5baa-4cc8-9fb6-274fd1b257be None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:58.684809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379e71c-5baa-4cc8-9fb6-274fd1b257be None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:58.685629 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379e71c-5baa-4cc8-9fb6-274fd1b257be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:58.685936 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379e71c-5baa-4cc8-9fb6-274fd1b257be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:58.686719 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 125/248] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:58.687621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14b6df-0465-4832-a351-a75eeab74253 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:58.688531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379e71c-5baa-4cc8-9fb6-274fd1b257be None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:58.701337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 124/249] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:24:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:24:58.707938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dd243-cd7e-465e-8c3e-2e67a8874cae None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:58.708235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dd243-cd7e-465e-8c3e-2e67a8874cae None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:58.708514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dd243-cd7e-465e-8c3e-2e67a8874cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:58.728286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-136dd243-cd7e-465e-8c3e-2e67a8874cae None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:58.729900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-136dd243-cd7e-465e-8c3e-2e67a8874cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:58.782184 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:58.811863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 125/250] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:58.812833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136dd243-cd7e-465e-8c3e-2e67a8874cae None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:58.828787 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14b6df-0465-4832-a351-a75eeab74253 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:58.893668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd2f40-af5a-4efc-90f7-35d0cd3838cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:58.894563 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd2f40-af5a-4efc-90f7-35d0cd3838cd None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:58.894852 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd2f40-af5a-4efc-90f7-35d0cd3838cd None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:58.895137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd2f40-af5a-4efc-90f7-35d0cd3838cd None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:58.896378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd2f40-af5a-4efc-90f7-35d0cd3838cd None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:58.897896 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd2f40-af5a-4efc-90f7-35d0cd3838cd None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:58.899915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 126/251] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:58 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:58.900704 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd2f40-af5a-4efc-90f7-35d0cd3838cd None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:58.931883 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136dd243-cd7e-465e-8c3e-2e67a8874cae None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:58.970925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e68f4-f5c7-4550-b8d8-a1ba86741de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:58.972646 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e68f4-f5c7-4550-b8d8-a1ba86741de0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:58.972957 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e68f4-f5c7-4550-b8d8-a1ba86741de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:58.973237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e68f4-f5c7-4550-b8d8-a1ba86741de0 None admin] PATH_INFO: `/v3/users/de93b6776a9b42e0b82ea8d023fd8127` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:58.974502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e68f4-f5c7-4550-b8d8-a1ba86741de0 None admin] RBAC: Authorizing `identity:get_user(user_id=de93b6776a9b42e0b82ea8d023fd8127)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:58.975968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e68f4-f5c7-4550-b8d8-a1ba86741de0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:58.984970 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 126/252] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:58 2022] GET /identity/v3/users/de93b6776a9b42e0b82ea8d023fd8127 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:58.984970 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e68f4-f5c7-4550-b8d8-a1ba86741de0 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:59.024864 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:59.028329 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:59.083730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd2f40-af5a-4efc-90f7-35d0cd3838cd None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:59.093655 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e68f4-f5c7-4550-b8d8-a1ba86741de0 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:59.137404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b379a9-551a-4d5f-a962-9deee7a9fd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:59.138215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b379a9-551a-4d5f-a962-9deee7a9fd8f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:59.138500 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b379a9-551a-4d5f-a962-9deee7a9fd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:59.138781 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b379a9-551a-4d5f-a962-9deee7a9fd8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:59.147534 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c4b20-594f-43c9-8181-9de67cdf6176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:59.148700 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c4b20-594f-43c9-8181-9de67cdf6176 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:59.149134 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c4b20-594f-43c9-8181-9de67cdf6176 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:59.149513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c4b20-594f-43c9-8181-9de67cdf6176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:59.150747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c4b20-594f-43c9-8181-9de67cdf6176 None admin] RBAC: Adding query filter params (role.id=98b5f1ee87964b378ac55b7e47ba10f6, scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1, user.id=d07974d9ca354abeae7565421ad82761) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:59.150862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b379a9-551a-4d5f-a962-9deee7a9fd8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:59.151229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c4b20-594f-43c9-8181-9de67cdf6176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:59.152772 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c4b20-594f-43c9-8181-9de67cdf6176 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-b5b379a9-551a-4d5f-a962-9deee7a9fd8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:59.158665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:59.159571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:59.160769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:59.160769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:59.160769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:59.160769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:59.160769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:59.160769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:59.160769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:59.160769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:59.160769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:59.160769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:59.160769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:24:59.160769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:24:59.161931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 127/253] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:24:58 2022] GET /identity/v3/role_assignments?user.id=d07974d9ca354abeae7565421ad82761&scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1&role.id=98b5f1ee87964b378ac55b7e47ba10f6 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:59.161931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c4b20-594f-43c9-8181-9de67cdf6176 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:59.165085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 127/254] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:24:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:59.166650 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa198fe1-3d57-403b-a711-8eaf6e681676 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:59.166939 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa198fe1-3d57-403b-a711-8eaf6e681676 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:59.167219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa198fe1-3d57-403b-a711-8eaf6e681676 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:59.168648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 128/255] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:24:59.174090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa198fe1-3d57-403b-a711-8eaf6e681676 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:59.290440 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c4b20-594f-43c9-8181-9de67cdf6176 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:59.301362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:59.316402 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa198fe1-3d57-403b-a711-8eaf6e681676 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:59.340287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47024f9c-9abb-40b1-a545-afac2db574a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:59.340890 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47024f9c-9abb-40b1-a545-afac2db574a5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:59.341206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47024f9c-9abb-40b1-a545-afac2db574a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:59.341490 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47024f9c-9abb-40b1-a545-afac2db574a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:59.355265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:59.425753 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02073727-3497-41bd-aa4a-2acdb8e0128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:59.426841 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02073727-3497-41bd-aa4a-2acdb8e0128a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:59.427319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02073727-3497-41bd-aa4a-2acdb8e0128a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:59.427787 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02073727-3497-41bd-aa4a-2acdb8e0128a None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:59.428783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02073727-3497-41bd-aa4a-2acdb8e0128a None admin] RBAC: Adding query filter params (name=member) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:24:59.429335 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02073727-3497-41bd-aa4a-2acdb8e0128a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:59.429779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47024f9c-9abb-40b1-a545-afac2db574a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:59.431097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02073727-3497-41bd-aa4a-2acdb8e0128a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:59.431650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47024f9c-9abb-40b1-a545-afac2db574a5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:59.448264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 129/256] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:24:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:59.449696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552b938-72ef-4f97-93c1-f84f5e271dbb None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:59.449986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552b938-72ef-4f97-93c1-f84f5e271dbb None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:59.450265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552b938-72ef-4f97-93c1-f84f5e271dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:59.470210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-7552b938-72ef-4f97-93c1-f84f5e271dbb None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:24:59.472804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7552b938-72ef-4f97-93c1-f84f5e271dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:24:59.555736 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 128/257] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:24:59.557058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47024f9c-9abb-40b1-a545-afac2db574a5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:59.569254 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:59.597251 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 130/258] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:24:59.597417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552b938-72ef-4f97-93c1-f84f5e271dbb None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:59.694600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47024f9c-9abb-40b1-a545-afac2db574a5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:59.731562 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235faba5-1dce-424d-92ac-9f2d9d1dec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:59.732804 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235faba5-1dce-424d-92ac-9f2d9d1dec01 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:59.733326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235faba5-1dce-424d-92ac-9f2d9d1dec01 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:59.733964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235faba5-1dce-424d-92ac-9f2d9d1dec01 None admin] PATH_INFO: `/v3/users/4f23865c8d604e7daaaa43d509357cb7` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:59.735383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235faba5-1dce-424d-92ac-9f2d9d1dec01 None admin] RBAC: Authorizing `identity:get_user(user_id=4f23865c8d604e7daaaa43d509357cb7)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:24:59.737919 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235faba5-1dce-424d-92ac-9f2d9d1dec01 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:24:59.739811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 129/259] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:24:59 2022] GET /identity/v3/users/4f23865c8d604e7daaaa43d509357cb7 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:24:59.740808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235faba5-1dce-424d-92ac-9f2d9d1dec01 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:59.824915 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:24:59.852207 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235faba5-1dce-424d-92ac-9f2d9d1dec01 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:24:59.894165 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2420954-f2f6-4a5b-aec2-798671bb858f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:24:59.894768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2420954-f2f6-4a5b-aec2-798671bb858f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:24:59.895054 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2420954-f2f6-4a5b-aec2-798671bb858f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:24:59.895328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2420954-f2f6-4a5b-aec2-798671bb858f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:24:59.906482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2420954-f2f6-4a5b-aec2-798671bb858f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-c2420954-f2f6-4a5b-aec2-798671bb858f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:24:59.915133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:24:59.916050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:24:59.916925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:24:59.916925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:24:59.916925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:24:59.916925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:24:59.916925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:24:59.916925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:24:59.916925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:24:59.916925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:24:59.916925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:24:59.916925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:24:59.916925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:24:59.916925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:24:59.916925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 130/260] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:24:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:24:59.917607 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2420954-f2f6-4a5b-aec2-798671bb858f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:24:59.982332 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552b938-72ef-4f97-93c1-f84f5e271dbb None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:00.015059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:00.028607 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2420954-f2f6-4a5b-aec2-798671bb858f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:00.065057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca355d-0e3d-42f7-b547-96287bf191fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:00.065967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca355d-0e3d-42f7-b547-96287bf191fb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:00.066251 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca355d-0e3d-42f7-b547-96287bf191fb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:00.066527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca355d-0e3d-42f7-b547-96287bf191fb None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:00.068006 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca355d-0e3d-42f7-b547-96287bf191fb None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:00.069972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca355d-0e3d-42f7-b547-96287bf191fb None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:00.072214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 131/261] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:59 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:00.073302 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca355d-0e3d-42f7-b547-96287bf191fb None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:00.101299 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:00.141652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee95352-6217-4ba3-9dfc-044b6faf66ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:00.141652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee95352-6217-4ba3-9dfc-044b6faf66ba None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:00.141652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee95352-6217-4ba3-9dfc-044b6faf66ba None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:00.141652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee95352-6217-4ba3-9dfc-044b6faf66ba None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:00.142164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee95352-6217-4ba3-9dfc-044b6faf66ba None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:00.142164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee95352-6217-4ba3-9dfc-044b6faf66ba None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:00.142164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 131/262] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:24:59 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 537 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:00.142164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee95352-6217-4ba3-9dfc-044b6faf66ba None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:00.187891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca355d-0e3d-42f7-b547-96287bf191fb None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:00.224396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48efa3-06fa-4110-a91d-973b56f7147f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:00.225496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48efa3-06fa-4110-a91d-973b56f7147f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:00.225968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48efa3-06fa-4110-a91d-973b56f7147f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:00.226474 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48efa3-06fa-4110-a91d-973b56f7147f None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:00.227468 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48efa3-06fa-4110-a91d-973b56f7147f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:00.228007 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48efa3-06fa-4110-a91d-973b56f7147f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:00.230022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48efa3-06fa-4110-a91d-973b56f7147f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:00.240730 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 132/263] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:00.242159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48efa3-06fa-4110-a91d-973b56f7147f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:00.317434 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:00.336927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee95352-6217-4ba3-9dfc-044b6faf66ba None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:00.349179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48efa3-06fa-4110-a91d-973b56f7147f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:00.386577 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be22712-f973-4e19-a16a-9a2d7ee44d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:00.387548 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be22712-f973-4e19-a16a-9a2d7ee44d1c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:00.388054 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be22712-f973-4e19-a16a-9a2d7ee44d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:00.388517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be22712-f973-4e19-a16a-9a2d7ee44d1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:00.389715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be22712-f973-4e19-a16a-9a2d7ee44d1c None admin] RBAC: Adding query filter params (role.id=58b5b157099e42bcb4ee3eff9aaf2064, scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1, user.id=de93b6776a9b42e0b82ea8d023fd8127) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:00.390229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be22712-f973-4e19-a16a-9a2d7ee44d1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:00.391974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be22712-f973-4e19-a16a-9a2d7ee44d1c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:00.399414 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 133/264] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:25:00 2022] GET /identity/v3/role_assignments?user.id=de93b6776a9b42e0b82ea8d023fd8127&scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1&role.id=58b5b157099e42bcb4ee3eff9aaf2064 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:00.400572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be22712-f973-4e19-a16a-9a2d7ee44d1c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:00.411103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d7e9-ec4e-46a5-ae8e-4127e27b4b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:00.411478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d7e9-ec4e-46a5-ae8e-4127e27b4b39 None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:00.411817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d7e9-ec4e-46a5-ae8e-4127e27b4b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:00.412126 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d7e9-ec4e-46a5-ae8e-4127e27b4b39 None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1/users/4f23865c8d604e7daaaa43d509357cb7/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:00.418381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600d7e9-ec4e-46a5-ae8e-4127e27b4b39 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1, user_id=4f23865c8d604e7daaaa43d509357cb7, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:00.419868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600d7e9-ec4e-46a5-ae8e-4127e27b4b39 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:00.502136 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 132/265] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:25:00 2022] PUT /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1/users/4f23865c8d604e7daaaa43d509357cb7/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:25:00.528328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be22712-f973-4e19-a16a-9a2d7ee44d1c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:00.563261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:00.572882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813c4bc-1ab2-4be9-8049-1394bf328cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:00.573829 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813c4bc-1ab2-4be9-8049-1394bf328cea None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:00.574112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813c4bc-1ab2-4be9-8049-1394bf328cea None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:00.574387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813c4bc-1ab2-4be9-8049-1394bf328cea None admin] PATH_INFO: `/v3/users/de93b6776a9b42e0b82ea8d023fd8127` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:00.575720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813c4bc-1ab2-4be9-8049-1394bf328cea None admin] RBAC: Authorizing `identity:get_user(user_id=de93b6776a9b42e0b82ea8d023fd8127)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:00.577379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813c4bc-1ab2-4be9-8049-1394bf328cea None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:00.579678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 134/266] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:25:00 2022] GET /identity/v3/users/de93b6776a9b42e0b82ea8d023fd8127 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:00.585311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d7e9-ec4e-46a5-ae8e-4127e27b4b39 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:00.644380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:00.736242 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d7e9-ec4e-46a5-ae8e-4127e27b4b39 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:00.785795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537a758-dc9b-4a92-a338-21507261be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:00.786472 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537a758-dc9b-4a92-a338-21507261be31 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:00.786755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537a758-dc9b-4a92-a338-21507261be31 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:00.787037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537a758-dc9b-4a92-a338-21507261be31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:00.882422 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537a758-dc9b-4a92-a338-21507261be31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:00.883989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537a758-dc9b-4a92-a338-21507261be31 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:00.930727 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:00.997895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 133/267] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:01.004159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813c4bc-1ab2-4be9-8049-1394bf328cea None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:01.130933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813c4bc-1ab2-4be9-8049-1394bf328cea None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:01.167187 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee0169-743b-4ecd-8d15-448cf3a31476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:01.168059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee0169-743b-4ecd-8d15-448cf3a31476 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:01.168366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee0169-743b-4ecd-8d15-448cf3a31476 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:01.168626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee0169-743b-4ecd-8d15-448cf3a31476 None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:01.169854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee0169-743b-4ecd-8d15-448cf3a31476 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:01.171322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee0169-743b-4ecd-8d15-448cf3a31476 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:01.173222 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 135/268] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:01 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:01.182141 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537a758-dc9b-4a92-a338-21507261be31 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:01.308684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537a758-dc9b-4a92-a338-21507261be31 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:01.365643 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712fa39-9bac-4799-ae54-94909b2246dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:01.367145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712fa39-9bac-4799-ae54-94909b2246dd None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:01.367659 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712fa39-9bac-4799-ae54-94909b2246dd None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:01.368148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712fa39-9bac-4799-ae54-94909b2246dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:01.369228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712fa39-9bac-4799-ae54-94909b2246dd None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1, user.id=de93b6776a9b42e0b82ea8d023fd8127) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:01.369757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712fa39-9bac-4799-ae54-94909b2246dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:01.371418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712fa39-9bac-4799-ae54-94909b2246dd None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:01.374815 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:01.379150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 134/269] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:25:01 2022] GET /identity/v3/role_assignments?user.id=de93b6776a9b42e0b82ea8d023fd8127&scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:01.464085 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0f417-a7a9-4f35-bd35-0bfae540f15b None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:01.464604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0f417-a7a9-4f35-bd35-0bfae540f15b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:01.464604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0f417-a7a9-4f35-bd35-0bfae540f15b None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:01.466021 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 136/270] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:01.477479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b3b85-0236-40a6-8fe2-beb207da91e1 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:01.477479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b3b85-0236-40a6-8fe2-beb207da91e1 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:01.477479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b3b85-0236-40a6-8fe2-beb207da91e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:01.504692 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-0d6b3b85-0236-40a6-8fe2-beb207da91e1 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:01.506004 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0d6b3b85-0236-40a6-8fe2-beb207da91e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:01.585916 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8fa27-bc8c-46fb-ad51-dd67d9f44c95 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:01.586564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8fa27-bc8c-46fb-ad51-dd67d9f44c95 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:01.587065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8fa27-bc8c-46fb-ad51-dd67d9f44c95 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:01.588766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 137/271] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:01.595118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaf72e-977e-4832-8281-ca02f56d388b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:01.595391 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 135/272] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:01.596694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaf72e-977e-4832-8281-ca02f56d388b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:01.597391 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaf72e-977e-4832-8281-ca02f56d388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:01.621634 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b3b85-0236-40a6-8fe2-beb207da91e1 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:01.626346 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7eaaf72e-977e-4832-8281-ca02f56d388b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:01.627731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7eaaf72e-977e-4832-8281-ca02f56d388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:01.715965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:01.729224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 138/273] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:25:01.760143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaf72e-977e-4832-8281-ca02f56d388b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:01.760851 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b3b85-0236-40a6-8fe2-beb207da91e1 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:01.803881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:01.811177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b70212-602d-437f-8189-353b67972234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:01.812202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b70212-602d-437f-8189-353b67972234 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:01.812647 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b70212-602d-437f-8189-353b67972234 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:01.813503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b70212-602d-437f-8189-353b67972234 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:01.820310 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b70212-602d-437f-8189-353b67972234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:01.820310 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b70212-602d-437f-8189-353b67972234 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:01.821441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 136/274] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:01.827982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b70212-602d-437f-8189-353b67972234 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:01.886681 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaf72e-977e-4832-8281-ca02f56d388b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:01.921950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b41e0-fd7c-4447-a478-ec78c72c4f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:01.922760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b41e0-fd7c-4447-a478-ec78c72c4f0a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:01.923048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b41e0-fd7c-4447-a478-ec78c72c4f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:01.923331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b41e0-fd7c-4447-a478-ec78c72c4f0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:01.935492 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b41e0-fd7c-4447-a478-ec78c72c4f0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-0f0b41e0-fd7c-4447-a478-ec78c72c4f0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:01.944191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:01.945152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:01.945976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:01.945976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:01.945976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:01.945976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:01.945976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:01.945976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:01.945976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:01.945976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:01.945976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:01.945976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:01.945976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:01.945976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:01.945976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 139/275] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:01.947936 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b70212-602d-437f-8189-353b67972234 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:01.951599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b41e0-fd7c-4447-a478-ec78c72c4f0a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:01.988618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b09569-3e50-410e-b9aa-73b56fe863da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:01.989595 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b09569-3e50-410e-b9aa-73b56fe863da None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:01.990074 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b09569-3e50-410e-b9aa-73b56fe863da None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:01.990532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b09569-3e50-410e-b9aa-73b56fe863da None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:01.991482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b09569-3e50-410e-b9aa-73b56fe863da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:01.993211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b09569-3e50-410e-b9aa-73b56fe863da None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:02.010924 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:02.057271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b41e0-fd7c-4447-a478-ec78c72c4f0a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:02.094507 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f22a73-0b09-45de-a5cf-d970bad2092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:02.095185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f22a73-0b09-45de-a5cf-d970bad2092b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:02.095478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f22a73-0b09-45de-a5cf-d970bad2092b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:02.096299 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f22a73-0b09-45de-a5cf-d970bad2092b None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:02.097219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f22a73-0b09-45de-a5cf-d970bad2092b None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:02.097538 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f22a73-0b09-45de-a5cf-d970bad2092b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:02.099026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f22a73-0b09-45de-a5cf-d970bad2092b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:02.107921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 140/276] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:02.114355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f22a73-0b09-45de-a5cf-d970bad2092b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:02.121028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 137/277] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:25:01 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:25:02.136677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08f17a-bb9e-4ccf-8caf-799952161320 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:02.137051 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08f17a-bb9e-4ccf-8caf-799952161320 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:02.137281 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08f17a-bb9e-4ccf-8caf-799952161320 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:02.139052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 138/278] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:02.145760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95b269-cc28-4ba4-a9bb-210bfaa34a9b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:02.146097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95b269-cc28-4ba4-a9bb-210bfaa34a9b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:02.146332 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95b269-cc28-4ba4-a9bb-210bfaa34a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:02.165917 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-5a95b269-cc28-4ba4-a9bb-210bfaa34a9b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:02.167147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-5a95b269-cc28-4ba4-a9bb-210bfaa34a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:02.226556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:02.235718 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f22a73-0b09-45de-a5cf-d970bad2092b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:02.247268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 139/279] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:02.275478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:02.276883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95b269-cc28-4ba4-a9bb-210bfaa34a9b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:02.284272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37511574-b18c-4e45-ade9-3fadc7e22fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:02.284272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37511574-b18c-4e45-ade9-3fadc7e22fde None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:02.284272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37511574-b18c-4e45-ade9-3fadc7e22fde None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:02.284272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37511574-b18c-4e45-ade9-3fadc7e22fde None admin] PATH_INFO: `/v3/users/176b8d894e324ce3944b417ee0b7a471` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:02.305275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37511574-b18c-4e45-ade9-3fadc7e22fde None admin] RBAC: Authorizing `identity:get_user(user_id=176b8d894e324ce3944b417ee0b7a471)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:02.306980 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37511574-b18c-4e45-ade9-3fadc7e22fde None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:02.309830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 141/280] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:25:02 2022] GET /identity/v3/users/176b8d894e324ce3944b417ee0b7a471 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:02.315860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37511574-b18c-4e45-ade9-3fadc7e22fde None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:02.414993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95b269-cc28-4ba4-a9bb-210bfaa34a9b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:02.443396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37511574-b18c-4e45-ade9-3fadc7e22fde None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:02.452624 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea4692-a982-4258-b049-24001f7a770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:02.453664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea4692-a982-4258-b049-24001f7a770c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:02.454082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea4692-a982-4258-b049-24001f7a770c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:02.454513 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea4692-a982-4258-b049-24001f7a770c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:02.472367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea4692-a982-4258-b049-24001f7a770c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:02.482805 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fde4a-2c7c-4d4d-80b7-b6e0d95a1e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-87ea4692-a982-4258-b049-24001f7a770c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:02.483390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:02.484250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:02.485499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:02.485499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:02.485499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:02.485499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:02.485499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:02.485499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:02.485499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:02.485499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:02.485499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:02.485499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:02.485499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:25:02.485499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:02.486139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fde4a-2c7c-4d4d-80b7-b6e0d95a1e04 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:02.486139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fde4a-2c7c-4d4d-80b7-b6e0d95a1e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:02.486139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fde4a-2c7c-4d4d-80b7-b6e0d95a1e04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:02.486139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fde4a-2c7c-4d4d-80b7-b6e0d95a1e04 None admin] RBAC: Adding query filter params (role.id=e8531ae972c749c0a8ea8a73601c5cd1, user.id=176b8d894e324ce3944b417ee0b7a471, scope.system=all) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:02.486139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fde4a-2c7c-4d4d-80b7-b6e0d95a1e04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:02.486988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fde4a-2c7c-4d4d-80b7-b6e0d95a1e04 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:02.489038 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 140/281] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:02.490833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea4692-a982-4258-b049-24001f7a770c None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:02.494225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 142/282] 10.222.0.33 () {56 vars in 1308 bytes} [Wed Jun 1 17:25:02 2022] GET /identity/v3/role_assignments?user.id=176b8d894e324ce3944b417ee0b7a471&scope.system=all&role.id=e8531ae972c749c0a8ea8a73601c5cd1 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:02.546286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:02.610321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea4692-a982-4258-b049-24001f7a770c None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:02.652778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7daf3-57d6-424d-99d7-854baa73ff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:02.653758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7daf3-57d6-424d-99d7-854baa73ff2f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:02.654181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7daf3-57d6-424d-99d7-854baa73ff2f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:02.654593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7daf3-57d6-424d-99d7-854baa73ff2f None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:02.655489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7daf3-57d6-424d-99d7-854baa73ff2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:02.655948 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7daf3-57d6-424d-99d7-854baa73ff2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:02.657550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7daf3-57d6-424d-99d7-854baa73ff2f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:02.671459 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 141/283] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:25:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:02.678119 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fde4a-2c7c-4d4d-80b7-b6e0d95a1e04 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:02.725125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:02.790208 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fde4a-2c7c-4d4d-80b7-b6e0d95a1e04 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:02.826175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cbd53-eb75-481f-865e-9b01b9467109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:02.827269 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cbd53-eb75-481f-865e-9b01b9467109 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:02.827700 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cbd53-eb75-481f-865e-9b01b9467109 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:02.828112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cbd53-eb75-481f-865e-9b01b9467109 None admin] PATH_INFO: `/v3/users/d07974d9ca354abeae7565421ad82761` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:02.829485 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cbd53-eb75-481f-865e-9b01b9467109 None admin] RBAC: Authorizing `identity:get_user(user_id=d07974d9ca354abeae7565421ad82761)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:02.831735 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cbd53-eb75-481f-865e-9b01b9467109 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:02.837017 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 143/284] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:25:02 2022] GET /identity/v3/users/d07974d9ca354abeae7565421ad82761 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:02.839702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7daf3-57d6-424d-99d7-854baa73ff2f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:02.956649 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7daf3-57d6-424d-99d7-854baa73ff2f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:02.964154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:03.006222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab12a0b-a25b-43f2-9ea2-d0c484eb2829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:03.007108 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab12a0b-a25b-43f2-9ea2-d0c484eb2829 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:03.007397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab12a0b-a25b-43f2-9ea2-d0c484eb2829 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:03.007680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab12a0b-a25b-43f2-9ea2-d0c484eb2829 None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:03.008907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab12a0b-a25b-43f2-9ea2-d0c484eb2829 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:03.010411 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab12a0b-a25b-43f2-9ea2-d0c484eb2829 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:03.012432 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 142/285] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:02 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:03.018221 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cbd53-eb75-481f-865e-9b01b9467109 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:03.161629 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cbd53-eb75-481f-865e-9b01b9467109 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:03.169553 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:03.209664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2662a-08c0-4fc7-bd3e-2645879bba07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:03.210918 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2662a-08c0-4fc7-bd3e-2645879bba07 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:03.211413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2662a-08c0-4fc7-bd3e-2645879bba07 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:03.211891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2662a-08c0-4fc7-bd3e-2645879bba07 None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1/users/d07974d9ca354abeae7565421ad82761/roles/98b5f1ee87964b378ac55b7e47ba10f6` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:03.214245 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2662a-08c0-4fc7-bd3e-2645879bba07 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1, user_id=d07974d9ca354abeae7565421ad82761, role_id=98b5f1ee87964b378ac55b7e47ba10f6)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:03.215942 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c2662a-08c0-4fc7-bd3e-2645879bba07 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:03.298576 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 144/286] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:25:03 2022] PUT /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1/users/d07974d9ca354abeae7565421ad82761/roles/98b5f1ee87964b378ac55b7e47ba10f6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:25:03.385611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ae60f-8236-4e84-b905-d04a28e1ebda None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:03.385934 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ae60f-8236-4e84-b905-d04a28e1ebda None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:03.386165 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ae60f-8236-4e84-b905-d04a28e1ebda None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:03.387717 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 143/287] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:03.393562 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b339063-92b3-4771-9569-8e1b88e02e38 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:03.394098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b339063-92b3-4771-9569-8e1b88e02e38 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:03.394591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b339063-92b3-4771-9569-8e1b88e02e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:03.418198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-9b339063-92b3-4771-9569-8e1b88e02e38 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:03.419379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9b339063-92b3-4771-9569-8e1b88e02e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:03.527818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 145/288] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:03.566183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ae60f-8236-4e84-b905-d04a28e1ebda None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:03.702975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ae60f-8236-4e84-b905-d04a28e1ebda None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:03.745359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab9c27-8c8f-4c17-b76a-f6de0de8d83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:03.746221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab9c27-8c8f-4c17-b76a-f6de0de8d83c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:03.746505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab9c27-8c8f-4c17-b76a-f6de0de8d83c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:03.746830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab9c27-8c8f-4c17-b76a-f6de0de8d83c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:03.757637 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab9c27-8c8f-4c17-b76a-f6de0de8d83c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-26ab9c27-8c8f-4c17-b76a-f6de0de8d83c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:03.765528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:03.766380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:03.767950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:03.767950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:03.767950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:03.767950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:03.767950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:03.767950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:03.767950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:03.767950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:03.767950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:03.767950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:03.767950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:03.767950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:03.767950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 144/289] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:03.773136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b339063-92b3-4771-9569-8e1b88e02e38 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:03.918444 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:03.924555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b339063-92b3-4771-9569-8e1b88e02e38 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:03.960630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab003297-0953-4ee6-acda-aa1d81766ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:03.961263 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab003297-0953-4ee6-acda-aa1d81766ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:03.961554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab003297-0953-4ee6-acda-aa1d81766ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:03.965989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab003297-0953-4ee6-acda-aa1d81766ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:03.965989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab003297-0953-4ee6-acda-aa1d81766ed9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:03.965989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab003297-0953-4ee6-acda-aa1d81766ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:03.965989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab003297-0953-4ee6-acda-aa1d81766ed9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:03.973671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 146/290] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:25:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:03.979215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab9c27-8c8f-4c17-b76a-f6de0de8d83c None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:04.015221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:04.100732 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab9c27-8c8f-4c17-b76a-f6de0de8d83c None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:04.142111 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff7291-94f6-4389-8fee-66e47e7cf896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:04.143718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff7291-94f6-4389-8fee-66e47e7cf896 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:04.144007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff7291-94f6-4389-8fee-66e47e7cf896 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:04.144285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff7291-94f6-4389-8fee-66e47e7cf896 None admin] PATH_INFO: `/v3/users/4f23865c8d604e7daaaa43d509357cb7` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:04.145573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff7291-94f6-4389-8fee-66e47e7cf896 None admin] RBAC: Authorizing `identity:get_user(user_id=4f23865c8d604e7daaaa43d509357cb7)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:04.147101 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff7291-94f6-4389-8fee-66e47e7cf896 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:04.148744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 145/291] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:25:03 2022] GET /identity/v3/users/4f23865c8d604e7daaaa43d509357cb7 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:04.154188 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab003297-0953-4ee6-acda-aa1d81766ed9 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:04.266119 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab003297-0953-4ee6-acda-aa1d81766ed9 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:04.302166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a04a47-15e6-4303-9690-dba8c97f76c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:04.302821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a04a47-15e6-4303-9690-dba8c97f76c3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:04.303109 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a04a47-15e6-4303-9690-dba8c97f76c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:04.303392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a04a47-15e6-4303-9690-dba8c97f76c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:04.332490 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:04.379370 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a04a47-15e6-4303-9690-dba8c97f76c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:04.380913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a04a47-15e6-4303-9690-dba8c97f76c3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:04.483581 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 147/292] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:04.490005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff7291-94f6-4389-8fee-66e47e7cf896 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:04.697345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff7291-94f6-4389-8fee-66e47e7cf896 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:04.699800 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:04.733840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61551a98-9908-43f0-a20f-7897d563c676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:04.735256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61551a98-9908-43f0-a20f-7897d563c676 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:04.735752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61551a98-9908-43f0-a20f-7897d563c676 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:04.736822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61551a98-9908-43f0-a20f-7897d563c676 None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:04.738572 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61551a98-9908-43f0-a20f-7897d563c676 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:04.740284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61551a98-9908-43f0-a20f-7897d563c676 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:04.743763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 146/293] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:04 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:04.749809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a04a47-15e6-4303-9690-dba8c97f76c3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:04.833305 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:04.858964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a04a47-15e6-4303-9690-dba8c97f76c3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:04.895073 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48239757-90f1-4caa-9acd-1037bf2bea93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:04.896071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48239757-90f1-4caa-9acd-1037bf2bea93 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:04.896554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48239757-90f1-4caa-9acd-1037bf2bea93 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:04.897059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48239757-90f1-4caa-9acd-1037bf2bea93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:04.898115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48239757-90f1-4caa-9acd-1037bf2bea93 None admin] RBAC: Adding query filter params (role.id=e8531ae972c749c0a8ea8a73601c5cd1, scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1, user.id=4f23865c8d604e7daaaa43d509357cb7) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:04.898635 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48239757-90f1-4caa-9acd-1037bf2bea93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:04.900273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48239757-90f1-4caa-9acd-1037bf2bea93 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:04.906973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 148/294] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:25:04 2022] GET /identity/v3/role_assignments?user.id=4f23865c8d604e7daaaa43d509357cb7&scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1&role.id=e8531ae972c749c0a8ea8a73601c5cd1 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:05.191738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7a744-2144-4f8d-a573-5b8dfbc8706e None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:05.192443 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7a744-2144-4f8d-a573-5b8dfbc8706e None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:05.192926 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7a744-2144-4f8d-a573-5b8dfbc8706e None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:05.194796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 147/295] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:05.199952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e53613-3931-43e4-8e01-0a55f75017c4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:05.200504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e53613-3931-43e4-8e01-0a55f75017c4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:05.201102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e53613-3931-43e4-8e01-0a55f75017c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:05.202536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7926c-aae4-4033-861c-9f51e861a636 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:05.202819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7926c-aae4-4033-861c-9f51e861a636 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:05.203093 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7926c-aae4-4033-861c-9f51e861a636 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:05.204432 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 148/296] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:25:05.211078 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a08b91-99da-4a66-81f7-aca2cca974f9 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:05.211655 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a08b91-99da-4a66-81f7-aca2cca974f9 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:05.212125 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a08b91-99da-4a66-81f7-aca2cca974f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:05.226734 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c1e53613-3931-43e4-8e01-0a55f75017c4 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:05.228305 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c1e53613-3931-43e4-8e01-0a55f75017c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:05.231989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-06a08b91-99da-4a66-81f7-aca2cca974f9 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:05.233588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-06a08b91-99da-4a66-81f7-aca2cca974f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:05.313045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 149/297] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:25:05.317105 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 149/298] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:05.332055 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a08b91-99da-4a66-81f7-aca2cca974f9 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:05.342696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e53613-3931-43e4-8e01-0a55f75017c4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:05.414436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:05.446579 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:05.450206 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a08b91-99da-4a66-81f7-aca2cca974f9 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:05.489184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e81a6-387b-4182-bfc0-f4471943c8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:05.490020 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e81a6-387b-4182-bfc0-f4471943c8ff None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:05.490395 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e81a6-387b-4182-bfc0-f4471943c8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:05.490755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e81a6-387b-4182-bfc0-f4471943c8ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:05.491976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e81a6-387b-4182-bfc0-f4471943c8ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:05.492383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e53613-3931-43e4-8e01-0a55f75017c4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:05.493677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e81a6-387b-4182-bfc0-f4471943c8ff None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:05.495839 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 150/299] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:05.501361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e81a6-387b-4182-bfc0-f4471943c8ff None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:05.531017 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462afc35-0034-4432-9f07-614147ac7ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:05.532251 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462afc35-0034-4432-9f07-614147ac7ace None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:05.532718 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462afc35-0034-4432-9f07-614147ac7ace None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:05.533922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462afc35-0034-4432-9f07-614147ac7ace None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:05.545690 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462afc35-0034-4432-9f07-614147ac7ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-462afc35-0034-4432-9f07-614147ac7ace None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:05.554610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:05.555496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:05.556287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:05.556287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:05.556287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:05.556287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:05.556287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:05.556287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:05.556287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:05.556287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:05.556287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:05.556287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:05.556287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:25:05.556287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:05.558822 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 150/300] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:05.565509 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462afc35-0034-4432-9f07-614147ac7ace None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:05.619491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e81a6-387b-4182-bfc0-f4471943c8ff None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:05.657031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c97bcd-1076-40ea-9900-e6bdf635a033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:05.661602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c97bcd-1076-40ea-9900-e6bdf635a033 None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:05.661602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c97bcd-1076-40ea-9900-e6bdf635a033 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:05.661602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c97bcd-1076-40ea-9900-e6bdf635a033 None admin] PATH_INFO: `/v3/groups` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:05.661602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c97bcd-1076-40ea-9900-e6bdf635a033 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:05.661602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c97bcd-1076-40ea-9900-e6bdf635a033 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:05.677379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462afc35-0034-4432-9f07-614147ac7ace None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:05.691137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:05.716708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cf445-fccc-4d2f-8678-9ecbb1519efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:05.717349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cf445-fccc-4d2f-8678-9ecbb1519efd None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:05.717638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cf445-fccc-4d2f-8678-9ecbb1519efd None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:05.717902 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cf445-fccc-4d2f-8678-9ecbb1519efd None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:05.718667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cf445-fccc-4d2f-8678-9ecbb1519efd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:05.718983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cf445-fccc-4d2f-8678-9ecbb1519efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:05.720378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cf445-fccc-4d2f-8678-9ecbb1519efd None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:05.729616 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 151/301] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:25:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:05.730951 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698d797-1bda-43d1-8a5b-bbf5aa80559e None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:05.731272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698d797-1bda-43d1-8a5b-bbf5aa80559e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:05.731527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698d797-1bda-43d1-8a5b-bbf5aa80559e None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:05.733019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 152/302] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:05.735220 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698d797-1bda-43d1-8a5b-bbf5aa80559e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:05.770491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 151/303] 10.222.0.33 () {60 vars in 1134 bytes} [Wed Jun 1 17:25:05 2022] POST /identity/v3/groups => generated 229 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:25:05.770491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2e985-86db-4a31-9961-8ed6a99b6906 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:05.770491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2e985-86db-4a31-9961-8ed6a99b6906 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:05.770491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2e985-86db-4a31-9961-8ed6a99b6906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:05.796271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-4bb2e985-86db-4a31-9961-8ed6a99b6906 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:05.798483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4bb2e985-86db-4a31-9961-8ed6a99b6906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:05.862036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:05.875141 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698d797-1bda-43d1-8a5b-bbf5aa80559e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:05.885802 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 152/304] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:05.912475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2e985-86db-4a31-9961-8ed6a99b6906 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:05.931501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d95cd-30dc-4fe5-9dab-06b00646b32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:05.932837 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d95cd-30dc-4fe5-9dab-06b00646b32d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:05.933500 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d95cd-30dc-4fe5-9dab-06b00646b32d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:05.933972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d95cd-30dc-4fe5-9dab-06b00646b32d None admin] PATH_INFO: `/v3/users/c369afd3f13048d5bdced00403829068` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:05.952919 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d95cd-30dc-4fe5-9dab-06b00646b32d None admin] RBAC: Authorizing `identity:get_user(user_id=c369afd3f13048d5bdced00403829068)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:05.955917 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d95cd-30dc-4fe5-9dab-06b00646b32d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:05.958387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 153/305] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:25:05 2022] GET /identity/v3/users/c369afd3f13048d5bdced00403829068 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:05.963626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d95cd-30dc-4fe5-9dab-06b00646b32d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:06.005110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:06.045173 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2e985-86db-4a31-9961-8ed6a99b6906 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:06.090741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897c101-31c6-4342-a6b1-6a49778fe815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:06.091594 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897c101-31c6-4342-a6b1-6a49778fe815 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:06.091945 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897c101-31c6-4342-a6b1-6a49778fe815 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:06.092290 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897c101-31c6-4342-a6b1-6a49778fe815 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:06.103615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897c101-31c6-4342-a6b1-6a49778fe815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:06.106437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d95cd-30dc-4fe5-9dab-06b00646b32d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-c897c101-31c6-4342-a6b1-6a49778fe815 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:06.112856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:06.113875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:06.115000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:06.115000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:06.115000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:06.115000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:06.115000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:06.115000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:06.115000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:06.115000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:06.115000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:06.115000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:06.115000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:06.115000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:06.115000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 153/306] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:06.119966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897c101-31c6-4342-a6b1-6a49778fe815 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:06.143659 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:06.150882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac403b-b69d-43fe-af3b-d96517c7da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:06.151883 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac403b-b69d-43fe-af3b-d96517c7da28 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:06.152346 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac403b-b69d-43fe-af3b-d96517c7da28 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:06.157600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac403b-b69d-43fe-af3b-d96517c7da28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:06.157600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac403b-b69d-43fe-af3b-d96517c7da28 None admin] RBAC: Adding query filter params (role.id=98b5f1ee87964b378ac55b7e47ba10f6, user.id=c369afd3f13048d5bdced00403829068, scope.system=all) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:06.157600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac403b-b69d-43fe-af3b-d96517c7da28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:06.157600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac403b-b69d-43fe-af3b-d96517c7da28 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:06.163104 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 154/307] 10.222.0.33 () {56 vars in 1308 bytes} [Wed Jun 1 17:25:05 2022] GET /identity/v3/role_assignments?user.id=c369afd3f13048d5bdced00403829068&scope.system=all&role.id=98b5f1ee87964b378ac55b7e47ba10f6 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:06.244056 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897c101-31c6-4342-a6b1-6a49778fe815 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:06.284253 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c11c60-ad04-46df-95f2-45cca60f3889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:06.285343 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c11c60-ad04-46df-95f2-45cca60f3889 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:06.285832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c11c60-ad04-46df-95f2-45cca60f3889 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:06.286330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c11c60-ad04-46df-95f2-45cca60f3889 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:06.287291 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c11c60-ad04-46df-95f2-45cca60f3889 None admin] RBAC: Adding query filter params (name=member) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:06.287866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c11c60-ad04-46df-95f2-45cca60f3889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:06.289588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c11c60-ad04-46df-95f2-45cca60f3889 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:06.304680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 154/308] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:06.307907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac403b-b69d-43fe-af3b-d96517c7da28 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:06.386681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ee5d3-24ed-4a1c-9d8d-43177e26dd33 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:06.387013 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ee5d3-24ed-4a1c-9d8d-43177e26dd33 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:06.387238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ee5d3-24ed-4a1c-9d8d-43177e26dd33 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:06.389007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 155/309] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:25:06.395283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993244c1-7c79-4250-8be6-aa1a1f1bb2d2 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:06.395882 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993244c1-7c79-4250-8be6-aa1a1f1bb2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:06.396416 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993244c1-7c79-4250-8be6-aa1a1f1bb2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:06.414355 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-993244c1-7c79-4250-8be6-aa1a1f1bb2d2 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:06.415749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-993244c1-7c79-4250-8be6-aa1a1f1bb2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:06.418501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:06.425312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac403b-b69d-43fe-af3b-d96517c7da28 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:06.462675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8f7c6-f853-4e29-9ee3-94a3ae24b3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:06.463620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8f7c6-f853-4e29-9ee3-94a3ae24b3eb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:06.463954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8f7c6-f853-4e29-9ee3-94a3ae24b3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:06.464238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8f7c6-f853-4e29-9ee3-94a3ae24b3eb None admin] PATH_INFO: `/v3/users/176b8d894e324ce3944b417ee0b7a471` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:06.465492 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8f7c6-f853-4e29-9ee3-94a3ae24b3eb None admin] RBAC: Authorizing `identity:get_user(user_id=176b8d894e324ce3944b417ee0b7a471)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:06.466963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8f7c6-f853-4e29-9ee3-94a3ae24b3eb None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:06.468800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 155/310] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:25:06 2022] GET /identity/v3/users/176b8d894e324ce3944b417ee0b7a471 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:06.474270 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8f7c6-f853-4e29-9ee3-94a3ae24b3eb None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:06.499379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 156/311] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:25:06.522744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993244c1-7c79-4250-8be6-aa1a1f1bb2d2 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:06.535072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:06.586322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8f7c6-f853-4e29-9ee3-94a3ae24b3eb None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:06.625302 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59933a-e68a-4851-ad91-aad85b6378ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:06.626167 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59933a-e68a-4851-ad91-aad85b6378ea None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:06.626450 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59933a-e68a-4851-ad91-aad85b6378ea None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:06.627273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59933a-e68a-4851-ad91-aad85b6378ea None admin] PATH_INFO: `/v3/system/users/176b8d894e324ce3944b417ee0b7a471/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:06.628586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993244c1-7c79-4250-8be6-aa1a1f1bb2d2 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:06.628766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59933a-e68a-4851-ad91-aad85b6378ea None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=176b8d894e324ce3944b417ee0b7a471, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:06.630172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59933a-e68a-4851-ad91-aad85b6378ea None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:06.668605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6792e-234e-44c6-94b7-c0862b04af4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:06.669530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6792e-234e-44c6-94b7-c0862b04af4d None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:06.669883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6792e-234e-44c6-94b7-c0862b04af4d None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:06.670250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6792e-234e-44c6-94b7-c0862b04af4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:06.681044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6792e-234e-44c6-94b7-c0862b04af4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-e0d6792e-234e-44c6-94b7-c0862b04af4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:06.688729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:06.690190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:06.690976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:06.690976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:06.690976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:06.690976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:06.690976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:06.690976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:06.690976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:06.690976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:06.690976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:06.690976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:06.690976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:25:06.690976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:06.690976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 157/312] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:06.697346 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6792e-234e-44c6-94b7-c0862b04af4d None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:06.762409 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 156/313] 10.222.0.33 () {58 vars in 1334 bytes} [Wed Jun 1 17:25:06 2022] PUT /identity/v3/system/users/176b8d894e324ce3944b417ee0b7a471/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:25:06.787526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:06.826117 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6792e-234e-44c6-94b7-c0862b04af4d None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:06.866642 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ab980-fc51-4e10-b38c-eadba9561a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:06.867636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ab980-fc51-4e10-b38c-eadba9561a02 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:06.868130 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ab980-fc51-4e10-b38c-eadba9561a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:06.868645 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ab980-fc51-4e10-b38c-eadba9561a02 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:06.869621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ab980-fc51-4e10-b38c-eadba9561a02 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:06.870117 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ab980-fc51-4e10-b38c-eadba9561a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:06.871777 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ab980-fc51-4e10-b38c-eadba9561a02 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:06.882825 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 158/314] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:25:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:06.889083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59933a-e68a-4851-ad91-aad85b6378ea None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:06.921387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:07.006338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59933a-e68a-4851-ad91-aad85b6378ea None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:07.042568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8edfc-5fce-453f-84fd-4b127087ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:07.043371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8edfc-5fce-453f-84fd-4b127087ff74 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:07.043658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8edfc-5fce-453f-84fd-4b127087ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:07.043935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8edfc-5fce-453f-84fd-4b127087ff74 None admin] PATH_INFO: `/v3/users/d07974d9ca354abeae7565421ad82761` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:07.045162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8edfc-5fce-453f-84fd-4b127087ff74 None admin] RBAC: Authorizing `identity:get_user(user_id=d07974d9ca354abeae7565421ad82761)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:07.046623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8edfc-5fce-453f-84fd-4b127087ff74 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:07.048618 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 157/315] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:25:06 2022] GET /identity/v3/users/d07974d9ca354abeae7565421ad82761 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:07.054160 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ab980-fc51-4e10-b38c-eadba9561a02 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:07.167891 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ab980-fc51-4e10-b38c-eadba9561a02 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:07.203638 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:07.207237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5197ac8-2d86-444e-b06c-fc9026d8dc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:07.207997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5197ac8-2d86-444e-b06c-fc9026d8dc46 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:07.208375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5197ac8-2d86-444e-b06c-fc9026d8dc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:07.208747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5197ac8-2d86-444e-b06c-fc9026d8dc46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:07.279459 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5197ac8-2d86-444e-b06c-fc9026d8dc46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:07.281107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5197ac8-2d86-444e-b06c-fc9026d8dc46 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:07.388063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 159/316] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:07.393898 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8edfc-5fce-453f-84fd-4b127087ff74 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:07.505717 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:07.513004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8edfc-5fce-453f-84fd-4b127087ff74 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:07.555061 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa2666-a60a-40af-9ac9-798dda84bf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:07.555939 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa2666-a60a-40af-9ac9-798dda84bf73 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:07.556224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa2666-a60a-40af-9ac9-798dda84bf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:07.556503 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa2666-a60a-40af-9ac9-798dda84bf73 None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:07.557896 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa2666-a60a-40af-9ac9-798dda84bf73 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:07.559413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa2666-a60a-40af-9ac9-798dda84bf73 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:07.561337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 158/317] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:07 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:07.567458 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5197ac8-2d86-444e-b06c-fc9026d8dc46 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:07.599015 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:07.671228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5197ac8-2d86-444e-b06c-fc9026d8dc46 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:07.711794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393dfb2-d854-4e14-bbee-32d914cd93ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:07.712460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393dfb2-d854-4e14-bbee-32d914cd93ad None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:07.712775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393dfb2-d854-4e14-bbee-32d914cd93ad None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:07.713056 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393dfb2-d854-4e14-bbee-32d914cd93ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:07.713957 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393dfb2-d854-4e14-bbee-32d914cd93ad None admin] RBAC: Adding query filter params (role.id=98b5f1ee87964b378ac55b7e47ba10f6, scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1, user.id=d07974d9ca354abeae7565421ad82761) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:07.714272 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393dfb2-d854-4e14-bbee-32d914cd93ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:07.715726 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393dfb2-d854-4e14-bbee-32d914cd93ad None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:07.729083 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 160/318] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:25:07 2022] GET /identity/v3/role_assignments?user.id=d07974d9ca354abeae7565421ad82761&scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1&role.id=98b5f1ee87964b378ac55b7e47ba10f6 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:08.318879 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01399d-ca55-45a2-aec7-af8a1b4c2a6b None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:08.319422 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01399d-ca55-45a2-aec7-af8a1b4c2a6b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:08.319659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01399d-ca55-45a2-aec7-af8a1b4c2a6b None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:08.321235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 159/319] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:08.326189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2908b-d983-43ad-b6ac-79edbeb44ab6 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:08.326594 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2908b-d983-43ad-b6ac-79edbeb44ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:08.326754 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2908b-d983-43ad-b6ac-79edbeb44ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:08.345932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-32f2908b-d983-43ad-b6ac-79edbeb44ab6 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:08.347477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-32f2908b-d983-43ad-b6ac-79edbeb44ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:08.415380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 161/320] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:08.438040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01399d-ca55-45a2-aec7-af8a1b4c2a6b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:08.549619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d16ce-bbe7-4b3e-8b54-a620ce02e0ca None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:08.549946 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d16ce-bbe7-4b3e-8b54-a620ce02e0ca None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:08.550227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d16ce-bbe7-4b3e-8b54-a620ce02e0ca None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:08.551616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 162/321] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:25:08.554484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01399d-ca55-45a2-aec7-af8a1b4c2a6b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:08.556968 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0400b-7476-4a46-9011-e03742722b30 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:08.557085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0400b-7476-4a46-9011-e03742722b30 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:08.557334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0400b-7476-4a46-9011-e03742722b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:08.573646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-12f0400b-7476-4a46-9011-e03742722b30 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:08.574766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-12f0400b-7476-4a46-9011-e03742722b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:08.591104 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbdbab-a953-4bf3-9805-f2e4f11b2e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:08.591911 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbdbab-a953-4bf3-9805-f2e4f11b2e46 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:08.592193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbdbab-a953-4bf3-9805-f2e4f11b2e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:08.592467 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbdbab-a953-4bf3-9805-f2e4f11b2e46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:08.593609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbdbab-a953-4bf3-9805-f2e4f11b2e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:08.595059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbdbab-a953-4bf3-9805-f2e4f11b2e46 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:08.598049 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 160/322] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:08.598171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:08.603529 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbdbab-a953-4bf3-9805-f2e4f11b2e46 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:08.636852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:08.660786 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 163/323] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:25:08.676540 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0400b-7476-4a46-9011-e03742722b30 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:08.711589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbdbab-a953-4bf3-9805-f2e4f11b2e46 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:08.748836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586b590-4d1a-46f9-bdd6-8f9a3406e421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:08.750321 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586b590-4d1a-46f9-bdd6-8f9a3406e421 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:08.750610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586b590-4d1a-46f9-bdd6-8f9a3406e421 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:08.750949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586b590-4d1a-46f9-bdd6-8f9a3406e421 None admin] PATH_INFO: `/v3/groups` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:08.752342 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586b590-4d1a-46f9-bdd6-8f9a3406e421 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:08.753896 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586b590-4d1a-46f9-bdd6-8f9a3406e421 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:08.805942 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0400b-7476-4a46-9011-e03742722b30 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:08.836836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 161/324] 10.222.0.33 () {60 vars in 1134 bytes} [Wed Jun 1 17:25:08 2022] POST /identity/v3/groups => generated 226 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:25:08.860423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b5eff-1863-4826-830e-51ae3ea5067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:08.860423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b5eff-1863-4826-830e-51ae3ea5067d None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:08.860423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b5eff-1863-4826-830e-51ae3ea5067d None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:08.860423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b5eff-1863-4826-830e-51ae3ea5067d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:08.874005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b5eff-1863-4826-830e-51ae3ea5067d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-2b1b5eff-1863-4826-830e-51ae3ea5067d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:08.883234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:08.884220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:08.885075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:08.885075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:08.885075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:08.885075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:08.885075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:08.885075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:08.885075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:08.885075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:08.885075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:08.885075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:08.885075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:25:08.885075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:08.885075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 164/325] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:08.893179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586b590-4d1a-46f9-bdd6-8f9a3406e421 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:09.005451 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:09.021082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586b590-4d1a-46f9-bdd6-8f9a3406e421 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:09.071164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb26552-dc9f-4299-8db8-dbdbde37f683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:09.072290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb26552-dc9f-4299-8db8-dbdbde37f683 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:09.072290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb26552-dc9f-4299-8db8-dbdbde37f683 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:09.072290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb26552-dc9f-4299-8db8-dbdbde37f683 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:09.073114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb26552-dc9f-4299-8db8-dbdbde37f683 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:09.073426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb26552-dc9f-4299-8db8-dbdbde37f683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:09.076639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb26552-dc9f-4299-8db8-dbdbde37f683 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:09.085539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 162/326] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:25:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:09.091030 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b5eff-1863-4826-830e-51ae3ea5067d None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:09.112391 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b179bf-5462-48ef-b117-a5d365252427 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:09.114202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b179bf-5462-48ef-b117-a5d365252427 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:09.114685 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b179bf-5462-48ef-b117-a5d365252427 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:09.116403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 163/327] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:09.120067 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:09.123571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0812a8-806f-482f-8fc1-07a515989067 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:09.123868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0812a8-806f-482f-8fc1-07a515989067 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:09.124151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0812a8-806f-482f-8fc1-07a515989067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:09.146247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ef0812a8-806f-482f-8fc1-07a515989067 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:09.147469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ef0812a8-806f-482f-8fc1-07a515989067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:09.227396 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b5eff-1863-4826-830e-51ae3ea5067d None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:09.242213 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 164/328] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:25:09.265960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0812a8-806f-482f-8fc1-07a515989067 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:09.271863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8a1bf-8670-4162-b1d5-e979513180d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:09.272758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8a1bf-8670-4162-b1d5-e979513180d1 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:09.273086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8a1bf-8670-4162-b1d5-e979513180d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:09.273369 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8a1bf-8670-4162-b1d5-e979513180d1 None admin] PATH_INFO: `/v3/users/c369afd3f13048d5bdced00403829068` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:09.274853 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8a1bf-8670-4162-b1d5-e979513180d1 None admin] RBAC: Authorizing `identity:get_user(user_id=c369afd3f13048d5bdced00403829068)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:09.276821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8a1bf-8670-4162-b1d5-e979513180d1 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:09.279315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 165/329] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:25:09 2022] GET /identity/v3/users/c369afd3f13048d5bdced00403829068 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:09.284693 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8a1bf-8670-4162-b1d5-e979513180d1 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:09.378642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:09.394965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0812a8-806f-482f-8fc1-07a515989067 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:09.396334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:09.422060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8a1bf-8670-4162-b1d5-e979513180d1 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:09.442843 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a25559-aa2c-4952-9ce9-bcd6d5b46c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:09.443895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a25559-aa2c-4952-9ce9-bcd6d5b46c84 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:09.444322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a25559-aa2c-4952-9ce9-bcd6d5b46c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:09.444743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a25559-aa2c-4952-9ce9-bcd6d5b46c84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:09.460042 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a25559-aa2c-4952-9ce9-bcd6d5b46c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:09.466340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5764778-205e-49af-a956-6e778c847995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:09.467365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5764778-205e-49af-a956-6e778c847995 None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:09.467799 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5764778-205e-49af-a956-6e778c847995 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:09.468221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5764778-205e-49af-a956-6e778c847995 None admin] PATH_INFO: `/v3/system/users/c369afd3f13048d5bdced00403829068/roles/98b5f1ee87964b378ac55b7e47ba10f6` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-39a25559-aa2c-4952-9ce9-bcd6d5b46c84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:09.468998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:09.470041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:09.471794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:09.471794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:09.471794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:09.471794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:09.471794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:09.471794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:09.471794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:09.471794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:09.471794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:09.471794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:09.471794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:09.471794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:09.472569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5764778-205e-49af-a956-6e778c847995 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c369afd3f13048d5bdced00403829068, role_id=98b5f1ee87964b378ac55b7e47ba10f6)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:09.474097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5764778-205e-49af-a956-6e778c847995 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:09.474475 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 165/330] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:09.481469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a25559-aa2c-4952-9ce9-bcd6d5b46c84 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:09.559121 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 166/331] 10.222.0.33 () {58 vars in 1334 bytes} [Wed Jun 1 17:25:09 2022] PUT /identity/v3/system/users/c369afd3f13048d5bdced00403829068/roles/98b5f1ee87964b378ac55b7e47ba10f6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:25:09.606975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a25559-aa2c-4952-9ce9-bcd6d5b46c84 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:09.651492 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df26ab-bf93-4256-ace9-53225d523906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:09.652099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df26ab-bf93-4256-ace9-53225d523906 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:09.652440 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df26ab-bf93-4256-ace9-53225d523906 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:09.652716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df26ab-bf93-4256-ace9-53225d523906 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:09.653553 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df26ab-bf93-4256-ace9-53225d523906 None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:09.653866 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df26ab-bf93-4256-ace9-53225d523906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:09.655279 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df26ab-bf93-4256-ace9-53225d523906 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:09.666416 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 166/332] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:25:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:09.672072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5764778-205e-49af-a956-6e778c847995 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:09.797944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5764778-205e-49af-a956-6e778c847995 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:09.837995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1948dc-e477-47c0-a8c1-93908c615e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:09.838898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1948dc-e477-47c0-a8c1-93908c615e20 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:09.839183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1948dc-e477-47c0-a8c1-93908c615e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:09.839461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1948dc-e477-47c0-a8c1-93908c615e20 None admin] PATH_INFO: `/v3/users/176b8d894e324ce3944b417ee0b7a471` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:09.840781 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1948dc-e477-47c0-a8c1-93908c615e20 None admin] RBAC: Authorizing `identity:get_user(user_id=176b8d894e324ce3944b417ee0b7a471)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:09.842287 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1948dc-e477-47c0-a8c1-93908c615e20 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:09.844346 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 167/333] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:25:09 2022] GET /identity/v3/users/176b8d894e324ce3944b417ee0b7a471 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:09.850523 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df26ab-bf93-4256-ace9-53225d523906 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:09.860755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:09.958618 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df26ab-bf93-4256-ace9-53225d523906 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:09.994973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4852a-a605-44a1-a4fc-cfab0dab8a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:09.995643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4852a-a605-44a1-a4fc-cfab0dab8a53 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:09.995922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4852a-a605-44a1-a4fc-cfab0dab8a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:09.996199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4852a-a605-44a1-a4fc-cfab0dab8a53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:09.997060 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4852a-a605-44a1-a4fc-cfab0dab8a53 None admin] RBAC: Adding query filter params (role.id=e8531ae972c749c0a8ea8a73601c5cd1, user.id=176b8d894e324ce3944b417ee0b7a471, scope.system=all) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:09.997380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4852a-a605-44a1-a4fc-cfab0dab8a53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:09.998830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4852a-a605-44a1-a4fc-cfab0dab8a53 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:10.011657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 167/334] 10.222.0.33 () {56 vars in 1308 bytes} [Wed Jun 1 17:25:09 2022] GET /identity/v3/role_assignments?user.id=176b8d894e324ce3944b417ee0b7a471&scope.system=all&role.id=e8531ae972c749c0a8ea8a73601c5cd1 => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:11.509969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caf536-f75a-46e9-9cb7-c173be041079 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:11.510917 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caf536-f75a-46e9-9cb7-c173be041079 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:11.511422 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caf536-f75a-46e9-9cb7-c173be041079 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:11.513235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 168/335] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:11.530941 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dffdd0-0b39-44dc-b8f5-a4fae44ad58a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:11.531867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dffdd0-0b39-44dc-b8f5-a4fae44ad58a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:11.532342 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dffdd0-0b39-44dc-b8f5-a4fae44ad58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:11.558217 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e2dffdd0-0b39-44dc-b8f5-a4fae44ad58a None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:11.559769 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e2dffdd0-0b39-44dc-b8f5-a4fae44ad58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:11.636636 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:11.646807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 168/336] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:25:11.690972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caf536-f75a-46e9-9cb7-c173be041079 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:11.721566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:11.818063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caf536-f75a-46e9-9cb7-c173be041079 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:11.865993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a2e23-a182-4798-b59e-45ffa456f6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:11.866813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a2e23-a182-4798-b59e-45ffa456f6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:11.867101 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a2e23-a182-4798-b59e-45ffa456f6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:11.867383 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a2e23-a182-4798-b59e-45ffa456f6a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:11.885441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a2e23-a182-4798-b59e-45ffa456f6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-2a4a2e23-a182-4798-b59e-45ffa456f6a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:11.894045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:11.894974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:11.895760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:11.895760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:11.895760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:11.895760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:11.895760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:11.895760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:11.895760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:11.895760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:11.895760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:11.895760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:11.895760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:11.895760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:11.895760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 169/337] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:11.901396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dffdd0-0b39-44dc-b8f5-a4fae44ad58a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:12.025301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dffdd0-0b39-44dc-b8f5-a4fae44ad58a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:12.069558 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca119324-f3ee-482b-a0c2-0b493d1ee5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:12.070164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca119324-f3ee-482b-a0c2-0b493d1ee5db None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:12.070449 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca119324-f3ee-482b-a0c2-0b493d1ee5db None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:12.070727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca119324-f3ee-482b-a0c2-0b493d1ee5db None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:12.071491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca119324-f3ee-482b-a0c2-0b493d1ee5db None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:12.071799 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca119324-f3ee-482b-a0c2-0b493d1ee5db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:12.073219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca119324-f3ee-482b-a0c2-0b493d1ee5db None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:12.085246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 169/338] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:25:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:12.090435 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a2e23-a182-4798-b59e-45ffa456f6a1 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:12.214978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:12.238853 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a2e23-a182-4798-b59e-45ffa456f6a1 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:12.274345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bec002-8bfe-4c6f-bc86-45ebdc5278c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:12.275006 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bec002-8bfe-4c6f-bc86-45ebdc5278c5 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:12.275288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bec002-8bfe-4c6f-bc86-45ebdc5278c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:12.275567 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bec002-8bfe-4c6f-bc86-45ebdc5278c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:12.358711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bec002-8bfe-4c6f-bc86-45ebdc5278c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:12.360100 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bec002-8bfe-4c6f-bc86-45ebdc5278c5 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:12.360514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd592f-5715-43dd-9143-6e42a1f1ef27 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:12.361609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd592f-5715-43dd-9143-6e42a1f1ef27 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:12.362093 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd592f-5715-43dd-9143-6e42a1f1ef27 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:12.363703 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 170/339] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:12.369377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1abb-d5a4-4bbe-a9e1-6d08e859a379 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:12.369913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1abb-d5a4-4bbe-a9e1-6d08e859a379 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:12.370390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1abb-d5a4-4bbe-a9e1-6d08e859a379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:12.393752 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-872b1abb-d5a4-4bbe-a9e1-6d08e859a379 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:12.397870 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-872b1abb-d5a4-4bbe-a9e1-6d08e859a379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:12.476028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:12.495209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 171/340] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:25:12.516064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:12.525585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b1abb-d5a4-4bbe-a9e1-6d08e859a379 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:12.562400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 170/341] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:12.568508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bec002-8bfe-4c6f-bc86-45ebdc5278c5 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:12.712565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b1abb-d5a4-4bbe-a9e1-6d08e859a379 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:12.759802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e328b8-0c97-4141-8ce3-79ebd2912173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:12.760662 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e328b8-0c97-4141-8ce3-79ebd2912173 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:12.760968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e328b8-0c97-4141-8ce3-79ebd2912173 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:12.761262 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e328b8-0c97-4141-8ce3-79ebd2912173 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:12.777001 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e328b8-0c97-4141-8ce3-79ebd2912173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-e7e328b8-0c97-4141-8ce3-79ebd2912173 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:12.789124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:12.790078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:12.790863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:12.790863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:12.790863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:12.790863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:12.790863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:12.790863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:12.790863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:12.790863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:12.790863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:12.790863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:12.790863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:25:12.790863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:12.793964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 172/342] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:25:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:12.796767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e328b8-0c97-4141-8ce3-79ebd2912173 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:12.802933 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bec002-8bfe-4c6f-bc86-45ebdc5278c5 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:12.870331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:12.873407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54cf2d-472b-4bc0-97cd-3da2083a1dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:12.874290 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54cf2d-472b-4bc0-97cd-3da2083a1dbb None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:12.874574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54cf2d-472b-4bc0-97cd-3da2083a1dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:12.874850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54cf2d-472b-4bc0-97cd-3da2083a1dbb None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:12.878141 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54cf2d-472b-4bc0-97cd-3da2083a1dbb None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:12.882837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54cf2d-472b-4bc0-97cd-3da2083a1dbb None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:12.882837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 171/343] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:12 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:12.886733 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54cf2d-472b-4bc0-97cd-3da2083a1dbb None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:12.948529 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e328b8-0c97-4141-8ce3-79ebd2912173 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:12.993756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:13.006516 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a22b92-4228-4db6-99c8-e91e5387b080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:13.008031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a22b92-4228-4db6-99c8-e91e5387b080 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:13.008684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a22b92-4228-4db6-99c8-e91e5387b080 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:13.009091 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a22b92-4228-4db6-99c8-e91e5387b080 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:13.010237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a22b92-4228-4db6-99c8-e91e5387b080 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:13.010869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a22b92-4228-4db6-99c8-e91e5387b080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:13.012679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a22b92-4228-4db6-99c8-e91e5387b080 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:13.028999 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 173/344] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:13.031032 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d88bc-a3cd-483a-b3c8-afcf9977b16e None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:13.031523 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d88bc-a3cd-483a-b3c8-afcf9977b16e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:13.031983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d88bc-a3cd-483a-b3c8-afcf9977b16e None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:13.034778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 174/345] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:13.036112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d88bc-a3cd-483a-b3c8-afcf9977b16e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:13.100871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54cf2d-472b-4bc0-97cd-3da2083a1dbb None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:13.152305 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d88bc-a3cd-483a-b3c8-afcf9977b16e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:13.160733 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97429fd4-2696-4522-9590-5eea11f6908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:13.161299 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97429fd4-2696-4522-9590-5eea11f6908b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:13.161586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97429fd4-2696-4522-9590-5eea11f6908b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:13.161864 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97429fd4-2696-4522-9590-5eea11f6908b None admin] PATH_INFO: `/v3/groups/833882f81a134c7bab260508b5ef374d` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:13.169841 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:13.172434 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97429fd4-2696-4522-9590-5eea11f6908b None admin] RBAC: Authorizing `identity:get_group(group_id=833882f81a134c7bab260508b5ef374d)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:13.174484 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97429fd4-2696-4522-9590-5eea11f6908b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:13.176594 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 172/346] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jun 1 17:25:12 2022] GET /identity/v3/groups/833882f81a134c7bab260508b5ef374d => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:13.177881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c52478-773a-44d3-972d-d346f40cffc5 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:13.178159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c52478-773a-44d3-972d-d346f40cffc5 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:13.178435 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c52478-773a-44d3-972d-d346f40cffc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:13.192303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065cb2c-984a-428a-bca0-e778cd08fc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:13.193280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065cb2c-984a-428a-bca0-e778cd08fc2d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:13.193766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065cb2c-984a-428a-bca0-e778cd08fc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:13.194222 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065cb2c-984a-428a-bca0-e778cd08fc2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:13.206154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-60c52478-773a-44d3-972d-d346f40cffc5 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:13.207484 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-60c52478-773a-44d3-972d-d346f40cffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:13.270863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065cb2c-984a-428a-bca0-e778cd08fc2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:13.272686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065cb2c-984a-428a-bca0-e778cd08fc2d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:13.330664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 173/347] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:13.331638 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c52478-773a-44d3-972d-d346f40cffc5 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:13.397695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 175/348] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:13.403753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065cb2c-984a-428a-bca0-e778cd08fc2d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:13.416917 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:13.424283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:13.514993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c52478-773a-44d3-972d-d346f40cffc5 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:13.539914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065cb2c-984a-428a-bca0-e778cd08fc2d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:13.561791 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084849f-3f43-43ae-a90a-6bdd283894ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:13.562623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084849f-3f43-43ae-a90a-6bdd283894ff None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:13.563012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084849f-3f43-43ae-a90a-6bdd283894ff None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:13.563397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084849f-3f43-43ae-a90a-6bdd283894ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:13.564978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084849f-3f43-43ae-a90a-6bdd283894ff None admin] RBAC: Adding query filter params (group.id=833882f81a134c7bab260508b5ef374d, role.id=e8531ae972c749c0a8ea8a73601c5cd1, scope.project.id=0bc23eb82d084bf399415f38e4538aab) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:13.565398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084849f-3f43-43ae-a90a-6bdd283894ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:13.567493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084849f-3f43-43ae-a90a-6bdd283894ff None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:13.576789 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 174/349] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jun 1 17:25:13 2022] GET /identity/v3/role_assignments?group.id=833882f81a134c7bab260508b5ef374d&scope.project.id=0bc23eb82d084bf399415f38e4538aab&role.id=e8531ae972c749c0a8ea8a73601c5cd1 => generated 260 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:13.577478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084849f-3f43-43ae-a90a-6bdd283894ff None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:13.581964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227ac90-05a4-4a15-9954-e0d8165a1823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:13.583067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227ac90-05a4-4a15-9954-e0d8165a1823 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:13.583502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227ac90-05a4-4a15-9954-e0d8165a1823 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:13.583917 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227ac90-05a4-4a15-9954-e0d8165a1823 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:13.597100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227ac90-05a4-4a15-9954-e0d8165a1823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-2227ac90-05a4-4a15-9954-e0d8165a1823 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:13.605560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:13.606544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:13.607374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:13.607374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:13.607374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:13.607374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:13.607374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:13.607374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:13.607374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:13.607374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:13.607374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:13.607374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:13.607374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 01 17:25:13.607374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:13.609916 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 176/350] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:13.611530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93dcfd-a37f-4548-acd5-06e09269b3e8 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:13.612158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93dcfd-a37f-4548-acd5-06e09269b3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:13.612653 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93dcfd-a37f-4548-acd5-06e09269b3e8 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:13.614550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 177/351] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:13.616421 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93dcfd-a37f-4548-acd5-06e09269b3e8 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:13.697422 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:13.720812 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084849f-3f43-43ae-a90a-6bdd283894ff None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:13.723109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:13.746866 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93dcfd-a37f-4548-acd5-06e09269b3e8 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:13.795499 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f37f3-5ebb-4ae8-a786-361cb04f0eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:13.796333 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f37f3-5ebb-4ae8-a786-361cb04f0eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:13.796692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f37f3-5ebb-4ae8-a786-361cb04f0eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:13.797076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f37f3-5ebb-4ae8-a786-361cb04f0eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:13.797933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f37f3-5ebb-4ae8-a786-361cb04f0eb5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:13.798873 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f37f3-5ebb-4ae8-a786-361cb04f0eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:13.800408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f37f3-5ebb-4ae8-a786-361cb04f0eb5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:13.801987 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b881d-76e7-4036-994b-569b0b243b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:13.803427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b881d-76e7-4036-994b-569b0b243b1c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:13.803923 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b881d-76e7-4036-994b-569b0b243b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:13.804394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b881d-76e7-4036-994b-569b0b243b1c None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:13.805975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b881d-76e7-4036-994b-569b0b243b1c None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:13.812963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b881d-76e7-4036-994b-569b0b243b1c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:13.813179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 178/352] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:25:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:13.813179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c3f21-d97a-4751-922d-42481b3b1171 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:13.813179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c3f21-d97a-4751-922d-42481b3b1171 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:13.813179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c3f21-d97a-4751-922d-42481b3b1171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:13.816729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 175/353] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:13 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:13.817903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b881d-76e7-4036-994b-569b0b243b1c None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:13.862960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7c9c3f21-d97a-4751-922d-42481b3b1171 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:13.864202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7c9c3f21-d97a-4751-922d-42481b3b1171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:13.952473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b881d-76e7-4036-994b-569b0b243b1c None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:13.996750 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29594396-26b9-4087-bf6f-a612a8a69400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:13.997860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29594396-26b9-4087-bf6f-a612a8a69400 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:13.998148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29594396-26b9-4087-bf6f-a612a8a69400 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:13.998425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29594396-26b9-4087-bf6f-a612a8a69400 None admin] PATH_INFO: `/v3/users/c369afd3f13048d5bdced00403829068` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:14.000235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29594396-26b9-4087-bf6f-a612a8a69400 None admin] RBAC: Authorizing `identity:get_user(user_id=c369afd3f13048d5bdced00403829068)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:14.001839 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29594396-26b9-4087-bf6f-a612a8a69400 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:14.003970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 176/354] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:25:13 2022] GET /identity/v3/users/c369afd3f13048d5bdced00403829068 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:14.004534 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 179/355] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:14.006928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29594396-26b9-4087-bf6f-a612a8a69400 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:14.010791 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c3f21-d97a-4751-922d-42481b3b1171 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:14.060805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:14.080159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:14.136240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c3f21-d97a-4751-922d-42481b3b1171 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:14.174489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c09c2-d301-49b9-ab11-5b5a7517d76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:14.175160 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c09c2-d301-49b9-ab11-5b5a7517d76f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:14.175451 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c09c2-d301-49b9-ab11-5b5a7517d76f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:14.175731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c09c2-d301-49b9-ab11-5b5a7517d76f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:14.176648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c09c2-d301-49b9-ab11-5b5a7517d76f None admin] RBAC: Adding query filter params (role.id=98b5f1ee87964b378ac55b7e47ba10f6, user.id=c369afd3f13048d5bdced00403829068, scope.system=all) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:14.177060 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c09c2-d301-49b9-ab11-5b5a7517d76f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:14.178449 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c09c2-d301-49b9-ab11-5b5a7517d76f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:14.183156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29594396-26b9-4087-bf6f-a612a8a69400 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:14.191372 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 180/356] 10.222.0.33 () {56 vars in 1308 bytes} [Wed Jun 1 17:25:14 2022] GET /identity/v3/role_assignments?user.id=c369afd3f13048d5bdced00403829068&scope.system=all&role.id=98b5f1ee87964b378ac55b7e47ba10f6 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:14.192235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c09c2-d301-49b9-ab11-5b5a7517d76f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:14.281750 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3950d-59f3-4000-a314-402cbff8ea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:14.283185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3950d-59f3-4000-a314-402cbff8ea05 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:14.284175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3950d-59f3-4000-a314-402cbff8ea05 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:14.284462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3950d-59f3-4000-a314-402cbff8ea05 None admin] PATH_INFO: `/v3/groups/833882f81a134c7bab260508b5ef374d` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:14.289814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3950d-59f3-4000-a314-402cbff8ea05 None admin] RBAC: Authorizing `identity:get_group(group_id=833882f81a134c7bab260508b5ef374d)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:14.291319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3950d-59f3-4000-a314-402cbff8ea05 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:14.293086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 177/357] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jun 1 17:25:14 2022] GET /identity/v3/groups/833882f81a134c7bab260508b5ef374d => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:14.294344 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23115d5-3801-4b6c-9531-6db82de720d3 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:14.294633 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23115d5-3801-4b6c-9531-6db82de720d3 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:14.294912 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23115d5-3801-4b6c-9531-6db82de720d3 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:14.296471 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 178/358] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:14.303326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae9c67-2d23-4474-8425-bb72a2092baa None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:14.303686 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae9c67-2d23-4474-8425-bb72a2092baa None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:14.303972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae9c67-2d23-4474-8425-bb72a2092baa None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:14.305781 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 179/359] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:14.306745 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae9c67-2d23-4474-8425-bb72a2092baa None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:14.314164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c09c2-d301-49b9-ab11-5b5a7517d76f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:14.334134 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:14.357229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5a5dd-5162-4b03-be1f-27a73d964d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:14.358200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5a5dd-5162-4b03-be1f-27a73d964d92 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:14.358563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5a5dd-5162-4b03-be1f-27a73d964d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:14.359497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5a5dd-5162-4b03-be1f-27a73d964d92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:14.372437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5a5dd-5162-4b03-be1f-27a73d964d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-dcd5a5dd-5162-4b03-be1f-27a73d964d92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:14.382214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:14.383211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:14.384022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:14.384022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:14.384022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:14.384022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:14.384022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:14.384022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:14.384022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:14.384022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:14.384022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:14.384022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:14.384022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:14.384022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:14.384022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 181/360] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:14.385335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bd517-175f-43ec-82d8-6e8eb3497160 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:14.385738 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bd517-175f-43ec-82d8-6e8eb3497160 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:14.386180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bd517-175f-43ec-82d8-6e8eb3497160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:14.415734 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c81bd517-175f-43ec-82d8-6e8eb3497160 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:14.417171 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c81bd517-175f-43ec-82d8-6e8eb3497160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:14.489707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae9c67-2d23-4474-8425-bb72a2092baa None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:14.499282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:14.515198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 182/361] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:14.516831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f1c59-10e8-4b27-9c19-2181b90cbd2c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:14.517876 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f1c59-10e8-4b27-9c19-2181b90cbd2c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:14.518636 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f1c59-10e8-4b27-9c19-2181b90cbd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:14.544181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-4f3f1c59-10e8-4b27-9c19-2181b90cbd2c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:14.546073 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4f3f1c59-10e8-4b27-9c19-2181b90cbd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:14.548644 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef8da5-027d-49a3-a258-070f0872dc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:14.549930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef8da5-027d-49a3-a258-070f0872dc3a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:14.549930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef8da5-027d-49a3-a258-070f0872dc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:14.550095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef8da5-027d-49a3-a258-070f0872dc3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:14.550926 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef8da5-027d-49a3-a258-070f0872dc3a None admin] RBAC: Adding query filter params (group.id=833882f81a134c7bab260508b5ef374d, role.id=58b5b157099e42bcb4ee3eff9aaf2064, scope.project.id=0bc23eb82d084bf399415f38e4538aab) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:14.551242 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef8da5-027d-49a3-a258-070f0872dc3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:14.552969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef8da5-027d-49a3-a258-070f0872dc3a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:14.565908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 180/362] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jun 1 17:25:14 2022] GET /identity/v3/role_assignments?group.id=833882f81a134c7bab260508b5ef374d&scope.project.id=0bc23eb82d084bf399415f38e4538aab&role.id=58b5b157099e42bcb4ee3eff9aaf2064 => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:14.567636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef8da5-027d-49a3-a258-070f0872dc3a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:14.651154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 183/363] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:14.652045 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f1c59-10e8-4b27-9c19-2181b90cbd2c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:14.709656 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef8da5-027d-49a3-a258-070f0872dc3a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:14.724870 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:14.753049 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2329a-ad7e-4f3a-9b6e-0b76cf6a0252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:14.754104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2329a-ad7e-4f3a-9b6e-0b76cf6a0252 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:14.754612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2329a-ad7e-4f3a-9b6e-0b76cf6a0252 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:14.755084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2329a-ad7e-4f3a-9b6e-0b76cf6a0252 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:14.756075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2329a-ad7e-4f3a-9b6e-0b76cf6a0252 None admin] RBAC: Adding query filter params (name=member) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:14.756665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2329a-ad7e-4f3a-9b6e-0b76cf6a0252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:14.758341 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2329a-ad7e-4f3a-9b6e-0b76cf6a0252 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:14.770235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 181/364] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:25:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:14.771418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2329a-ad7e-4f3a-9b6e-0b76cf6a0252 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:14.799168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f1c59-10e8-4b27-9c19-2181b90cbd2c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:14.811079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:14.837411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14822172-69da-4dc9-b455-6e77055ad5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:14.838139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14822172-69da-4dc9-b455-6e77055ad5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:14.838465 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14822172-69da-4dc9-b455-6e77055ad5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:14.838744 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14822172-69da-4dc9-b455-6e77055ad5d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:14.850661 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14822172-69da-4dc9-b455-6e77055ad5d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-14822172-69da-4dc9-b455-6e77055ad5d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:14.859320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:14.860225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:14.861847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:14.861847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:14.861847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:14.861847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:14.861847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:14.861847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:14.861847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:14.861847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:14.861847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:14.861847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:14.861847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:25:14.861847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:14.861847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 184/365] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:25:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:14.862523 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14822172-69da-4dc9-b455-6e77055ad5d5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:14.898068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2329a-ad7e-4f3a-9b6e-0b76cf6a0252 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:14.935441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786681b2-35eb-4820-9528-28e6f6af3bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:14.936628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786681b2-35eb-4820-9528-28e6f6af3bdf None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:14.937151 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786681b2-35eb-4820-9528-28e6f6af3bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:14.937627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786681b2-35eb-4820-9528-28e6f6af3bdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:14.949819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786681b2-35eb-4820-9528-28e6f6af3bdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-786681b2-35eb-4820-9528-28e6f6af3bdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:14.958477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:14.959382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:14.960201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:14.960201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:14.960201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:14.960201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:14.960201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:14.960201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:14.960201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:14.960201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:14.960201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:14.960201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:14.960201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:25:14.960201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:14.962897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 182/366] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:25:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:14.964036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786681b2-35eb-4820-9528-28e6f6af3bdf None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:14.980415 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:14.984805 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14822172-69da-4dc9-b455-6e77055ad5d5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:15.024033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bd8ed-e53b-448a-8008-b7825cb3b061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:15.024655 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bd8ed-e53b-448a-8008-b7825cb3b061 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:15.024950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bd8ed-e53b-448a-8008-b7825cb3b061 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:15.025235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bd8ed-e53b-448a-8008-b7825cb3b061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:15.072527 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:15.083017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786681b2-35eb-4820-9528-28e6f6af3bdf None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:15.100647 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bd8ed-e53b-448a-8008-b7825cb3b061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:15.102074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bd8ed-e53b-448a-8008-b7825cb3b061 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:15.120484 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42ad6e-9896-4ae2-936b-2ab3788cf36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:15.121518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42ad6e-9896-4ae2-936b-2ab3788cf36c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:15.122028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42ad6e-9896-4ae2-936b-2ab3788cf36c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:15.122527 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42ad6e-9896-4ae2-936b-2ab3788cf36c None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:15.123470 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42ad6e-9896-4ae2-936b-2ab3788cf36c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:15.123974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42ad6e-9896-4ae2-936b-2ab3788cf36c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:15.125572 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42ad6e-9896-4ae2-936b-2ab3788cf36c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:15.135219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 183/367] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:15.136334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42ad6e-9896-4ae2-936b-2ab3788cf36c None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:15.211660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:15.215004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 185/368] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:15.215698 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bd8ed-e53b-448a-8008-b7825cb3b061 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:15.252708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42ad6e-9896-4ae2-936b-2ab3788cf36c None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:15.290306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d6806-c320-48fb-bce2-a6e25d6a3f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:15.291335 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d6806-c320-48fb-bce2-a6e25d6a3f5c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:15.291817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d6806-c320-48fb-bce2-a6e25d6a3f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:15.292296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d6806-c320-48fb-bce2-a6e25d6a3f5c None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:15.293265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d6806-c320-48fb-bce2-a6e25d6a3f5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:15.293794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d6806-c320-48fb-bce2-a6e25d6a3f5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:15.296422 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d6806-c320-48fb-bce2-a6e25d6a3f5c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:15.306597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 184/369] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:15.307707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d6806-c320-48fb-bce2-a6e25d6a3f5c None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:15.327709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bd8ed-e53b-448a-8008-b7825cb3b061 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:15.333918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:15.365957 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f90e3-1756-4856-92a7-8e44b7d4a7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:15.366587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f90e3-1756-4856-92a7-8e44b7d4a7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:15.366869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f90e3-1756-4856-92a7-8e44b7d4a7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:15.367180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f90e3-1756-4856-92a7-8e44b7d4a7f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:15.428661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d6806-c320-48fb-bce2-a6e25d6a3f5c None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:15.441423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:15.445919 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f90e3-1756-4856-92a7-8e44b7d4a7f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:15.447583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f90e3-1756-4856-92a7-8e44b7d4a7f9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:15.468607 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0911eab-5b0b-487a-b850-23734d6d4b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:15.469881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0911eab-5b0b-487a-b850-23734d6d4b34 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:15.471567 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0911eab-5b0b-487a-b850-23734d6d4b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:15.472049 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0911eab-5b0b-487a-b850-23734d6d4b34 None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:15.474574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0911eab-5b0b-487a-b850-23734d6d4b34 None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:15.476255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0911eab-5b0b-487a-b850-23734d6d4b34 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:15.478228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 185/370] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:15 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:15.479495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0911eab-5b0b-487a-b850-23734d6d4b34 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:15.566799 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 186/371] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:15.567647 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f90e3-1756-4856-92a7-8e44b7d4a7f9 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:15.574115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:15.592802 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0911eab-5b0b-487a-b850-23734d6d4b34 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:15.630613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8397a-5dfe-4171-9868-16c2de716610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:15.631595 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8397a-5dfe-4171-9868-16c2de716610 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:15.632077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8397a-5dfe-4171-9868-16c2de716610 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:15.632551 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8397a-5dfe-4171-9868-16c2de716610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:15.679568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:15.682675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f90e3-1756-4856-92a7-8e44b7d4a7f9 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:15.712826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8397a-5dfe-4171-9868-16c2de716610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:15.714631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8397a-5dfe-4171-9868-16c2de716610 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:15.722245 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8de0b7-3f46-47be-b717-34e5f125bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:15.723111 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8de0b7-3f46-47be-b717-34e5f125bc68 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:15.723390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8de0b7-3f46-47be-b717-34e5f125bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:15.723663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8de0b7-3f46-47be-b717-34e5f125bc68 None admin] PATH_INFO: `/v3/groups/833882f81a134c7bab260508b5ef374d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:15.724849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8de0b7-3f46-47be-b717-34e5f125bc68 None admin] RBAC: Authorizing `identity:get_group(group_id=833882f81a134c7bab260508b5ef374d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:15.726337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8de0b7-3f46-47be-b717-34e5f125bc68 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:15.728183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 187/372] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jun 1 17:25:15 2022] GET /identity/v3/groups/833882f81a134c7bab260508b5ef374d => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:15.729085 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8de0b7-3f46-47be-b717-34e5f125bc68 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:15.829346 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:15.837811 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 186/373] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:15.839252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8397a-5dfe-4171-9868-16c2de716610 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:15.851861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8de0b7-3f46-47be-b717-34e5f125bc68 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:15.888797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ca72f-e50e-490d-a429-86b3cf58343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:15.889631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ca72f-e50e-490d-a429-86b3cf58343e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:15.889912 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ca72f-e50e-490d-a429-86b3cf58343e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:15.890188 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ca72f-e50e-490d-a429-86b3cf58343e None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:15.892823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ca72f-e50e-490d-a429-86b3cf58343e None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:15.894275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ca72f-e50e-490d-a429-86b3cf58343e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:15.896186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 188/374] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:15 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:15.896777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ca72f-e50e-490d-a429-86b3cf58343e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:15.939881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:15.969057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8397a-5dfe-4171-9868-16c2de716610 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:16.010246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e720c-bbbb-4098-8da9-1f9cab7cbe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:16.011298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e720c-bbbb-4098-8da9-1f9cab7cbe0c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:16.011829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e720c-bbbb-4098-8da9-1f9cab7cbe0c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:16.011933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ca72f-e50e-490d-a429-86b3cf58343e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:16.012397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e720c-bbbb-4098-8da9-1f9cab7cbe0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:16.013600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e720c-bbbb-4098-8da9-1f9cab7cbe0c None admin] RBAC: Adding query filter params (group.id=833882f81a134c7bab260508b5ef374d, role.id=e8531ae972c749c0a8ea8a73601c5cd1, scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:16.014205 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e720c-bbbb-4098-8da9-1f9cab7cbe0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:16.015849 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e720c-bbbb-4098-8da9-1f9cab7cbe0c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:16.024059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 187/375] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jun 1 17:25:15 2022] GET /identity/v3/role_assignments?group.id=833882f81a134c7bab260508b5ef374d&scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1&role.id=e8531ae972c749c0a8ea8a73601c5cd1 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:16.025223 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e720c-bbbb-4098-8da9-1f9cab7cbe0c None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:16.071214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6af05-5fc7-4be3-9ade-9ee767c91fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:16.074515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6af05-5fc7-4be3-9ade-9ee767c91fae None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:16.076109 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6af05-5fc7-4be3-9ade-9ee767c91fae None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:16.077820 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6af05-5fc7-4be3-9ade-9ee767c91fae None admin] PATH_INFO: `/v3/projects/5ab5b23ebc224a5b9dd9616b70ea67bd` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:16.081851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6af05-5fc7-4be3-9ade-9ee767c91fae None admin] RBAC: Authorizing `identity:get_project(project_id=5ab5b23ebc224a5b9dd9616b70ea67bd)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:16.085257 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6af05-5fc7-4be3-9ade-9ee767c91fae None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:16.088573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 189/376] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:15 2022] GET /identity/v3/projects/5ab5b23ebc224a5b9dd9616b70ea67bd => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:16.096682 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6af05-5fc7-4be3-9ade-9ee767c91fae None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:16.133333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:16.244403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e720c-bbbb-4098-8da9-1f9cab7cbe0c None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:16.290778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6af05-5fc7-4be3-9ade-9ee767c91fae None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:16.295300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:16.319020 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f94551-7faf-487f-9246-89a2f3fb58e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:16.320225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f94551-7faf-487f-9246-89a2f3fb58e5 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:16.321277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f94551-7faf-487f-9246-89a2f3fb58e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:16.321277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f94551-7faf-487f-9246-89a2f3fb58e5 None admin] PATH_INFO: `/v3/groups/833882f81a134c7bab260508b5ef374d` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:16.322649 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f94551-7faf-487f-9246-89a2f3fb58e5 None admin] RBAC: Authorizing `identity:get_group(group_id=833882f81a134c7bab260508b5ef374d)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:16.324326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f94551-7faf-487f-9246-89a2f3fb58e5 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:16.326285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 188/377] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jun 1 17:25:16 2022] GET /identity/v3/groups/833882f81a134c7bab260508b5ef374d => generated 226 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:16.334232 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f94551-7faf-487f-9246-89a2f3fb58e5 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:16.348023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd38095-22af-4414-bf9e-8189249c019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:16.348023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd38095-22af-4414-bf9e-8189249c019e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:16.348023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd38095-22af-4414-bf9e-8189249c019e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:16.348023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd38095-22af-4414-bf9e-8189249c019e None admin] PATH_INFO: `/v3/groups/498839e88e434983bab97ada0561bb96` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:16.354535 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd38095-22af-4414-bf9e-8189249c019e None admin] RBAC: Authorizing `identity:get_group(group_id=498839e88e434983bab97ada0561bb96)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:16.355997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd38095-22af-4414-bf9e-8189249c019e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:16.358026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 190/378] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jun 1 17:25:16 2022] GET /identity/v3/groups/498839e88e434983bab97ada0561bb96 => generated 229 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:16.364146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd38095-22af-4414-bf9e-8189249c019e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:16.469340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f94551-7faf-487f-9246-89a2f3fb58e5 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:16.492113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:16.496490 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd38095-22af-4414-bf9e-8189249c019e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:16.511732 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb335d-bb23-4db3-ae29-e649cf96ff27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:16.512403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb335d-bb23-4db3-ae29-e649cf96ff27 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:16.512690 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb335d-bb23-4db3-ae29-e649cf96ff27 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:16.513006 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb335d-bb23-4db3-ae29-e649cf96ff27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:16.513850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb335d-bb23-4db3-ae29-e649cf96ff27 None admin] RBAC: Adding query filter params (group.id=833882f81a134c7bab260508b5ef374d, role.id=58b5b157099e42bcb4ee3eff9aaf2064, scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:16.514167 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb335d-bb23-4db3-ae29-e649cf96ff27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:16.515620 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb335d-bb23-4db3-ae29-e649cf96ff27 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:16.522791 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 189/379] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jun 1 17:25:16 2022] GET /identity/v3/role_assignments?group.id=833882f81a134c7bab260508b5ef374d&scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1&role.id=58b5b157099e42bcb4ee3eff9aaf2064 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:16.524242 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cbb1a-c494-44d4-abf3-86a096b928eb None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:16.524545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cbb1a-c494-44d4-abf3-86a096b928eb None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:16.525192 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cbb1a-c494-44d4-abf3-86a096b928eb None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:16.526539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 190/380] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:16.534712 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfc106-f6de-4389-badc-e67e4988f260 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:16.537695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfc106-f6de-4389-badc-e67e4988f260 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:16.539651 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfc106-f6de-4389-badc-e67e4988f260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:16.565980 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfad16-4aea-437a-aca1-faad775cf1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:16.566918 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfad16-4aea-437a-aca1-faad775cf1ac None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:16.567343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfad16-4aea-437a-aca1-faad775cf1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:16.567761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfad16-4aea-437a-aca1-faad775cf1ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:16.568787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfad16-4aea-437a-aca1-faad775cf1ac None admin] RBAC: Adding query filter params (group.id=498839e88e434983bab97ada0561bb96, role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=5ab5b23ebc224a5b9dd9616b70ea67bd) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:16.569277 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfad16-4aea-437a-aca1-faad775cf1ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:16.570902 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfad16-4aea-437a-aca1-faad775cf1ac None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:16.579852 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-f1bfc106-f6de-4389-badc-e67e4988f260 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:16.582627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f1bfc106-f6de-4389-badc-e67e4988f260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:16.584007 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 191/381] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jun 1 17:25:16 2022] GET /identity/v3/role_assignments?group.id=498839e88e434983bab97ada0561bb96&scope.project.id=5ab5b23ebc224a5b9dd9616b70ea67bd&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:16.710763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 191/382] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:16.750407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfad16-4aea-437a-aca1-faad775cf1ac None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:16.805482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:16.895891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfad16-4aea-437a-aca1-faad775cf1ac None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:16.934578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bd8dd-97b2-482e-b84b-8db792107c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:16.935387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bd8dd-97b2-482e-b84b-8db792107c93 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:16.935673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bd8dd-97b2-482e-b84b-8db792107c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:16.935953 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bd8dd-97b2-482e-b84b-8db792107c93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:16.948411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291bd8dd-97b2-482e-b84b-8db792107c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-291bd8dd-97b2-482e-b84b-8db792107c93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:16.956578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:16.957627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:16.958402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:16.958402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:16.958402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:16.958402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:16.958402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:16.958402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:16.958402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:16.958402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:16.958402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:16.958402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:16.958402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:16.958402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:16.958402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 192/383] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:16.963933 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfc106-f6de-4389-badc-e67e4988f260 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:17.090939 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfc106-f6de-4389-badc-e67e4988f260 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:17.103077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:17.130319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb099943-e0e5-40f3-a885-1ed320e9dea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:17.131006 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb099943-e0e5-40f3-a885-1ed320e9dea9 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:17.131292 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb099943-e0e5-40f3-a885-1ed320e9dea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:17.131572 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb099943-e0e5-40f3-a885-1ed320e9dea9 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:17.132320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb099943-e0e5-40f3-a885-1ed320e9dea9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:17.132628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb099943-e0e5-40f3-a885-1ed320e9dea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:17.134061 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb099943-e0e5-40f3-a885-1ed320e9dea9 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:17.146059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 192/384] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:25:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:17.148831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bd8dd-97b2-482e-b84b-8db792107c93 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:17.258833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:17.269304 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bd8dd-97b2-482e-b84b-8db792107c93 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:17.312781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203b810-df53-4ce5-b342-d88b5480ca5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:17.314199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203b810-df53-4ce5-b342-d88b5480ca5d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:17.314537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203b810-df53-4ce5-b342-d88b5480ca5d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:17.314832 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203b810-df53-4ce5-b342-d88b5480ca5d None admin] PATH_INFO: `/v3/groups/833882f81a134c7bab260508b5ef374d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:17.321719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203b810-df53-4ce5-b342-d88b5480ca5d None admin] RBAC: Authorizing `identity:get_group(group_id=833882f81a134c7bab260508b5ef374d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:17.323214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203b810-df53-4ce5-b342-d88b5480ca5d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:17.325097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 193/385] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jun 1 17:25:17 2022] GET /identity/v3/groups/833882f81a134c7bab260508b5ef374d => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:17.331098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb099943-e0e5-40f3-a885-1ed320e9dea9 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:17.372771 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefe8ad-2158-4211-adce-d57dd2212d45 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:17.373076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefe8ad-2158-4211-adce-d57dd2212d45 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:17.373300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefe8ad-2158-4211-adce-d57dd2212d45 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:17.374988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 194/386] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:17.386654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f630961-a7e4-428e-b956-7c2f88ccde30 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:17.386935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f630961-a7e4-428e-b956-7c2f88ccde30 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:17.387225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f630961-a7e4-428e-b956-7c2f88ccde30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:17.412976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6f630961-a7e4-428e-b956-7c2f88ccde30 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:17.414194 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6f630961-a7e4-428e-b956-7c2f88ccde30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:17.452358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb099943-e0e5-40f3-a885-1ed320e9dea9 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:17.506982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c5743-16e4-4f33-9902-84e769ae8f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:17.508263 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5743-16e4-4f33-9902-84e769ae8f11 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:17.508760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5743-16e4-4f33-9902-84e769ae8f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:17.509256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5743-16e4-4f33-9902-84e769ae8f11 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:17.511696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c5743-16e4-4f33-9902-84e769ae8f11 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:17.513609 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c5743-16e4-4f33-9902-84e769ae8f11 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:17.515872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 193/387] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:17 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:17.528731 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c5743-16e4-4f33-9902-84e769ae8f11 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:17.545009 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 195/388] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:17.576772 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f630961-a7e4-428e-b956-7c2f88ccde30 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:17.617335 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:17.714061 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c5743-16e4-4f33-9902-84e769ae8f11 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:17.767976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d207b-c600-446c-8aac-e5f5301af45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:17.768361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:17.769162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d207b-c600-446c-8aac-e5f5301af45b None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:17.769274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d207b-c600-446c-8aac-e5f5301af45b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:17.769468 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d207b-c600-446c-8aac-e5f5301af45b None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab/groups/833882f81a134c7bab260508b5ef374d/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:17.773708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d207b-c600-446c-8aac-e5f5301af45b None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc23eb82d084bf399415f38e4538aab, group_id=833882f81a134c7bab260508b5ef374d, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:17.781792 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d207b-c600-446c-8aac-e5f5301af45b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:17.793107 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f630961-a7e4-428e-b956-7c2f88ccde30 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:17.832335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fd69d-7246-4587-81e9-8c5f9181541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:17.833191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fd69d-7246-4587-81e9-8c5f9181541a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:17.833484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fd69d-7246-4587-81e9-8c5f9181541a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:17.833861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fd69d-7246-4587-81e9-8c5f9181541a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:17.845748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fd69d-7246-4587-81e9-8c5f9181541a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-3f4fd69d-7246-4587-81e9-8c5f9181541a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:17.854076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:17.855144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:17.855935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:17.855935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:17.855935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:17.855935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:17.855935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:17.855935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:17.855935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:17.855935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:17.855935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:17.855935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:17.855935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:25:17.855935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:17.855935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 196/389] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:25:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:17.871146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fd69d-7246-4587-81e9-8c5f9181541a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:17.875471 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 194/390] 10.222.0.33 () {58 vars in 1442 bytes} [Wed Jun 1 17:25:17 2022] PUT /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab/groups/833882f81a134c7bab260508b5ef374d/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:25:18.021164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fd69d-7246-4587-81e9-8c5f9181541a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:18.071646 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09da73-ae0f-4504-9e44-9355c4f89b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:18.072331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09da73-ae0f-4504-9e44-9355c4f89b84 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:18.072613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09da73-ae0f-4504-9e44-9355c4f89b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:18.072886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09da73-ae0f-4504-9e44-9355c4f89b84 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:18.073714 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09da73-ae0f-4504-9e44-9355c4f89b84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:18.074023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09da73-ae0f-4504-9e44-9355c4f89b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:18.075415 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09da73-ae0f-4504-9e44-9355c4f89b84 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:18.089294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 197/391] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:18.096096 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d207b-c600-446c-8aac-e5f5301af45b None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:18.209391 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:18.212223 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d207b-c600-446c-8aac-e5f5301af45b None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:18.250489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6c68b-d67b-4c17-ba86-0227020cb603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:18.251419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6c68b-d67b-4c17-ba86-0227020cb603 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:18.251694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6c68b-d67b-4c17-ba86-0227020cb603 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:18.251992 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6c68b-d67b-4c17-ba86-0227020cb603 None admin] PATH_INFO: `/v3/groups/833882f81a134c7bab260508b5ef374d` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:18.253254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6c68b-d67b-4c17-ba86-0227020cb603 None admin] RBAC: Authorizing `identity:get_group(group_id=833882f81a134c7bab260508b5ef374d)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:18.254694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6c68b-d67b-4c17-ba86-0227020cb603 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:18.257476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 195/392] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jun 1 17:25:18 2022] GET /identity/v3/groups/833882f81a134c7bab260508b5ef374d => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:18.261993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09da73-ae0f-4504-9e44-9355c4f89b84 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:18.278299 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:18.386993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09da73-ae0f-4504-9e44-9355c4f89b84 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:18.422431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740adc7-03ac-410a-a180-ab1c0e32dd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:18.423325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740adc7-03ac-410a-a180-ab1c0e32dd7e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:18.423609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740adc7-03ac-410a-a180-ab1c0e32dd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:18.423886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740adc7-03ac-410a-a180-ab1c0e32dd7e None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:18.425219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740adc7-03ac-410a-a180-ab1c0e32dd7e None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:18.427251 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740adc7-03ac-410a-a180-ab1c0e32dd7e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:18.429020 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 198/393] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:18 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:18.437021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6c68b-d67b-4c17-ba86-0227020cb603 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:18.566890 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6c68b-d67b-4c17-ba86-0227020cb603 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:18.608041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e368f-03ec-4e24-a139-ca4c60f2bb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:18.608953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e368f-03ec-4e24-a139-ca4c60f2bb73 None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:18.609252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e368f-03ec-4e24-a139-ca4c60f2bb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:18.609528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e368f-03ec-4e24-a139-ca4c60f2bb73 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab/groups/833882f81a134c7bab260508b5ef374d/roles/58b5b157099e42bcb4ee3eff9aaf2064` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:18.612598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e368f-03ec-4e24-a139-ca4c60f2bb73 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc23eb82d084bf399415f38e4538aab, group_id=833882f81a134c7bab260508b5ef374d, role_id=58b5b157099e42bcb4ee3eff9aaf2064)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:18.614292 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e368f-03ec-4e24-a139-ca4c60f2bb73 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:18.707635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 196/394] 10.222.0.33 () {58 vars in 1442 bytes} [Wed Jun 1 17:25:18 2022] PUT /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab/groups/833882f81a134c7bab260508b5ef374d/roles/58b5b157099e42bcb4ee3eff9aaf2064 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:25:18.824606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b3be7-6662-40fc-97b3-fcfeff216813 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:18.824899 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b3be7-6662-40fc-97b3-fcfeff216813 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:18.825098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b3be7-6662-40fc-97b3-fcfeff216813 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:18.827091 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 199/395] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:18.832557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65a5d2-8bba-4a11-8769-2582f7a1d130 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:18.833192 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65a5d2-8bba-4a11-8769-2582f7a1d130 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:18.833680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65a5d2-8bba-4a11-8769-2582f7a1d130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:18.858299 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-6b65a5d2-8bba-4a11-8769-2582f7a1d130 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:18.859940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6b65a5d2-8bba-4a11-8769-2582f7a1d130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:18.893457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:18.947653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 197/396] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:18.981723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b3be7-6662-40fc-97b3-fcfeff216813 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:19.109560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:19.141725 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b3be7-6662-40fc-97b3-fcfeff216813 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:19.191521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb7c0e-d1d4-4c44-9fed-638a53af5e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:19.192348 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb7c0e-d1d4-4c44-9fed-638a53af5e51 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:19.192633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb7c0e-d1d4-4c44-9fed-638a53af5e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:19.192914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb7c0e-d1d4-4c44-9fed-638a53af5e51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:19.212028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb7c0e-d1d4-4c44-9fed-638a53af5e51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-8bfb7c0e-d1d4-4c44-9fed-638a53af5e51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:19.219950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:19.220850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:19.221768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:19.221768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:19.221768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:19.221768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:19.221768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:19.221768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:19.221768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:19.221768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:19.221768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:19.221768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:19.221768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:19.221768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:19.222376 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 200/397] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:19.227437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65a5d2-8bba-4a11-8769-2582f7a1d130 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:19.369456 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65a5d2-8bba-4a11-8769-2582f7a1d130 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:19.416458 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5097a-33e2-4e34-ac8c-c130d18c4c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:19.417659 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5097a-33e2-4e34-ac8c-c130d18c4c66 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:19.418137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5097a-33e2-4e34-ac8c-c130d18c4c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:19.418654 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5097a-33e2-4e34-ac8c-c130d18c4c66 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:19.419588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5097a-33e2-4e34-ac8c-c130d18c4c66 None admin] RBAC: Adding query filter params (name=member) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:19.420104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5097a-33e2-4e34-ac8c-c130d18c4c66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:19.421755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5097a-33e2-4e34-ac8c-c130d18c4c66 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:19.431842 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 198/398] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:25:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:19.437519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb7c0e-d1d4-4c44-9fed-638a53af5e51 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:19.572788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb7c0e-d1d4-4c44-9fed-638a53af5e51 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:19.624359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c6542-5187-4d9c-8666-c4c0b688d43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:19.625202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c6542-5187-4d9c-8666-c4c0b688d43a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:19.625494 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c6542-5187-4d9c-8666-c4c0b688d43a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:19.625787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c6542-5187-4d9c-8666-c4c0b688d43a None admin] PATH_INFO: `/v3/groups/833882f81a134c7bab260508b5ef374d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:19.627531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c6542-5187-4d9c-8666-c4c0b688d43a None admin] RBAC: Authorizing `identity:get_group(group_id=833882f81a134c7bab260508b5ef374d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:19.629050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c6542-5187-4d9c-8666-c4c0b688d43a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:19.631086 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 201/399] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jun 1 17:25:19 2022] GET /identity/v3/groups/833882f81a134c7bab260508b5ef374d => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:19.636245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5097a-33e2-4e34-ac8c-c130d18c4c66 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:19.676985 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:19.739691 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ba4fa-20dc-42fe-8430-25e60e3e9458 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:19.740014 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ba4fa-20dc-42fe-8430-25e60e3e9458 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:19.740259 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ba4fa-20dc-42fe-8430-25e60e3e9458 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:19.743179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 202/400] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:19.748172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85d20d-2745-4370-a7b4-51da32a747db None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:19.748466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85d20d-2745-4370-a7b4-51da32a747db None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:19.748751 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85d20d-2745-4370-a7b4-51da32a747db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:19.775850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:19.786478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5097a-33e2-4e34-ac8c-c130d18c4c66 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:19.789683 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0b85d20d-2745-4370-a7b4-51da32a747db None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:19.792800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0b85d20d-2745-4370-a7b4-51da32a747db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:19.855683 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4f928-5703-43c0-898d-2e470befa3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:19.856930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4f928-5703-43c0-898d-2e470befa3cc None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:19.857449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4f928-5703-43c0-898d-2e470befa3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:19.857915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4f928-5703-43c0-898d-2e470befa3cc None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:19.859483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4f928-5703-43c0-898d-2e470befa3cc None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:19.861943 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4f928-5703-43c0-898d-2e470befa3cc None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:19.866092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 199/401] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:19 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:19.873328 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4f928-5703-43c0-898d-2e470befa3cc None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:19.931340 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 203/402] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:19.973697 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85d20d-2745-4370-a7b4-51da32a747db None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:19.975462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:19.989159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4f928-5703-43c0-898d-2e470befa3cc None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:20.028213 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d47cf9-d7e4-4702-8332-329b94760293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:20.029562 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d47cf9-d7e4-4702-8332-329b94760293 None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:20.030042 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d47cf9-d7e4-4702-8332-329b94760293 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:20.030530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d47cf9-d7e4-4702-8332-329b94760293 None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1/groups/833882f81a134c7bab260508b5ef374d/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:20.033492 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d47cf9-d7e4-4702-8332-329b94760293 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1, group_id=833882f81a134c7bab260508b5ef374d, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:20.035478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d47cf9-d7e4-4702-8332-329b94760293 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:20.121698 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85d20d-2745-4370-a7b4-51da32a747db None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:20.137741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 200/403] 10.222.0.33 () {58 vars in 1442 bytes} [Wed Jun 1 17:25:19 2022] PUT /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1/groups/833882f81a134c7bab260508b5ef374d/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:25:20.139783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70845b00-3f48-46e9-b61b-cab505db3544 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:20.140574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70845b00-3f48-46e9-b61b-cab505db3544 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:20.142399 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70845b00-3f48-46e9-b61b-cab505db3544 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:20.145015 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 201/404] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:20.151382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac934501-f64d-466e-a0b9-02a617101a6d None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:20.152519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac934501-f64d-466e-a0b9-02a617101a6d None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:20.153029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac934501-f64d-466e-a0b9-02a617101a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:20.177908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-ac934501-f64d-466e-a0b9-02a617101a6d None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:20.180028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ac934501-f64d-466e-a0b9-02a617101a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:20.192061 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01b271-84b4-4fe4-a7b4-e405f4ea4f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:20.192852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01b271-84b4-4fe4-a7b4-e405f4ea4f04 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:20.193177 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01b271-84b4-4fe4-a7b4-e405f4ea4f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:20.193458 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01b271-84b4-4fe4-a7b4-e405f4ea4f04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:20.202518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:20.219846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01b271-84b4-4fe4-a7b4-e405f4ea4f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-7b01b271-84b4-4fe4-a7b4-e405f4ea4f04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:20.228905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:20.229945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:20.230729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:20.230729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:20.230729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:20.230729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:20.230729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:20.230729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:20.230729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:20.230729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:20.230729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:20.230729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:20.230729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:25:20.230729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:20.237372 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 204/405] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:25:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:20.238357 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01b271-84b4-4fe4-a7b4-e405f4ea4f04 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:20.279899 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 202/406] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:25:20.306482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac934501-f64d-466e-a0b9-02a617101a6d None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:20.404307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:20.434246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac934501-f64d-466e-a0b9-02a617101a6d None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:20.462863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01b271-84b4-4fe4-a7b4-e405f4ea4f04 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:20.496101 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6457b-3915-4735-b4d9-3537e7d7b6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:20.497793 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6457b-3915-4735-b4d9-3537e7d7b6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:20.498315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6457b-3915-4735-b4d9-3537e7d7b6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:20.498977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6457b-3915-4735-b4d9-3537e7d7b6a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:20.512186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6457b-3915-4735-b4d9-3537e7d7b6a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-54d6457b-3915-4735-b4d9-3537e7d7b6a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:20.522723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:20.523682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:20.524464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:20.524464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:20.524464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:20.524464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:20.524464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:20.524464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:20.524464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:20.524464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:20.524464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:20.524464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:20.524464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:25:20.524464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:20.527382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 203/407] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:25:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:20.532349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f87ee-2f31-41d5-8835-97332f8093bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:20.532349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f87ee-2f31-41d5-8835-97332f8093bd None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:20.532349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f87ee-2f31-41d5-8835-97332f8093bd None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:20.532349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f87ee-2f31-41d5-8835-97332f8093bd None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:20.532747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f87ee-2f31-41d5-8835-97332f8093bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:20.532747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f87ee-2f31-41d5-8835-97332f8093bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:20.534197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6457b-3915-4735-b4d9-3537e7d7b6a8 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:20.534930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f87ee-2f31-41d5-8835-97332f8093bd None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:20.553233 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 205/408] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:20.558642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f87ee-2f31-41d5-8835-97332f8093bd None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:20.652994 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6457b-3915-4735-b4d9-3537e7d7b6a8 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:20.679128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:20.706547 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738daec7-0d05-4b2f-b8e7-12d05d76e107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:20.707669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738daec7-0d05-4b2f-b8e7-12d05d76e107 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:20.708225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738daec7-0d05-4b2f-b8e7-12d05d76e107 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:20.708684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738daec7-0d05-4b2f-b8e7-12d05d76e107 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:20.709619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738daec7-0d05-4b2f-b8e7-12d05d76e107 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:20.710082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738daec7-0d05-4b2f-b8e7-12d05d76e107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:20.711635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738daec7-0d05-4b2f-b8e7-12d05d76e107 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:20.727479 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f87ee-2f31-41d5-8835-97332f8093bd None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:20.729156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:20.734373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 204/409] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:20.741242 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738daec7-0d05-4b2f-b8e7-12d05d76e107 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:20.767098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1361540-24ac-4a7e-951c-d770d87c205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:20.768327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1361540-24ac-4a7e-951c-d770d87c205f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:20.768618 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1361540-24ac-4a7e-951c-d770d87c205f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:20.768903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1361540-24ac-4a7e-951c-d770d87c205f None admin] PATH_INFO: `/v3/groups/498839e88e434983bab97ada0561bb96` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:20.770159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1361540-24ac-4a7e-951c-d770d87c205f None admin] RBAC: Authorizing `identity:get_group(group_id=498839e88e434983bab97ada0561bb96)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:20.771610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1361540-24ac-4a7e-951c-d770d87c205f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:20.773578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 206/410] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jun 1 17:25:20 2022] GET /identity/v3/groups/498839e88e434983bab97ada0561bb96 => generated 229 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:20.778917 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1361540-24ac-4a7e-951c-d770d87c205f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:20.884652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1361540-24ac-4a7e-951c-d770d87c205f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:20.912614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:20.921545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68f63a-5414-47c7-b83e-891b394db022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:20.922514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68f63a-5414-47c7-b83e-891b394db022 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:20.922925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68f63a-5414-47c7-b83e-891b394db022 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:20.923298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68f63a-5414-47c7-b83e-891b394db022 None admin] PATH_INFO: `/v3/projects/5ab5b23ebc224a5b9dd9616b70ea67bd` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:20.924630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68f63a-5414-47c7-b83e-891b394db022 None admin] RBAC: Authorizing `identity:get_project(project_id=5ab5b23ebc224a5b9dd9616b70ea67bd)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:20.926105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738daec7-0d05-4b2f-b8e7-12d05d76e107 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:20.926545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68f63a-5414-47c7-b83e-891b394db022 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:20.928237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 207/411] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:20 2022] GET /identity/v3/projects/5ab5b23ebc224a5b9dd9616b70ea67bd => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:20.933981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd9e1b-974e-4536-9a79-63b5e903b8b4 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:20.934366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd9e1b-974e-4536-9a79-63b5e903b8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:20.934724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd9e1b-974e-4536-9a79-63b5e903b8b4 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:20.936460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 208/412] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:20.937344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd9e1b-974e-4536-9a79-63b5e903b8b4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:20.966554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d99d9d-80a3-40bf-a06d-660b9fe3d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:20.967526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d99d9d-80a3-40bf-a06d-660b9fe3d421 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:20.967808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d99d9d-80a3-40bf-a06d-660b9fe3d421 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:20.968081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d99d9d-80a3-40bf-a06d-660b9fe3d421 None admin] PATH_INFO: `/v3/groups/833882f81a134c7bab260508b5ef374d` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:20.969378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d99d9d-80a3-40bf-a06d-660b9fe3d421 None admin] RBAC: Authorizing `identity:get_group(group_id=833882f81a134c7bab260508b5ef374d)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:20.971119 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d99d9d-80a3-40bf-a06d-660b9fe3d421 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:20.972856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 205/413] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jun 1 17:25:20 2022] GET /identity/v3/groups/833882f81a134c7bab260508b5ef374d => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:20.974065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8b9e2-71aa-493a-ab56-c6327c8f6ce3 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:20.974346 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8b9e2-71aa-493a-ab56-c6327c8f6ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:20.974628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8b9e2-71aa-493a-ab56-c6327c8f6ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:20.996853 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-cfc8b9e2-71aa-493a-ab56-c6327c8f6ce3 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:20.997997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-cfc8b9e2-71aa-493a-ab56-c6327c8f6ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:21.046946 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd9e1b-974e-4536-9a79-63b5e903b8b4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:21.068574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:21.075611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 206/414] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:21.078528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8b9e2-71aa-493a-ab56-c6327c8f6ce3 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:21.086832 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85074efe-810a-4e88-ab4e-565f23b9de78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:21.087973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85074efe-810a-4e88-ab4e-565f23b9de78 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:21.088407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85074efe-810a-4e88-ab4e-565f23b9de78 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:21.088874 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85074efe-810a-4e88-ab4e-565f23b9de78 None admin] PATH_INFO: `/v3/projects/5ab5b23ebc224a5b9dd9616b70ea67bd/groups/498839e88e434983bab97ada0561bb96/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:21.091083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85074efe-810a-4e88-ab4e-565f23b9de78 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ab5b23ebc224a5b9dd9616b70ea67bd, group_id=498839e88e434983bab97ada0561bb96, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:21.092831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85074efe-810a-4e88-ab4e-565f23b9de78 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:21.177653 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 209/415] 10.222.0.33 () {58 vars in 1442 bytes} [Wed Jun 1 17:25:20 2022] PUT /identity/v3/projects/5ab5b23ebc224a5b9dd9616b70ea67bd/groups/498839e88e434983bab97ada0561bb96/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:25:21.186769 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85074efe-810a-4e88-ab4e-565f23b9de78 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:21.209414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8b9e2-71aa-493a-ab56-c6327c8f6ce3 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:21.293235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:21.315373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4a29e-fac9-409f-ad6d-0627f243638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:21.316271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4a29e-fac9-409f-ad6d-0627f243638a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:21.316560 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4a29e-fac9-409f-ad6d-0627f243638a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:21.316838 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4a29e-fac9-409f-ad6d-0627f243638a None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:21.321828 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4a29e-fac9-409f-ad6d-0627f243638a None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:21.323337 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4a29e-fac9-409f-ad6d-0627f243638a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:21.325556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 207/416] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:21 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:21.331891 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4a29e-fac9-409f-ad6d-0627f243638a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:21.367386 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85074efe-810a-4e88-ab4e-565f23b9de78 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:21.439955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2d0cf-980c-4b86-8a31-8ca32c7c42fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:21.440807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d0cf-980c-4b86-8a31-8ca32c7c42fb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:21.441085 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d0cf-980c-4b86-8a31-8ca32c7c42fb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:21.441363 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d0cf-980c-4b86-8a31-8ca32c7c42fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:21.456629 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2d0cf-980c-4b86-8a31-8ca32c7c42fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:21.457379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-96f2d0cf-980c-4b86-8a31-8ca32c7c42fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:21.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:21.472205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:21.473057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:21.473057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:21.473057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:21.473057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:21.473057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:21.473057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:21.473057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:21.473057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:21.473057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:21.473057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:21.473057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:21.473057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:21.473057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 210/417] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:21.481510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2d0cf-980c-4b86-8a31-8ca32c7c42fb None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:21.512032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4a29e-fac9-409f-ad6d-0627f243638a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:21.556982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b75922-1089-4697-a2c6-6b26ea6a370f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:21.557952 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b75922-1089-4697-a2c6-6b26ea6a370f None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:21.558335 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b75922-1089-4697-a2c6-6b26ea6a370f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:21.558714 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b75922-1089-4697-a2c6-6b26ea6a370f None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1/groups/833882f81a134c7bab260508b5ef374d/roles/58b5b157099e42bcb4ee3eff9aaf2064` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:21.561680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b75922-1089-4697-a2c6-6b26ea6a370f None admin] RBAC: Authorizing `identity:create_grant(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1, group_id=833882f81a134c7bab260508b5ef374d, role_id=58b5b157099e42bcb4ee3eff9aaf2064)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:21.563074 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b75922-1089-4697-a2c6-6b26ea6a370f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:21.606576 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2d0cf-980c-4b86-8a31-8ca32c7c42fb None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:21.623689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:21.637725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 208/418] 10.222.0.33 () {58 vars in 1442 bytes} [Wed Jun 1 17:25:21 2022] PUT /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1/groups/833882f81a134c7bab260508b5ef374d/roles/58b5b157099e42bcb4ee3eff9aaf2064 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:25:21.668387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa88c69-2b48-4624-bfc0-d777bb30ac0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:21.669177 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa88c69-2b48-4624-bfc0-d777bb30ac0a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:21.669474 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa88c69-2b48-4624-bfc0-d777bb30ac0a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:21.669760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa88c69-2b48-4624-bfc0-d777bb30ac0a None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:21.671850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa88c69-2b48-4624-bfc0-d777bb30ac0a None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:21.671850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa88c69-2b48-4624-bfc0-d777bb30ac0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:21.672367 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa88c69-2b48-4624-bfc0-d777bb30ac0a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:21.687928 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 211/419] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:25:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:21.694045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b75922-1089-4697-a2c6-6b26ea6a370f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:21.831664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b75922-1089-4697-a2c6-6b26ea6a370f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:21.867124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:21.877025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68301dae-c961-429a-aa78-f98268b5cf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:21.877805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68301dae-c961-429a-aa78-f98268b5cf2f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:21.878084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68301dae-c961-429a-aa78-f98268b5cf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:21.878358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68301dae-c961-429a-aa78-f98268b5cf2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:21.964645 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68301dae-c961-429a-aa78-f98268b5cf2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:21.966163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68301dae-c961-429a-aa78-f98268b5cf2f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:22.085752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 209/420] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:22.091193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa88c69-2b48-4624-bfc0-d777bb30ac0a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:22.226004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa88c69-2b48-4624-bfc0-d777bb30ac0a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:22.241475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2484e-453f-44f8-9699-0e9effa2313f None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:22.241782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2484e-453f-44f8-9699-0e9effa2313f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:22.242034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2484e-453f-44f8-9699-0e9effa2313f None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:22.243762 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 210/421] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:22.249831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29232510-cd55-4ae5-aa5d-d46ce79799ca None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:22.250148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29232510-cd55-4ae5-aa5d-d46ce79799ca None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:22.250401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29232510-cd55-4ae5-aa5d-d46ce79799ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:22.271217 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-29232510-cd55-4ae5-aa5d-d46ce79799ca None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:22.272446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-29232510-cd55-4ae5-aa5d-d46ce79799ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:22.283451 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae1286-49bc-4d07-88ca-90b5a807df41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:22.284808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae1286-49bc-4d07-88ca-90b5a807df41 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:22.285117 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae1286-49bc-4d07-88ca-90b5a807df41 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:22.285420 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae1286-49bc-4d07-88ca-90b5a807df41 None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:22.287478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae1286-49bc-4d07-88ca-90b5a807df41 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:22.289265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae1286-49bc-4d07-88ca-90b5a807df41 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:22.292211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 212/422] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:22 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:22.297601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae1286-49bc-4d07-88ca-90b5a807df41 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:22.301717 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:22.397491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:22.426599 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 211/423] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:25:22.460293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae1286-49bc-4d07-88ca-90b5a807df41 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:22.463508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29232510-cd55-4ae5-aa5d-d46ce79799ca None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:22.533192 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a92d1-932c-45eb-9909-0d724a5f20a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:22.536492 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a92d1-932c-45eb-9909-0d724a5f20a8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:22.536785 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a92d1-932c-45eb-9909-0d724a5f20a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:22.537098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a92d1-932c-45eb-9909-0d724a5f20a8 None admin] PATH_INFO: `/v3/groups/833882f81a134c7bab260508b5ef374d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:22.540209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a92d1-932c-45eb-9909-0d724a5f20a8 None admin] RBAC: Authorizing `identity:get_group(group_id=833882f81a134c7bab260508b5ef374d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:22.541713 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a92d1-932c-45eb-9909-0d724a5f20a8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:22.545102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 213/424] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jun 1 17:25:22 2022] GET /identity/v3/groups/833882f81a134c7bab260508b5ef374d => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:22.562780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a92d1-932c-45eb-9909-0d724a5f20a8 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:22.625352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29232510-cd55-4ae5-aa5d-d46ce79799ca None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:22.666868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe52e5-cc6d-4b33-b60d-0197eb881c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:22.667610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe52e5-cc6d-4b33-b60d-0197eb881c66 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:22.667908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe52e5-cc6d-4b33-b60d-0197eb881c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:22.668481 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe52e5-cc6d-4b33-b60d-0197eb881c66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:22.680361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe52e5-cc6d-4b33-b60d-0197eb881c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-9afe52e5-cc6d-4b33-b60d-0197eb881c66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:22.689826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:22.690776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:22.692201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:22.692201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:22.692201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:22.692201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:22.692201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:22.692201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:22.692201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:22.692201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:22.692201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:22.692201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:22.692201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:25:22.692201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:22.692201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 212/425] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:25:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:22.697369 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe52e5-cc6d-4b33-b60d-0197eb881c66 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:22.720245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:22.791731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a92d1-932c-45eb-9909-0d724a5f20a8 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:22.815698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe52e5-cc6d-4b33-b60d-0197eb881c66 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:22.823061 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:22.857471 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea57961-4f6d-455b-8786-4c0160836e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:22.858157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea57961-4f6d-455b-8786-4c0160836e4a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:22.858444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea57961-4f6d-455b-8786-4c0160836e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:22.858723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea57961-4f6d-455b-8786-4c0160836e4a None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:22.859546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea57961-4f6d-455b-8786-4c0160836e4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:22.859863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea57961-4f6d-455b-8786-4c0160836e4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:22.862096 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea57961-4f6d-455b-8786-4c0160836e4a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:22.872066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 213/426] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:22.877918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea57961-4f6d-455b-8786-4c0160836e4a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:22.894196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f970e-a0a8-4bf5-b136-7387a3250734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:22.894860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f970e-a0a8-4bf5-b136-7387a3250734 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:22.895144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f970e-a0a8-4bf5-b136-7387a3250734 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:22.895420 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f970e-a0a8-4bf5-b136-7387a3250734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:22.896284 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f970e-a0a8-4bf5-b136-7387a3250734 None admin] RBAC: Adding query filter params (group.id=833882f81a134c7bab260508b5ef374d, role.id=e8531ae972c749c0a8ea8a73601c5cd1, scope.project.id=0bc23eb82d084bf399415f38e4538aab) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:22.896596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f970e-a0a8-4bf5-b136-7387a3250734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:22.898077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f970e-a0a8-4bf5-b136-7387a3250734 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:22.916366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 214/427] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jun 1 17:25:22 2022] GET /identity/v3/role_assignments?group.id=833882f81a134c7bab260508b5ef374d&scope.project.id=0bc23eb82d084bf399415f38e4538aab&role.id=e8531ae972c749c0a8ea8a73601c5cd1 => generated 611 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:22.925494 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82944bb-11dd-4a4e-91fb-4fa032831557 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:22.925777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82944bb-11dd-4a4e-91fb-4fa032831557 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:22.925964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82944bb-11dd-4a4e-91fb-4fa032831557 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:22.927561 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 215/428] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:25:22.933505 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c834a-4df5-426d-a765-bb3cb4c68b10 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:22.933939 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c834a-4df5-426d-a765-bb3cb4c68b10 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:22.934315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c834a-4df5-426d-a765-bb3cb4c68b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:22.955720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-773c834a-4df5-426d-a765-bb3cb4c68b10 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:22.957093 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-773c834a-4df5-426d-a765-bb3cb4c68b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:23.059321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:23.077909 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 216/429] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:25:23.101908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea57961-4f6d-455b-8786-4c0160836e4a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:23.148771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062b98f-3687-434e-8233-c8ca413b2d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:23.149804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062b98f-3687-434e-8233-c8ca413b2d66 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:23.150290 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062b98f-3687-434e-8233-c8ca413b2d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:23.150768 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062b98f-3687-434e-8233-c8ca413b2d66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:23.155316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c834a-4df5-426d-a765-bb3cb4c68b10 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:23.259720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062b98f-3687-434e-8233-c8ca413b2d66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:23.261554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062b98f-3687-434e-8233-c8ca413b2d66 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:23.274662 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c834a-4df5-426d-a765-bb3cb4c68b10 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:23.291799 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:23.334648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcbd1a-3ffa-4fb8-b591-909690e59014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:23.334648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcbd1a-3ffa-4fb8-b591-909690e59014 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:23.334648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcbd1a-3ffa-4fb8-b591-909690e59014 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:23.334648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcbd1a-3ffa-4fb8-b591-909690e59014 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:23.352324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcbd1a-3ffa-4fb8-b591-909690e59014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-83fcbd1a-3ffa-4fb8-b591-909690e59014 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:23.362743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:23.363979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:23.364779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:23.364779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:23.364779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:23.364779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:23.364779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:23.364779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:23.364779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:23.364779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:23.364779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:23.364779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:23.364779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 01 17:25:23.364779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:23.364779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 217/430] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:23.368246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcbd1a-3ffa-4fb8-b591-909690e59014 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:23.372992 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:23.400542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 214/431] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:23.410117 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062b98f-3687-434e-8233-c8ca413b2d66 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:23.493643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcbd1a-3ffa-4fb8-b591-909690e59014 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:23.539604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552343e-be55-485d-afae-196456697550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:23.540459 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552343e-be55-485d-afae-196456697550 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:23.541077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552343e-be55-485d-afae-196456697550 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:23.542206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552343e-be55-485d-afae-196456697550 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:23.543098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552343e-be55-485d-afae-196456697550 None admin] RBAC: Adding query filter params (name=member) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:23.543515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552343e-be55-485d-afae-196456697550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:23.545323 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552343e-be55-485d-afae-196456697550 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:23.558229 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062b98f-3687-434e-8233-c8ca413b2d66 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:23.562859 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 218/432] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:25:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:23.564045 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552343e-be55-485d-afae-196456697550 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:23.608130 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:23.613747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c97d58-3823-415a-8b0c-e9ccb15e9f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:23.615065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c97d58-3823-415a-8b0c-e9ccb15e9f9d None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:23.615423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c97d58-3823-415a-8b0c-e9ccb15e9f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:23.615708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c97d58-3823-415a-8b0c-e9ccb15e9f9d None admin] PATH_INFO: `/v3/projects/0bc23eb82d084bf399415f38e4538aab` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:23.617320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c97d58-3823-415a-8b0c-e9ccb15e9f9d None admin] RBAC: Authorizing `identity:get_project(project_id=0bc23eb82d084bf399415f38e4538aab)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:23.618932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c97d58-3823-415a-8b0c-e9ccb15e9f9d None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:23.621808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 215/433] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:23 2022] GET /identity/v3/projects/0bc23eb82d084bf399415f38e4538aab => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:23.628318 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c97d58-3823-415a-8b0c-e9ccb15e9f9d None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:23.692483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:23.706325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552343e-be55-485d-afae-196456697550 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:23.747066 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446b563-5cdd-4c6c-a731-b30769ac104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:23.747999 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446b563-5cdd-4c6c-a731-b30769ac104e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:23.748108 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446b563-5cdd-4c6c-a731-b30769ac104e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:23.748396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446b563-5cdd-4c6c-a731-b30769ac104e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:23.758968 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c97d58-3823-415a-8b0c-e9ccb15e9f9d None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:23.803729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7ec60-7012-4cd2-a653-f70d9be11656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:23.804916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7ec60-7012-4cd2-a653-f70d9be11656 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:23.805454 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7ec60-7012-4cd2-a653-f70d9be11656 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:23.805926 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7ec60-7012-4cd2-a653-f70d9be11656 None admin] PATH_INFO: `/v3/groups/833882f81a134c7bab260508b5ef374d` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:23.807323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7ec60-7012-4cd2-a653-f70d9be11656 None admin] RBAC: Authorizing `identity:get_group(group_id=833882f81a134c7bab260508b5ef374d)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:23.809004 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7ec60-7012-4cd2-a653-f70d9be11656 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:23.810905 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 216/434] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jun 1 17:25:23 2022] GET /identity/v3/groups/833882f81a134c7bab260508b5ef374d => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:23.822784 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7ec60-7012-4cd2-a653-f70d9be11656 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:23.836083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446b563-5cdd-4c6c-a731-b30769ac104e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:23.837765 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446b563-5cdd-4c6c-a731-b30769ac104e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:23.866851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:23.936068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7ec60-7012-4cd2-a653-f70d9be11656 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:23.947299 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 219/435] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:23.952580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:23.952787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446b563-5cdd-4c6c-a731-b30769ac104e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:23.974614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dae39-56e8-4da6-96ef-9aaff730d194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:23.975630 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dae39-56e8-4da6-96ef-9aaff730d194 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:23.976113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dae39-56e8-4da6-96ef-9aaff730d194 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:23.976607 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dae39-56e8-4da6-96ef-9aaff730d194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:23.977666 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dae39-56e8-4da6-96ef-9aaff730d194 None admin] RBAC: Adding query filter params (group.id=833882f81a134c7bab260508b5ef374d, role.id=58b5b157099e42bcb4ee3eff9aaf2064, scope.project.id=0bc23eb82d084bf399415f38e4538aab) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:23.978433 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dae39-56e8-4da6-96ef-9aaff730d194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:23.980082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dae39-56e8-4da6-96ef-9aaff730d194 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:23.993092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 217/436] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jun 1 17:25:23 2022] GET /identity/v3/role_assignments?group.id=833882f81a134c7bab260508b5ef374d&scope.project.id=0bc23eb82d084bf399415f38e4538aab&role.id=58b5b157099e42bcb4ee3eff9aaf2064 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:24.078824 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446b563-5cdd-4c6c-a731-b30769ac104e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:24.113212 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:24.122164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcc0ba-c24e-4954-8dd5-c0cfd2f2289d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:24.123049 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcc0ba-c24e-4954-8dd5-c0cfd2f2289d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:24.123339 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcc0ba-c24e-4954-8dd5-c0cfd2f2289d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:24.124482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcc0ba-c24e-4954-8dd5-c0cfd2f2289d None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:24.125102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcc0ba-c24e-4954-8dd5-c0cfd2f2289d None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:24.127202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcc0ba-c24e-4954-8dd5-c0cfd2f2289d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:24.129407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 220/437] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:23 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:24.135122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dae39-56e8-4da6-96ef-9aaff730d194 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:24.143531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92ec16-4354-4ff1-a5cc-82def105aa45 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:24.143915 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92ec16-4354-4ff1-a5cc-82def105aa45 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:24.144200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92ec16-4354-4ff1-a5cc-82def105aa45 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:24.145604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 221/438] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:24.151400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a13b18-07fd-4d97-96ac-923fcbd3ad45 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:24.151686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a13b18-07fd-4d97-96ac-923fcbd3ad45 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:24.151996 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a13b18-07fd-4d97-96ac-923fcbd3ad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:24.170987 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f5a13b18-07fd-4d97-96ac-923fcbd3ad45 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:24.172363 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f5a13b18-07fd-4d97-96ac-923fcbd3ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:24.257646 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 222/439] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:25:24.262284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dae39-56e8-4da6-96ef-9aaff730d194 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:24.285440 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a13b18-07fd-4d97-96ac-923fcbd3ad45 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:24.305661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7db74-9382-4ece-88c4-fdf15caf15b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:24.307220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7db74-9382-4ece-88c4-fdf15caf15b9 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:24.307513 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7db74-9382-4ece-88c4-fdf15caf15b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:24.307797 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7db74-9382-4ece-88c4-fdf15caf15b9 None admin] PATH_INFO: `/v3/groups/833882f81a134c7bab260508b5ef374d` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:24.309188 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7db74-9382-4ece-88c4-fdf15caf15b9 None admin] RBAC: Authorizing `identity:get_group(group_id=833882f81a134c7bab260508b5ef374d)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:24.311120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7db74-9382-4ece-88c4-fdf15caf15b9 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:24.312456 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 218/440] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jun 1 17:25:24 2022] GET /identity/v3/groups/833882f81a134c7bab260508b5ef374d => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:24.318903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7db74-9382-4ece-88c4-fdf15caf15b9 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:24.379542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:24.425346 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a13b18-07fd-4d97-96ac-923fcbd3ad45 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:24.453531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7db74-9382-4ece-88c4-fdf15caf15b9 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:24.456357 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:24.467546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97698a34-caaf-4599-b404-4976440580eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:24.468495 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97698a34-caaf-4599-b404-4976440580eb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:24.468787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97698a34-caaf-4599-b404-4976440580eb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:24.469121 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97698a34-caaf-4599-b404-4976440580eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:24.486328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97698a34-caaf-4599-b404-4976440580eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-97698a34-caaf-4599-b404-4976440580eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:24.494809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:24.495686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:24.496470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:24.496470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:24.496470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:24.496470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:24.496470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:24.496470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:24.496470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:24.496470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:24.496470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:24.496470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:24.496470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:25:24.496470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:24.498132 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bd2b0-50ac-4778-990f-b3042fc5d090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:24.499721 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 223/441] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:25:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:24.499836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bd2b0-50ac-4778-990f-b3042fc5d090 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:24.499836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bd2b0-50ac-4778-990f-b3042fc5d090 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:24.499836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bd2b0-50ac-4778-990f-b3042fc5d090 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:24.500238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bd2b0-50ac-4778-990f-b3042fc5d090 None admin] RBAC: Adding query filter params (group.id=833882f81a134c7bab260508b5ef374d, role.id=e8531ae972c749c0a8ea8a73601c5cd1, scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:24.500555 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bd2b0-50ac-4778-990f-b3042fc5d090 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:24.502338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dabacc-5c19-445e-a66e-75cc391f1e33 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:24.502613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bd2b0-50ac-4778-990f-b3042fc5d090 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:24.502715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dabacc-5c19-445e-a66e-75cc391f1e33 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:24.502939 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dabacc-5c19-445e-a66e-75cc391f1e33 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:24.504644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 224/442] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:24.505408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dabacc-5c19-445e-a66e-75cc391f1e33 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:24.516982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 219/443] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jun 1 17:25:24 2022] GET /identity/v3/role_assignments?group.id=833882f81a134c7bab260508b5ef374d&scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1&role.id=e8531ae972c749c0a8ea8a73601c5cd1 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:24.516982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b6639-041f-42c7-bde5-309e29aec9fd None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:24.516982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b6639-041f-42c7-bde5-309e29aec9fd None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:24.516982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b6639-041f-42c7-bde5-309e29aec9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:24.531078 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-e45b6639-041f-42c7-bde5-309e29aec9fd None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:24.532597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e45b6639-041f-42c7-bde5-309e29aec9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:24.609496 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 220/444] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:24.624836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dabacc-5c19-445e-a66e-75cc391f1e33 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:24.634341 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b6639-041f-42c7-bde5-309e29aec9fd None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:24.665065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b1ac6-8ef0-40f2-8b50-9e95156a4536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:24.665746 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b1ac6-8ef0-40f2-8b50-9e95156a4536 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:24.673932 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b1ac6-8ef0-40f2-8b50-9e95156a4536 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:24.673932 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b1ac6-8ef0-40f2-8b50-9e95156a4536 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:24.673932 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b1ac6-8ef0-40f2-8b50-9e95156a4536 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:24.673932 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b1ac6-8ef0-40f2-8b50-9e95156a4536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:24.673932 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b1ac6-8ef0-40f2-8b50-9e95156a4536 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:24.678551 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:24.680824 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 225/445] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:24.686838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b1ac6-8ef0-40f2-8b50-9e95156a4536 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:24.747064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b6639-041f-42c7-bde5-309e29aec9fd None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:24.749059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:24.794803 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593a084-2330-4449-9315-b027f7792dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:24.795378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593a084-2330-4449-9315-b027f7792dbb None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:24.795652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593a084-2330-4449-9315-b027f7792dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:24.795927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593a084-2330-4449-9315-b027f7792dbb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:24.809635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593a084-2330-4449-9315-b027f7792dbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:24.810690 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b1ac6-8ef0-40f2-8b50-9e95156a4536 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-1593a084-2330-4449-9315-b027f7792dbb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:24.819533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:24.820431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:24.821282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:24.821282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:24.821282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:24.821282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:24.821282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:24.821282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:24.821282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:24.821282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:24.821282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:24.821282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:24.821282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:25:24.821282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:24.821282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 221/446] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:25:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:24.826764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593a084-2330-4449-9315-b027f7792dbb None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:24.853642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c9782-8663-4772-a0b2-09e3ad0a6cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:24.854329 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c9782-8663-4772-a0b2-09e3ad0a6cfa None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:24.854590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c9782-8663-4772-a0b2-09e3ad0a6cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:24.854869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c9782-8663-4772-a0b2-09e3ad0a6cfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:24.934658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c9782-8663-4772-a0b2-09e3ad0a6cfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:24.936053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c9782-8663-4772-a0b2-09e3ad0a6cfa None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:24.945848 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:24.948839 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593a084-2330-4449-9315-b027f7792dbb None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:24.982485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d621d-1607-4d0c-9358-103f2f4ed0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:24.983158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d621d-1607-4d0c-9358-103f2f4ed0da None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:24.983445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d621d-1607-4d0c-9358-103f2f4ed0da None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:24.983724 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d621d-1607-4d0c-9358-103f2f4ed0da None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:24.984471 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d621d-1607-4d0c-9358-103f2f4ed0da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:24.984780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d621d-1607-4d0c-9358-103f2f4ed0da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:24.985588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:24.986241 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d621d-1607-4d0c-9358-103f2f4ed0da None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:24.994054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 222/447] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:24.999558 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d621d-1607-4d0c-9358-103f2f4ed0da None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:25.037898 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 226/448] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:25.043375 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c9782-8663-4772-a0b2-09e3ad0a6cfa None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:25.100102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d621d-1607-4d0c-9358-103f2f4ed0da None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:25.132864 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d1612-5350-4f43-9740-d45c95487ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:25.133545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1612-5350-4f43-9740-d45c95487ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:25.133837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1612-5350-4f43-9740-d45c95487ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:25.134111 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1612-5350-4f43-9740-d45c95487ef7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:25.139964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c9782-8663-4772-a0b2-09e3ad0a6cfa None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:25.163837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:25.174769 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af313f-b5a1-40b9-81b2-1e12115610bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:25.175657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af313f-b5a1-40b9-81b2-1e12115610bc None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:25.175933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af313f-b5a1-40b9-81b2-1e12115610bc None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:25.176201 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af313f-b5a1-40b9-81b2-1e12115610bc None admin] PATH_INFO: `/v3/projects/5ab5b23ebc224a5b9dd9616b70ea67bd` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:25.177403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af313f-b5a1-40b9-81b2-1e12115610bc None admin] RBAC: Authorizing `identity:get_project(project_id=5ab5b23ebc224a5b9dd9616b70ea67bd)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:25.178852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af313f-b5a1-40b9-81b2-1e12115610bc None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:25.180547 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 227/449] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:25 2022] GET /identity/v3/projects/5ab5b23ebc224a5b9dd9616b70ea67bd => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:25.185971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af313f-b5a1-40b9-81b2-1e12115610bc None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:25.202349 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d1612-5350-4f43-9740-d45c95487ef7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:25.203625 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:25.203797 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d1612-5350-4f43-9740-d45c95487ef7 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:25.285967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af313f-b5a1-40b9-81b2-1e12115610bc None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:25.303428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 223/450] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 01 17:25:25.308893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d1612-5350-4f43-9740-d45c95487ef7 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:25.319515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b9512-fe5d-4941-b8ec-9856f285b754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:25.320372 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b9512-fe5d-4941-b8ec-9856f285b754 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:25.320659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b9512-fe5d-4941-b8ec-9856f285b754 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:25.320965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b9512-fe5d-4941-b8ec-9856f285b754 None admin] PATH_INFO: `/v3/groups/498839e88e434983bab97ada0561bb96` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:25.322153 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b9512-fe5d-4941-b8ec-9856f285b754 None admin] RBAC: Authorizing `identity:get_group(group_id=498839e88e434983bab97ada0561bb96)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:25.323597 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b9512-fe5d-4941-b8ec-9856f285b754 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:25.325239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 228/451] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jun 1 17:25:25 2022] GET /identity/v3/groups/498839e88e434983bab97ada0561bb96 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:25.331386 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b9512-fe5d-4941-b8ec-9856f285b754 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:25.370447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:25.408837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d1612-5350-4f43-9740-d45c95487ef7 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:25.413969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:25.429496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b9512-fe5d-4941-b8ec-9856f285b754 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:25.442177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c82fc2-f1f8-48ca-a46e-b6c04d7d5e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:25.442997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c82fc2-f1f8-48ca-a46e-b6c04d7d5e0a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:25.443271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c82fc2-f1f8-48ca-a46e-b6c04d7d5e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:25.443537 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c82fc2-f1f8-48ca-a46e-b6c04d7d5e0a None admin] PATH_INFO: `/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:25.444704 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c82fc2-f1f8-48ca-a46e-b6c04d7d5e0a None admin] RBAC: Authorizing `identity:get_project(project_id=ffa68f0d486f4f77ba4b7a3c537ac4e1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:25.446189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c82fc2-f1f8-48ca-a46e-b6c04d7d5e0a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:25.447868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 224/452] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:25:25 2022] GET /identity/v3/projects/ffa68f0d486f4f77ba4b7a3c537ac4e1 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:25.453093 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c82fc2-f1f8-48ca-a46e-b6c04d7d5e0a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:25.464557 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4cc46-3e0c-4e83-bf53-11189ced8027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:25.465303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4cc46-3e0c-4e83-bf53-11189ced8027 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:25.465584 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4cc46-3e0c-4e83-bf53-11189ced8027 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:25.465860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4cc46-3e0c-4e83-bf53-11189ced8027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:25.466689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4cc46-3e0c-4e83-bf53-11189ced8027 None admin] RBAC: Adding query filter params (group.id=498839e88e434983bab97ada0561bb96, role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=5ab5b23ebc224a5b9dd9616b70ea67bd) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:25.467000 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4cc46-3e0c-4e83-bf53-11189ced8027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:25.468727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4cc46-3e0c-4e83-bf53-11189ced8027 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:25.475496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 229/453] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jun 1 17:25:25 2022] GET /identity/v3/role_assignments?group.id=498839e88e434983bab97ada0561bb96&scope.project.id=5ab5b23ebc224a5b9dd9616b70ea67bd&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:25.562195 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c82fc2-f1f8-48ca-a46e-b6c04d7d5e0a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:25.593407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:25.600086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005922b-5325-4749-9b42-03dbc6f40b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:25.611679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005922b-5325-4749-9b42-03dbc6f40b6f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:25.611679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005922b-5325-4749-9b42-03dbc6f40b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:25.611679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005922b-5325-4749-9b42-03dbc6f40b6f None admin] PATH_INFO: `/v3/groups/833882f81a134c7bab260508b5ef374d` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:25.611679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005922b-5325-4749-9b42-03dbc6f40b6f None admin] RBAC: Authorizing `identity:get_group(group_id=833882f81a134c7bab260508b5ef374d)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:25.611679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005922b-5325-4749-9b42-03dbc6f40b6f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:25.611679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 225/454] 10.222.0.33 () {56 vars in 1180 bytes} [Wed Jun 1 17:25:25 2022] GET /identity/v3/groups/833882f81a134c7bab260508b5ef374d => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:25.612253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4cc46-3e0c-4e83-bf53-11189ced8027 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:25.718084 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4cc46-3e0c-4e83-bf53-11189ced8027 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:25.751617 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82df7ea-bd8a-48ef-908b-54e5aaa3dcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:25.752264 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82df7ea-bd8a-48ef-908b-54e5aaa3dcbf None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:25.752545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82df7ea-bd8a-48ef-908b-54e5aaa3dcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:25.752827 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82df7ea-bd8a-48ef-908b-54e5aaa3dcbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:25.753683 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82df7ea-bd8a-48ef-908b-54e5aaa3dcbf None admin] RBAC: Adding query filter params (group.id=833882f81a134c7bab260508b5ef374d, role.id=58b5b157099e42bcb4ee3eff9aaf2064, scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:25.753995 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82df7ea-bd8a-48ef-908b-54e5aaa3dcbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:25.755463 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82df7ea-bd8a-48ef-908b-54e5aaa3dcbf None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:25.761099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 230/455] 10.222.0.33 () {56 vars in 1376 bytes} [Wed Jun 1 17:25:25 2022] GET /identity/v3/role_assignments?group.id=833882f81a134c7bab260508b5ef374d&scope.project.id=ffa68f0d486f4f77ba4b7a3c537ac4e1&role.id=58b5b157099e42bcb4ee3eff9aaf2064 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:28.485526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c924555-2ced-429d-b0d7-97b9dc940dcc None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:28.486570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c924555-2ced-429d-b0d7-97b9dc940dcc None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:28.487083 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c924555-2ced-429d-b0d7-97b9dc940dcc None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:28.488952 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 226/456] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:28.494005 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded05232-6eef-4581-a2f4-1c949c57b6b7 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:28.494810 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded05232-6eef-4581-a2f4-1c949c57b6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:28.495291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded05232-6eef-4581-a2f4-1c949c57b6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:28.522229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ded05232-6eef-4581-a2f4-1c949c57b6b7 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:28.523874 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ded05232-6eef-4581-a2f4-1c949c57b6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:28.533190 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:28.619868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 231/457] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:28.657310 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c924555-2ced-429d-b0d7-97b9dc940dcc None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:28.730894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c85ae-42dd-4f53-8c08-95fa4ba854b0 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:28.731504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c85ae-42dd-4f53-8c08-95fa4ba854b0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:28.731979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c85ae-42dd-4f53-8c08-95fa4ba854b0 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:28.734734 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 232/458] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:28.739343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fe586-5468-422d-80bd-1eb8ba2f0100 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:28.739852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fe586-5468-422d-80bd-1eb8ba2f0100 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:28.740333 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fe586-5468-422d-80bd-1eb8ba2f0100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:28.790083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-353fe586-5468-422d-80bd-1eb8ba2f0100 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:28.791315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-353fe586-5468-422d-80bd-1eb8ba2f0100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:28.802840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c924555-2ced-429d-b0d7-97b9dc940dcc None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:28.852488 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e18750-c2d4-439b-ad49-4bafad218332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:28.853586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e18750-c2d4-439b-ad49-4bafad218332 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:28.853872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e18750-c2d4-439b-ad49-4bafad218332 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:28.854151 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e18750-c2d4-439b-ad49-4bafad218332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:28.870915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e18750-c2d4-439b-ad49-4bafad218332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:28.872386 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e18750-c2d4-439b-ad49-4bafad218332 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:28.883218 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 233/459] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 01 17:25:28.891485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-96e18750-c2d4-439b-ad49-4bafad218332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:28.891485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:28.891485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:28.891485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:28.891485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:28.891485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:28.891485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:28.891485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:28.891485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:28.891485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:28.891485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:28.891485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:28.891485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:28.891485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:28.891485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:28.892367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:28.893604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:28.893604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:28.893604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:28.893604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:28.893604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 227/460] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:28.898448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fe586-5468-422d-80bd-1eb8ba2f0100 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:28.927361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e18750-c2d4-439b-ad49-4bafad218332 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:28.986328 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:29.005380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:29.029878 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fe586-5468-422d-80bd-1eb8ba2f0100 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:29.039282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e18750-c2d4-439b-ad49-4bafad218332 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:29.068260 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5585f-66ca-420f-8b4b-37ef3a1ad0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:29.069073 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5585f-66ca-420f-8b4b-37ef3a1ad0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:29.069459 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5585f-66ca-420f-8b4b-37ef3a1ad0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:29.069744 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5585f-66ca-420f-8b4b-37ef3a1ad0f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:29.070494 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5585f-66ca-420f-8b4b-37ef3a1ad0f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:29.070807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5585f-66ca-420f-8b4b-37ef3a1ad0f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:29.072441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5585f-66ca-420f-8b4b-37ef3a1ad0f8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:29.077634 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415a2cf-8653-4bc8-9cc7-4d950b2abc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:29.078455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415a2cf-8653-4bc8-9cc7-4d950b2abc9c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:29.078810 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415a2cf-8653-4bc8-9cc7-4d950b2abc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:29.079093 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415a2cf-8653-4bc8-9cc7-4d950b2abc9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:29.087070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 234/461] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:29.088483 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d53bc-1337-428d-9986-734c3b572543 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:29.088777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d53bc-1337-428d-9986-734c3b572543 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:29.089094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d53bc-1337-428d-9986-734c3b572543 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:29.094981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 235/462] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:29.096063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d53bc-1337-428d-9986-734c3b572543 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:29.096911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415a2cf-8653-4bc8-9cc7-4d950b2abc9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:29.098444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415a2cf-8653-4bc8-9cc7-4d950b2abc9c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:29.118648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-9415a2cf-8653-4bc8-9cc7-4d950b2abc9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:29.118648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:29.118648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:29.118648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:29.118648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:29.118648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:29.118648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:29.118648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:29.118648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:29.118648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:29.118648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:29.118648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:29.118648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:29.118648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:29.118648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:29.120783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:29.122895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:29.122895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:29.122895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:29.122895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:29.128962 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 228/463] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:29.128962 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48606fab-ed7e-435d-8f31-a3d051a89ef1 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:29.128962 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48606fab-ed7e-435d-8f31-a3d051a89ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:29.128962 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48606fab-ed7e-435d-8f31-a3d051a89ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:29.146789 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-48606fab-ed7e-435d-8f31-a3d051a89ef1 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:29.148211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-48606fab-ed7e-435d-8f31-a3d051a89ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:29.212663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d53bc-1337-428d-9986-734c3b572543 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:29.222765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 229/464] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:29.223631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48606fab-ed7e-435d-8f31-a3d051a89ef1 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:29.256499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:29.265335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:29.276672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f800ebb-fb6a-47fa-898d-4d1f5ad1d6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:29.284893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f800ebb-fb6a-47fa-898d-4d1f5ad1d6b2 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:29.284893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f800ebb-fb6a-47fa-898d-4d1f5ad1d6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:29.284893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f800ebb-fb6a-47fa-898d-4d1f5ad1d6b2 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:29.284893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f800ebb-fb6a-47fa-898d-4d1f5ad1d6b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:29.284893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f800ebb-fb6a-47fa-898d-4d1f5ad1d6b2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:29.333745 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48606fab-ed7e-435d-8f31-a3d051a89ef1 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:29.371622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 236/465] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:25:29 2022] POST /identity/v3/users => generated 246 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:25:29.372255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f800ebb-fb6a-47fa-898d-4d1f5ad1d6b2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:29.396470 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc628c32-ad42-49d9-8a25-11f7797adf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:29.397195 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc628c32-ad42-49d9-8a25-11f7797adf8c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:29.397481 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc628c32-ad42-49d9-8a25-11f7797adf8c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:29.397762 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc628c32-ad42-49d9-8a25-11f7797adf8c None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:29.398507 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc628c32-ad42-49d9-8a25-11f7797adf8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:29.398816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc628c32-ad42-49d9-8a25-11f7797adf8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:29.400254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc628c32-ad42-49d9-8a25-11f7797adf8c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:29.425107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 230/466] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:29.433824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc628c32-ad42-49d9-8a25-11f7797adf8c None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:29.530794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f800ebb-fb6a-47fa-898d-4d1f5ad1d6b2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:29.570383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fceed-c2f6-4c38-85b2-166eedcb5c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:29.571555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fceed-c2f6-4c38-85b2-166eedcb5c02 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:29.571982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fceed-c2f6-4c38-85b2-166eedcb5c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:29.572434 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fceed-c2f6-4c38-85b2-166eedcb5c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:29.584795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:29.586577 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fceed-c2f6-4c38-85b2-166eedcb5c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:29.588233 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fceed-c2f6-4c38-85b2-166eedcb5c02 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:29.595718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc628c32-ad42-49d9-8a25-11f7797adf8c None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:29.613448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-107fceed-c2f6-4c38-85b2-166eedcb5c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:29.613448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:29.613448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:29.613448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:29.613448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:29.613448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:29.613448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:29.613448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:29.613448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:29.613448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:29.613448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:29.613448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:29.613448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:29.613448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:29.613448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:29.614334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:29.615174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:29.615174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:29.615174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:29.615174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:29.616750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 237/467] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:29.618310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb3e27-a4b7-4eb6-ab9f-ca925976a482 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:29.618792 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb3e27-a4b7-4eb6-ab9f-ca925976a482 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:29.619982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb3e27-a4b7-4eb6-ab9f-ca925976a482 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:29.621469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 238/468] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:29.624902 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb3e27-a4b7-4eb6-ab9f-ca925976a482 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:29.637073 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7bcb1-1370-43fc-a9d4-4397b33564ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:29.637757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7bcb1-1370-43fc-a9d4-4397b33564ee None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:29.638481 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7bcb1-1370-43fc-a9d4-4397b33564ee None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:29.638481 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7bcb1-1370-43fc-a9d4-4397b33564ee None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:29.639008 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7bcb1-1370-43fc-a9d4-4397b33564ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:29.640440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7bcb1-1370-43fc-a9d4-4397b33564ee None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:29.676684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:29.741104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 231/469] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:25:29 2022] POST /identity/v3/users => generated 248 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:25:29.742815 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4911d0-9699-4aad-87bb-0920e1c5b64b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:29.743096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb3e27-a4b7-4eb6-ab9f-ca925976a482 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:29.743235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4911d0-9699-4aad-87bb-0920e1c5b64b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:29.743575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4911d0-9699-4aad-87bb-0920e1c5b64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:29.774476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-ec4911d0-9699-4aad-87bb-0920e1c5b64b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:29.775770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ec4911d0-9699-4aad-87bb-0920e1c5b64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:29.788272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa8ad8-fba0-4033-9089-485857d1afb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:29.788870 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa8ad8-fba0-4033-9089-485857d1afb4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:29.789828 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa8ad8-fba0-4033-9089-485857d1afb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:29.790116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa8ad8-fba0-4033-9089-485857d1afb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:29.791140 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa8ad8-fba0-4033-9089-485857d1afb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:29.791513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa8ad8-fba0-4033-9089-485857d1afb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:29.793057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa8ad8-fba0-4033-9089-485857d1afb4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:29.810029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 239/470] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:29.820215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa8ad8-fba0-4033-9089-485857d1afb4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:29.929774 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 232/471] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:29.973984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4911d0-9699-4aad-87bb-0920e1c5b64b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:30.025904 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:30.029278 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa8ad8-fba0-4033-9089-485857d1afb4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:30.065911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:30.084326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8b2ec-879b-4aed-95bb-1961bfcf8df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:30.085080 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8b2ec-879b-4aed-95bb-1961bfcf8df1 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:30.085419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8b2ec-879b-4aed-95bb-1961bfcf8df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:30.085702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8b2ec-879b-4aed-95bb-1961bfcf8df1 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:30.086419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8b2ec-879b-4aed-95bb-1961bfcf8df1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:30.087942 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8b2ec-879b-4aed-95bb-1961bfcf8df1 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:30.088336 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4911d0-9699-4aad-87bb-0920e1c5b64b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:30.128252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bba05-64ca-4734-a456-30cb3f1f1b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:30.129094 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bba05-64ca-4734-a456-30cb3f1f1b57 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:30.129384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bba05-64ca-4734-a456-30cb3f1f1b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:30.129658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bba05-64ca-4734-a456-30cb3f1f1b57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:30.140283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609bba05-64ca-4734-a456-30cb3f1f1b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:30.141805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609bba05-64ca-4734-a456-30cb3f1f1b57 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:30.161001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-609bba05-64ca-4734-a456-30cb3f1f1b57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:30.161001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:30.161001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:30.161001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:30.161001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:30.161001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:30.161001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:30.161001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:30.161001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:30.161001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:30.161001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:30.161001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:30.161001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:30.161001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:30.161001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:30.166636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:30.167516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:30.167516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:30.167516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:30.167516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:30.167516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 233/472] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:30.168352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bba05-64ca-4734-a456-30cb3f1f1b57 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:30.222776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 240/473] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:25:29 2022] POST /identity/v3/users => generated 248 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:25:30.299257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bba05-64ca-4734-a456-30cb3f1f1b57 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:30.345133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:30.351767 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0b079-958f-4c5d-8a0a-750b7a7bc022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:30.352445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0b079-958f-4c5d-8a0a-750b7a7bc022 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:30.352732 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0b079-958f-4c5d-8a0a-750b7a7bc022 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:30.353344 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0b079-958f-4c5d-8a0a-750b7a7bc022 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:30.354078 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0b079-958f-4c5d-8a0a-750b7a7bc022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:30.354439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0b079-958f-4c5d-8a0a-750b7a7bc022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:30.355822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0b079-958f-4c5d-8a0a-750b7a7bc022 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:30.368792 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 234/474] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:30.374236 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8b2ec-879b-4aed-95bb-1961bfcf8df1 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:30.420975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cb148-eda2-478c-993e-61c6a0b4b026 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:30.420975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cb148-eda2-478c-993e-61c6a0b4b026 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:30.420975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cb148-eda2-478c-993e-61c6a0b4b026 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:30.421489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 235/475] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:30.426749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab3fe2-224d-40b4-af80-04fcc198d355 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:30.427045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab3fe2-224d-40b4-af80-04fcc198d355 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:30.427305 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab3fe2-224d-40b4-af80-04fcc198d355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:30.447987 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-66ab3fe2-224d-40b4-af80-04fcc198d355 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:30.449490 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-66ab3fe2-224d-40b4-af80-04fcc198d355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:30.556826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8b2ec-879b-4aed-95bb-1961bfcf8df1 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:30.561211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 236/476] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:30.587569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab3fe2-224d-40b4-af80-04fcc198d355 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:30.607068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff636e42-763b-47c9-946b-17b7588a24ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:30.607920 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff636e42-763b-47c9-946b-17b7588a24ef None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:30.608203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff636e42-763b-47c9-946b-17b7588a24ef None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:30.608967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff636e42-763b-47c9-946b-17b7588a24ef None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:30.610017 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff636e42-763b-47c9-946b-17b7588a24ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:30.611884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff636e42-763b-47c9-946b-17b7588a24ef None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:30.706732 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab3fe2-224d-40b4-af80-04fcc198d355 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:30.714763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 241/477] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:25:30 2022] POST /identity/v3/users => generated 249 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:25:30.736051 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:30.751540 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6fd4b-cf61-4aea-9305-208155256774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:30.752249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6fd4b-cf61-4aea-9305-208155256774 None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:30.752590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6fd4b-cf61-4aea-9305-208155256774 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:30.752877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6fd4b-cf61-4aea-9305-208155256774 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:30.753724 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6fd4b-cf61-4aea-9305-208155256774 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:30.755248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6fd4b-cf61-4aea-9305-208155256774 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:30.814779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.sql.core [None req-ccb6fd4b-cf61-4aea-9305-208155256774 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 01 17:25:30.814779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 01 17:25:30.814779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [parameters: {'id': 'fc898f862d54451c8c6b1be9472efd44', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 01 17:25:30.814779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80426) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 01 17:25:30.832729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-ccb6fd4b-cf61-4aea-9305-208155256774 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 01 17:25:30.832729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:30.832729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 01 17:25:30.832729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 01 17:25:30.832729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 01 17:25:30.832729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 01 17:25:30.832729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 01 17:25:30.832729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application result = self._query(query) Jun 01 17:25:30.832729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 01 17:25:30.832729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application conn.query(q) Jun 01 17:25:30.832729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 01 17:25:30.832729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 01 17:25:30.832729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 01 17:25:30.832729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application result.read() Jun 01 17:25:30.832729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return ref.to_dict() Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 01 17:25:30.834830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application next(self.gen) Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application yield resource Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application next(self.gen) Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self.session.rollback() Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self.force_reraise() Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise self.value Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application session.commit() Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 01 17:25:30.840363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._prepare_impl() Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self.session.flush() Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._flush(objects) Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application compat.raise_( Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application flush_context.execute() Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rec.execute(self) Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 01 17:25:30.842623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 01 17:25:30.845646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application result = self._query(query) Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application conn.query(q) Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application result.read() Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 01 17:25:30.847932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [parameters: {'id': 'fc898f862d54451c8c6b1be9472efd44', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:30.857913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 01 17:25:30.860208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:30.862416 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 237/478] 10.222.0.33 () {60 vars in 1131 bytes} [Wed Jun 1 17:25:30 2022] POST /identity/v3/roles => generated 144 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:30.862564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff636e42-763b-47c9-946b-17b7588a24ef None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:30.862564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:30.953028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff636e42-763b-47c9-946b-17b7588a24ef None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:30.990694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8173b-d74f-43d4-a73c-8bb1d4a09645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:30.991530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8173b-d74f-43d4-a73c-8bb1d4a09645 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:30.991822 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8173b-d74f-43d4-a73c-8bb1d4a09645 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:30.992112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8173b-d74f-43d4-a73c-8bb1d4a09645 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:31.004282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8173b-d74f-43d4-a73c-8bb1d4a09645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-fff8173b-d74f-43d4-a73c-8bb1d4a09645 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:31.012522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:31.014652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:31.017568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:31.017568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:31.017568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:31.017568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:31.017568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:31.017568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:31.017568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:31.017568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:31.017568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:31.017568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:31.017568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 01 17:25:31.017568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:31.021502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 242/479] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:25:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:31.021640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6fd4b-cf61-4aea-9305-208155256774 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:31.138761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6fd4b-cf61-4aea-9305-208155256774 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:31.175007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af771d1-7888-40ee-8df5-9c4be285b62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:31.175675 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af771d1-7888-40ee-8df5-9c4be285b62d None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:31.175955 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af771d1-7888-40ee-8df5-9c4be285b62d None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:31.176228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af771d1-7888-40ee-8df5-9c4be285b62d None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:31.176995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af771d1-7888-40ee-8df5-9c4be285b62d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:31.177306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af771d1-7888-40ee-8df5-9c4be285b62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:31.178732 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af771d1-7888-40ee-8df5-9c4be285b62d None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:31.187927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 238/480] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:32.041412 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5be6c0-7730-4cd0-b27d-31499b947652 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:32.041412 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5be6c0-7730-4cd0-b27d-31499b947652 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:32.041412 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5be6c0-7730-4cd0-b27d-31499b947652 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:32.041412 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 243/481] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:32.049976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aa688-45d5-4c66-9764-beb7deed2fa9 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:32.049976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aa688-45d5-4c66-9764-beb7deed2fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:32.049976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aa688-45d5-4c66-9764-beb7deed2fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:32.073923 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-a79aa688-45d5-4c66-9764-beb7deed2fa9 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:32.075450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a79aa688-45d5-4c66-9764-beb7deed2fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:32.133331 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:32.167370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 239/482] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:32.193968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5be6c0-7730-4cd0-b27d-31499b947652 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:32.295568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:32.333587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5be6c0-7730-4cd0-b27d-31499b947652 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:32.376374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98fb4d-f266-461d-9141-d0f9019f8600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:32.377634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98fb4d-f266-461d-9141-d0f9019f8600 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:32.378143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98fb4d-f266-461d-9141-d0f9019f8600 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:32.378630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98fb4d-f266-461d-9141-d0f9019f8600 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:32.390709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98fb4d-f266-461d-9141-d0f9019f8600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-ca98fb4d-f266-461d-9141-d0f9019f8600 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:32.399418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:32.400285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:32.401203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:32.401203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:32.401203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:32.401203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:32.401203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:32.401203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:32.401203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:32.401203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:32.401203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:32.401203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:32.401203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:32.401203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:32.403838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 244/483] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:32.410542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79aa688-45d5-4c66-9764-beb7deed2fa9 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:32.548593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79aa688-45d5-4c66-9764-beb7deed2fa9 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:32.600458 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d24231-2ad3-48c0-a5ed-a1439d59ed01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:32.601170 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24231-2ad3-48c0-a5ed-a1439d59ed01 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:32.601458 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24231-2ad3-48c0-a5ed-a1439d59ed01 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:32.601737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24231-2ad3-48c0-a5ed-a1439d59ed01 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:32.602497 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d24231-2ad3-48c0-a5ed-a1439d59ed01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:32.603058 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d24231-2ad3-48c0-a5ed-a1439d59ed01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:32.604445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d24231-2ad3-48c0-a5ed-a1439d59ed01 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:32.616206 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 240/484] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:32.621661 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98fb4d-f266-461d-9141-d0f9019f8600 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:32.749115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98fb4d-f266-461d-9141-d0f9019f8600 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:32.777562 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3af428-3aea-49a2-b62e-04fad994170a None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:32.777954 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3af428-3aea-49a2-b62e-04fad994170a None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:32.778234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3af428-3aea-49a2-b62e-04fad994170a None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:32.780065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 241/485] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:32.785406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:32.787402 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b88d5-0359-4e7e-bc86-19d733ddeafd None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:32.787858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b88d5-0359-4e7e-bc86-19d733ddeafd None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:32.788055 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6f78d-099d-4c84-9558-c4c1c958d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:32.788460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b88d5-0359-4e7e-bc86-19d733ddeafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:32.788897 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6f78d-099d-4c84-9558-c4c1c958d6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:32.789242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6f78d-099d-4c84-9558-c4c1c958d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:32.789518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6f78d-099d-4c84-9558-c4c1c958d6a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:32.802582 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6f78d-099d-4c84-9558-c4c1c958d6a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:32.804002 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6f78d-099d-4c84-9558-c4c1c958d6a8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:32.822196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-14c6f78d-099d-4c84-9558-c4c1c958d6a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:32.822196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:32.822196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:32.822196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:32.822196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:32.822196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:32.822196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:32.822196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:32.822196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:32.822196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:32.822196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:32.822196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:32.822196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:32.822196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:32.822196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:32.823307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:32.824350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:32.824350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:32.824350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:32.824350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:32.824350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 245/486] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:32.825787 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-458b88d5-0359-4e7e-bc86-19d733ddeafd None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:32.827113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-458b88d5-0359-4e7e-bc86-19d733ddeafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:32.830938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6f78d-099d-4c84-9558-c4c1c958d6a8 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:32.884984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:32.950681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 242/487] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:32.982144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6f78d-099d-4c84-9558-c4c1c958d6a8 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:32.991302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b88d5-0359-4e7e-bc86-19d733ddeafd None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:33.057393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1db00d-e715-4be4-8046-f45d3dc11d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:33.057393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1db00d-e715-4be4-8046-f45d3dc11d4a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:33.057393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1db00d-e715-4be4-8046-f45d3dc11d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:33.057393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1db00d-e715-4be4-8046-f45d3dc11d4a None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:33.058097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1db00d-e715-4be4-8046-f45d3dc11d4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:33.058181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1db00d-e715-4be4-8046-f45d3dc11d4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:33.059530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1db00d-e715-4be4-8046-f45d3dc11d4a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:33.087156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 246/488] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:33.092358 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1db00d-e715-4be4-8046-f45d3dc11d4a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:33.186077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:33.192296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b88d5-0359-4e7e-bc86-19d733ddeafd None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:33.233765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae90810-ffb2-44cc-b535-c98e1d5f6727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:33.235028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae90810-ffb2-44cc-b535-c98e1d5f6727 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:33.235536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae90810-ffb2-44cc-b535-c98e1d5f6727 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:33.236069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae90810-ffb2-44cc-b535-c98e1d5f6727 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:33.246888 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae90810-ffb2-44cc-b535-c98e1d5f6727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:33.252456 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1db00d-e715-4be4-8046-f45d3dc11d4a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-cae90810-ffb2-44cc-b535-c98e1d5f6727 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:33.255908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:33.256813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:33.257653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:33.257653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:33.257653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:33.257653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:33.257653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:33.257653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:33.257653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:33.257653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:33.257653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:33.257653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:33.257653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:33.257653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:33.264820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 243/489] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:33.267016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99fe7c-6a94-460d-81f5-576db8391f55 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:33.267572 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99fe7c-6a94-460d-81f5-576db8391f55 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:33.268062 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99fe7c-6a94-460d-81f5-576db8391f55 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:33.269729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 244/490] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:33.270740 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99fe7c-6a94-460d-81f5-576db8391f55 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:33.290055 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed85c79-5e75-47e8-b949-b253621c1138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:33.290855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed85c79-5e75-47e8-b949-b253621c1138 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:33.291143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed85c79-5e75-47e8-b949-b253621c1138 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:33.291425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed85c79-5e75-47e8-b949-b253621c1138 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:33.299162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed85c79-5e75-47e8-b949-b253621c1138 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:33.300627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed85c79-5e75-47e8-b949-b253621c1138 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:33.313764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-3ed85c79-5e75-47e8-b949-b253621c1138 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:33.317692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:33.318601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:33.319536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:33.319536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:33.319536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:33.319536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:33.319536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:33.319536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:33.319536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:33.319536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:33.319536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:25:33.319536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:33.319536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 247/491] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jun 1 17:25:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:33.320636 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eef2d-369c-4a16-aae6-3dcd613f8c48 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:33.320821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eef2d-369c-4a16-aae6-3dcd613f8c48 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:33.321125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310eef2d-369c-4a16-aae6-3dcd613f8c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:33.339083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-310eef2d-369c-4a16-aae6-3dcd613f8c48 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:33.340289 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-310eef2d-369c-4a16-aae6-3dcd613f8c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:33.393460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99fe7c-6a94-460d-81f5-576db8391f55 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:33.420513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 248/492] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:33.421486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eef2d-369c-4a16-aae6-3dcd613f8c48 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:33.439558 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137e443-5f4f-4752-aac5-227b6b1e56ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:33.440908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137e443-5f4f-4752-aac5-227b6b1e56ae None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:33.441459 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137e443-5f4f-4752-aac5-227b6b1e56ae None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:33.442502 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137e443-5f4f-4752-aac5-227b6b1e56ae None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:33.443568 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137e443-5f4f-4752-aac5-227b6b1e56ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:33.444112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137e443-5f4f-4752-aac5-227b6b1e56ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:33.446604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137e443-5f4f-4752-aac5-227b6b1e56ae None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:33.466897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 245/493] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:33.472967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:33.474233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137e443-5f4f-4752-aac5-227b6b1e56ae None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:33.563929 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310eef2d-369c-4a16-aae6-3dcd613f8c48 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:33.581426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:33.591670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137e443-5f4f-4752-aac5-227b6b1e56ae None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:33.609806 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443936c7-0a1c-44fb-85bd-2eb2581f3c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:33.611116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443936c7-0a1c-44fb-85bd-2eb2581f3c5c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:33.611657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443936c7-0a1c-44fb-85bd-2eb2581f3c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:33.612145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443936c7-0a1c-44fb-85bd-2eb2581f3c5c None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:33.613720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443936c7-0a1c-44fb-85bd-2eb2581f3c5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:33.614389 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443936c7-0a1c-44fb-85bd-2eb2581f3c5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:33.616354 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443936c7-0a1c-44fb-85bd-2eb2581f3c5c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:33.627404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd35e1-b1d3-4ff5-9c69-974496f9c931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:33.628220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd35e1-b1d3-4ff5-9c69-974496f9c931 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:33.628508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd35e1-b1d3-4ff5-9c69-974496f9c931 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:33.628790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd35e1-b1d3-4ff5-9c69-974496f9c931 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:33.647056 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd35e1-b1d3-4ff5-9c69-974496f9c931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-61dd35e1-b1d3-4ff5-9c69-974496f9c931 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:33.654959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:33.655858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:33.657286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:33.657286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:33.657286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:33.657286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:33.657286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:33.657286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:33.657286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:33.657286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:33.657286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:33.657286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:33.657286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:33.657286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:33.661712 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 246/494] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:33.662624 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd35e1-b1d3-4ff5-9c69-974496f9c931 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:33.668852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 249/495] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jun 1 17:25:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:33.670066 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443936c7-0a1c-44fb-85bd-2eb2581f3c5c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:33.774276 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd35e1-b1d3-4ff5-9c69-974496f9c931 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:33.799251 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:33.808734 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443936c7-0a1c-44fb-85bd-2eb2581f3c5c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:33.811323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6134764-ae14-4c09-803a-2dbdacbbe197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:33.812193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6134764-ae14-4c09-803a-2dbdacbbe197 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:33.812482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6134764-ae14-4c09-803a-2dbdacbbe197 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:33.812759 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6134764-ae14-4c09-803a-2dbdacbbe197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:33.824279 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6134764-ae14-4c09-803a-2dbdacbbe197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:33.825710 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6134764-ae14-4c09-803a-2dbdacbbe197 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:33.846367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-b6134764-ae14-4c09-803a-2dbdacbbe197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:33.846367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:33.846367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:33.846367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:33.846367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:33.846367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:33.846367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:33.846367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:33.846367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:33.846367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:33.846367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:33.846367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:33.846367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:33.846367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:33.846367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:33.847271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:33.853604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:33.853604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:33.853604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:33.853604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:33.853819 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfe29e-83ce-4d07-b14b-803c8f77134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:33.853819 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe29e-83ce-4d07-b14b-803c8f77134c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:33.853819 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe29e-83ce-4d07-b14b-803c8f77134c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:33.854035 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 247/496] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:33.854113 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe29e-83ce-4d07-b14b-803c8f77134c None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:33.854183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6134764-ae14-4c09-803a-2dbdacbbe197 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:33.854255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfe29e-83ce-4d07-b14b-803c8f77134c None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:33.854255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfe29e-83ce-4d07-b14b-803c8f77134c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:33.854255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfe29e-83ce-4d07-b14b-803c8f77134c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:33.855561 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:33.862545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 250/497] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:33.868034 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664b637-cebb-4060-bbb4-48367530197e None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:33.868325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664b637-cebb-4060-bbb4-48367530197e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:33.868601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664b637-cebb-4060-bbb4-48367530197e None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:33.870047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 251/498] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:33.870617 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664b637-cebb-4060-bbb4-48367530197e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:33.972563 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6134764-ae14-4c09-803a-2dbdacbbe197 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:34.009041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffaf6b-afd2-45a7-bdb4-41dae9c2aa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:34.009700 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffaf6b-afd2-45a7-bdb4-41dae9c2aa6c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:34.009985 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffaf6b-afd2-45a7-bdb4-41dae9c2aa6c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:34.010261 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffaf6b-afd2-45a7-bdb4-41dae9c2aa6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:34.087163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffaf6b-afd2-45a7-bdb4-41dae9c2aa6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:34.088908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffaf6b-afd2-45a7-bdb4-41dae9c2aa6c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:34.091113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:34.107335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664b637-cebb-4060-bbb4-48367530197e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:34.143587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227a672-f74e-4286-8aeb-1a349e10f71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:34.144327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227a672-f74e-4286-8aeb-1a349e10f71e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:34.144617 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227a672-f74e-4286-8aeb-1a349e10f71e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:34.144893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227a672-f74e-4286-8aeb-1a349e10f71e None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:34.145642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227a672-f74e-4286-8aeb-1a349e10f71e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:34.146067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227a672-f74e-4286-8aeb-1a349e10f71e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:34.147463 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227a672-f74e-4286-8aeb-1a349e10f71e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:34.160336 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 252/499] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:34.161189 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227a672-f74e-4286-8aeb-1a349e10f71e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:34.179835 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:34.205333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 248/500] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:34.205333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890ce2a-7a9a-4fdd-abed-09767d306234 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:34.205333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890ce2a-7a9a-4fdd-abed-09767d306234 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:34.205333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890ce2a-7a9a-4fdd-abed-09767d306234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:34.222003 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-6890ce2a-7a9a-4fdd-abed-09767d306234 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:34.223408 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6890ce2a-7a9a-4fdd-abed-09767d306234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:34.268143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227a672-f74e-4286-8aeb-1a349e10f71e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:34.306968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82da38d-e84a-4570-bced-30599e94b168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:34.307800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82da38d-e84a-4570-bced-30599e94b168 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:34.308088 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82da38d-e84a-4570-bced-30599e94b168 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:34.308369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82da38d-e84a-4570-bced-30599e94b168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:34.320509 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82da38d-e84a-4570-bced-30599e94b168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:34.322044 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82da38d-e84a-4570-bced-30599e94b168 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:34.341377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-d82da38d-e84a-4570-bced-30599e94b168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:34.341377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:34.341377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:34.341377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:34.341377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:34.341377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:34.341377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:34.341377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:34.341377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:34.341377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:34.341377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:34.341377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:34.341377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:34.341377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:34.341377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:34.342328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:34.343482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:34.343482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:34.343482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:34.343482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:34.343482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 253/501] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:34.343922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82da38d-e84a-4570-bced-30599e94b168 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:34.412976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:34.414013 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 249/502] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:34.415121 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890ce2a-7a9a-4fdd-abed-09767d306234 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:34.446005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:34.462522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82da38d-e84a-4570-bced-30599e94b168 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:34.497554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba006d-c567-4ce2-8c60-f1d799cc18b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:34.498357 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba006d-c567-4ce2-8c60-f1d799cc18b0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:34.498644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba006d-c567-4ce2-8c60-f1d799cc18b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:34.498927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba006d-c567-4ce2-8c60-f1d799cc18b0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:34.506786 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba006d-c567-4ce2-8c60-f1d799cc18b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:34.508253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba006d-c567-4ce2-8c60-f1d799cc18b0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:34.513928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890ce2a-7a9a-4fdd-abed-09767d306234 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-f2ba006d-c567-4ce2-8c60-f1d799cc18b0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:34.522803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:34.523797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:34.524749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:34.524749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:34.524749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:34.524749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:34.524749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:34.524749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:34.524749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:34.524749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:34.524749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 01 17:25:34.524749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:34.524749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 254/503] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:34.525453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e4fd3-4ce0-4a27-9d03-69b02cb5313a None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:34.525768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e4fd3-4ce0-4a27-9d03-69b02cb5313a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:34.526185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e4fd3-4ce0-4a27-9d03-69b02cb5313a None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:34.527344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 255/504] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:34.528654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e4fd3-4ce0-4a27-9d03-69b02cb5313a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:34.551568 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee08eb-084d-4cd3-ab8d-d0fb2b7f2499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:34.552363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee08eb-084d-4cd3-ab8d-d0fb2b7f2499 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:34.552646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee08eb-084d-4cd3-ab8d-d0fb2b7f2499 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:34.552924 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee08eb-084d-4cd3-ab8d-d0fb2b7f2499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:34.563440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee08eb-084d-4cd3-ab8d-d0fb2b7f2499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:34.564909 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee08eb-084d-4cd3-ab8d-d0fb2b7f2499 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:34.582981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-a7ee08eb-084d-4cd3-ab8d-d0fb2b7f2499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:34.582981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:34.582981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:34.582981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:34.582981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:34.582981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:34.582981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:34.582981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:34.582981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:34.582981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:34.582981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:34.582981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:34.582981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:34.582981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:34.582981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:34.583884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:34.584737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:34.584737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:34.584737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:34.584737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:34.584737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 250/505] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:34.585586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee08eb-084d-4cd3-ab8d-d0fb2b7f2499 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:34.633624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e4fd3-4ce0-4a27-9d03-69b02cb5313a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:34.659972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:34.668858 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9a837-afc2-4952-b3c0-0d535642cc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:34.669560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9a837-afc2-4952-b3c0-0d535642cc4c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:34.669846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9a837-afc2-4952-b3c0-0d535642cc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:34.670128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9a837-afc2-4952-b3c0-0d535642cc4c None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:34.670848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9a837-afc2-4952-b3c0-0d535642cc4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:34.671159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9a837-afc2-4952-b3c0-0d535642cc4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:34.672633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9a837-afc2-4952-b3c0-0d535642cc4c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:34.676149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:34.684365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 256/506] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:34.685193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9a837-afc2-4952-b3c0-0d535642cc4c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:34.691998 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee08eb-084d-4cd3-ab8d-d0fb2b7f2499 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:34.725986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ea7e1-ed1d-465f-a66e-d616c705d818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:34.726788 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ea7e1-ed1d-465f-a66e-d616c705d818 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:34.727076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ea7e1-ed1d-465f-a66e-d616c705d818 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:34.727358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ea7e1-ed1d-465f-a66e-d616c705d818 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:34.738306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ea7e1-ed1d-465f-a66e-d616c705d818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-e39ea7e1-ed1d-465f-a66e-d616c705d818 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:34.746085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:34.747052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:34.747889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:34.747889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:34.747889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:34.747889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:34.747889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:34.747889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:34.747889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:34.747889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:34.747889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:34.747889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:34.747889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:34.747889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:34.747889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 251/507] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:34.748576 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62130d26-3921-4e39-b8f9-9f37741b6b66 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:34.748860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62130d26-3921-4e39-b8f9-9f37741b6b66 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:34.749130 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62130d26-3921-4e39-b8f9-9f37741b6b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:34.765523 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-62130d26-3921-4e39-b8f9-9f37741b6b66 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:34.767262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-62130d26-3921-4e39-b8f9-9f37741b6b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:34.794832 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9a837-afc2-4952-b3c0-0d535642cc4c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:34.831230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d151e-75f4-4268-9e57-b55c98fe39eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:34.831902 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d151e-75f4-4268-9e57-b55c98fe39eb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:34.832186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d151e-75f4-4268-9e57-b55c98fe39eb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:34.832474 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d151e-75f4-4268-9e57-b55c98fe39eb None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:34.833339 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d151e-75f4-4268-9e57-b55c98fe39eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:34.833651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d151e-75f4-4268-9e57-b55c98fe39eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:34.834609 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 252/508] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:34.835093 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d151e-75f4-4268-9e57-b55c98fe39eb None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:34.835499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62130d26-3921-4e39-b8f9-9f37741b6b66 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:34.862587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 257/509] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Jun 1 17:25:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:34.863423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d151e-75f4-4268-9e57-b55c98fe39eb None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:34.909259 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:34.910736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:34.935446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62130d26-3921-4e39-b8f9-9f37741b6b66 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:34.961915 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d151e-75f4-4268-9e57-b55c98fe39eb None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:34.967794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9d48b-00e9-44d8-afbe-462532b7a002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:34.968458 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9d48b-00e9-44d8-afbe-462532b7a002 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:34.968734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9d48b-00e9-44d8-afbe-462532b7a002 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:34.969653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9d48b-00e9-44d8-afbe-462532b7a002 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:34.970522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9d48b-00e9-44d8-afbe-462532b7a002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:34.970826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9d48b-00e9-44d8-afbe-462532b7a002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:34.972230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9d48b-00e9-44d8-afbe-462532b7a002 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:34.983918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 253/510] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:34.985441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9d48b-00e9-44d8-afbe-462532b7a002 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:34.996776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07b3a-46d5-4153-8087-f9006753c51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:34.997600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07b3a-46d5-4153-8087-f9006753c51e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:34.997885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07b3a-46d5-4153-8087-f9006753c51e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:34.998160 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07b3a-46d5-4153-8087-f9006753c51e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:35.005621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd07b3a-46d5-4153-8087-f9006753c51e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:35.007060 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd07b3a-46d5-4153-8087-f9006753c51e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-fdd07b3a-46d5-4153-8087-f9006753c51e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:35.021327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:35.022228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:35.023144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:35.023144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:35.023144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:35.023144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:35.023144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:35.023144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:35.023144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:35.023144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:35.023144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 17:25:35.023144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:35.023144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 258/511] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:35.024059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07b3a-46d5-4153-8087-f9006753c51e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:35.087112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9d48b-00e9-44d8-afbe-462532b7a002 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:35.120405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31958fd8-9fb9-42a0-9ad3-f2260fcb1942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:35.121106 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31958fd8-9fb9-42a0-9ad3-f2260fcb1942 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:35.121399 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31958fd8-9fb9-42a0-9ad3-f2260fcb1942 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:35.121680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31958fd8-9fb9-42a0-9ad3-f2260fcb1942 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:35.122429 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31958fd8-9fb9-42a0-9ad3-f2260fcb1942 None admin] RBAC: Adding query filter params (name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:35.122518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07b3a-46d5-4153-8087-f9006753c51e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:35.122943 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31958fd8-9fb9-42a0-9ad3-f2260fcb1942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:35.124118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31958fd8-9fb9-42a0-9ad3-f2260fcb1942 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:35.124724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:35.125994 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:35.133855 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 254/512] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:35.134649 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31958fd8-9fb9-42a0-9ad3-f2260fcb1942 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:35.157726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89075340-2c31-42fa-893a-a7844e31f98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:35.158522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89075340-2c31-42fa-893a-a7844e31f98a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:35.158810 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89075340-2c31-42fa-893a-a7844e31f98a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:35.159090 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89075340-2c31-42fa-893a-a7844e31f98a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:35.171334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89075340-2c31-42fa-893a-a7844e31f98a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:35.171681 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89075340-2c31-42fa-893a-a7844e31f98a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:35.191610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-89075340-2c31-42fa-893a-a7844e31f98a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:35.191610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:35.191610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:35.191610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:35.191610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:35.191610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:35.191610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:35.191610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:35.191610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:35.191610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:35.191610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:35.191610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:35.191610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:35.191610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:35.191610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:35.192643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:35.193732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:35.193732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:35.193732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:35.193732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:35.193732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 259/513] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:35.193732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89075340-2c31-42fa-893a-a7844e31f98a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:35.238881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31958fd8-9fb9-42a0-9ad3-f2260fcb1942 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:35.272752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ce1a7-3d88-4a48-9c20-64d8dc7280b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:35.273417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ce1a7-3d88-4a48-9c20-64d8dc7280b2 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:35.273697 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ce1a7-3d88-4a48-9c20-64d8dc7280b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:35.273971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ce1a7-3d88-4a48-9c20-64d8dc7280b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:35.291199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89075340-2c31-42fa-893a-a7844e31f98a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:35.326362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99954267-7384-47ae-bd33-c8c1287a60cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:35.327150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99954267-7384-47ae-bd33-c8c1287a60cc None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:35.327436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99954267-7384-47ae-bd33-c8c1287a60cc None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:35.327715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99954267-7384-47ae-bd33-c8c1287a60cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:35.334426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:35.334580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99954267-7384-47ae-bd33-c8c1287a60cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:35.336022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99954267-7384-47ae-bd33-c8c1287a60cc None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:35.340893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ce1a7-3d88-4a48-9c20-64d8dc7280b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:35.342493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ce1a7-3d88-4a48-9c20-64d8dc7280b2 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:35.350800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-99954267-7384-47ae-bd33-c8c1287a60cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:35.350800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:35.350800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:35.350800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:35.350800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:35.350800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:35.350800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:35.350800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:35.350800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:35.350800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:35.350800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:35.350800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:35.350800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:35.350800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:35.350800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:35.351665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:35.352521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:35.352521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:35.352521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:35.352521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:35.352521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:35.352521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:35.352521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:35.352521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:35.352521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 260/514] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:35.354033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99954267-7384-47ae-bd33-c8c1287a60cc None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:35.373213 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:35.442469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 255/515] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:35.443246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ce1a7-3d88-4a48-9c20-64d8dc7280b2 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:35.458531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99954267-7384-47ae-bd33-c8c1287a60cc None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:35.494362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be31a7-07c8-4719-9a4b-972e5c03571f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:35.495044 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be31a7-07c8-4719-9a4b-972e5c03571f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:35.495329 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be31a7-07c8-4719-9a4b-972e5c03571f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:35.495606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be31a7-07c8-4719-9a4b-972e5c03571f None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:35.496445 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be31a7-07c8-4719-9a4b-972e5c03571f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:35.496757 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be31a7-07c8-4719-9a4b-972e5c03571f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:35.498226 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be31a7-07c8-4719-9a4b-972e5c03571f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:35.515354 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 261/516] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Jun 1 17:25:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:35.515976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be31a7-07c8-4719-9a4b-972e5c03571f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:35.538457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:35.544025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ce1a7-3d88-4a48-9c20-64d8dc7280b2 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:35.578957 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddedb92-c8b3-48c7-8f4e-fe25998939d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:35.579757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddedb92-c8b3-48c7-8f4e-fe25998939d0 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:35.580041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddedb92-c8b3-48c7-8f4e-fe25998939d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:35.580335 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddedb92-c8b3-48c7-8f4e-fe25998939d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:35.590378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddedb92-c8b3-48c7-8f4e-fe25998939d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:35.591132 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:35.591834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddedb92-c8b3-48c7-8f4e-fe25998939d0 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:35.610984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-0ddedb92-c8b3-48c7-8f4e-fe25998939d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:35.610984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:35.610984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:35.610984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:35.610984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:35.610984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:35.610984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:35.610984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:35.610984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:35.610984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:35.610984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:35.610984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:35.610984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:35.610984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:35.610984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:35.617372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:35.618411 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:35.618411 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:35.618411 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:35.618411 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:35.618411 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 256/517] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:35.618411 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddedb92-c8b3-48c7-8f4e-fe25998939d0 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:35.623685 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be31a7-07c8-4719-9a4b-972e5c03571f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:35.659328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2ebc8-5b6f-4d9b-ae84-5201c8afae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:35.660002 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2ebc8-5b6f-4d9b-ae84-5201c8afae12 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:35.660293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2ebc8-5b6f-4d9b-ae84-5201c8afae12 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:35.660579 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2ebc8-5b6f-4d9b-ae84-5201c8afae12 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:35.661340 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2ebc8-5b6f-4d9b-ae84-5201c8afae12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:35.661660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2ebc8-5b6f-4d9b-ae84-5201c8afae12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:35.663045 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2ebc8-5b6f-4d9b-ae84-5201c8afae12 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:35.675221 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 262/518] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:35.681402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2ebc8-5b6f-4d9b-ae84-5201c8afae12 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:35.721187 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddedb92-c8b3-48c7-8f4e-fe25998939d0 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:35.756506 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342b296-693b-4f7b-89a3-87244c92dfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:35.757196 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342b296-693b-4f7b-89a3-87244c92dfa9 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:35.757493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342b296-693b-4f7b-89a3-87244c92dfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:35.757775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342b296-693b-4f7b-89a3-87244c92dfa9 None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:35.758557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342b296-693b-4f7b-89a3-87244c92dfa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:35.758873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342b296-693b-4f7b-89a3-87244c92dfa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:35.760305 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342b296-693b-4f7b-89a3-87244c92dfa9 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:35.776075 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2ebc8-5b6f-4d9b-ae84-5201c8afae12 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:35.778363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 257/519] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:35.779254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342b296-693b-4f7b-89a3-87244c92dfa9 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:35.793496 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:35.809578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bbc06-2ae2-45da-963f-993a18a4c4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:35.810382 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bbc06-2ae2-45da-963f-993a18a4c4ed None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:35.810667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bbc06-2ae2-45da-963f-993a18a4c4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:35.810952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bbc06-2ae2-45da-963f-993a18a4c4ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:35.812883 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:35.821895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bbc06-2ae2-45da-963f-993a18a4c4ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:35.823345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bbc06-2ae2-45da-963f-993a18a4c4ed None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:35.840845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-4f9bbc06-2ae2-45da-963f-993a18a4c4ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:35.840845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:35.840845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:35.840845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:35.840845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:35.840845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:35.840845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:35.840845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:35.840845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:35.840845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:35.840845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:35.840845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:35.840845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:35.840845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:35.840845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:35.842225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:35.843125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:35.843125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:35.843125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:35.843125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:35.843125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 263/520] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:35.843125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bbc06-2ae2-45da-963f-993a18a4c4ed None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:35.887626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342b296-693b-4f7b-89a3-87244c92dfa9 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:35.923062 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defcec4-6530-4a9e-8f86-6671d58a14dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:35.923719 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defcec4-6530-4a9e-8f86-6671d58a14dd None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:35.923997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defcec4-6530-4a9e-8f86-6671d58a14dd None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:35.924275 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defcec4-6530-4a9e-8f86-6671d58a14dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:35.946707 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bbc06-2ae2-45da-963f-993a18a4c4ed None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:35.980677 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba663a3a-877d-4765-915a-21ef11d398b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:35.981303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba663a3a-877d-4765-915a-21ef11d398b0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:35.981585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba663a3a-877d-4765-915a-21ef11d398b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:35.981867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba663a3a-877d-4765-915a-21ef11d398b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:35.982590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba663a3a-877d-4765-915a-21ef11d398b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:35.982895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba663a3a-877d-4765-915a-21ef11d398b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:35.984274 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba663a3a-877d-4765-915a-21ef11d398b0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:35.990873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defcec4-6530-4a9e-8f86-6671d58a14dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:35.992322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defcec4-6530-4a9e-8f86-6671d58a14dd None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:35.996662 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 264/521] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:35.997491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba663a3a-877d-4765-915a-21ef11d398b0 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:36.004508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:36.043855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:36.092891 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 258/522] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:36.093758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defcec4-6530-4a9e-8f86-6671d58a14dd None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:36.100427 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba663a3a-877d-4765-915a-21ef11d398b0 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:36.135813 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71338935-e8eb-4263-8085-372ee6beec85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:36.136487 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71338935-e8eb-4263-8085-372ee6beec85 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:36.136770 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71338935-e8eb-4263-8085-372ee6beec85 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:36.137162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71338935-e8eb-4263-8085-372ee6beec85 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:36.137770 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71338935-e8eb-4263-8085-372ee6beec85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:36.139205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71338935-e8eb-4263-8085-372ee6beec85 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:36.192670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defcec4-6530-4a9e-8f86-6671d58a14dd None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:36.201668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:36.226319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd94b9-6819-4487-a043-d3dd8462da01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:36.226975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd94b9-6819-4487-a043-d3dd8462da01 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:36.227262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd94b9-6819-4487-a043-d3dd8462da01 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:36.227805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd94b9-6819-4487-a043-d3dd8462da01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:36.228635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd94b9-6819-4487-a043-d3dd8462da01 None admin] RBAC: Adding query filter params (role.id=97f88c6182044737a47af038d94a74b8, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=5d5a5ba6aecd46e79dc7199589384a4f) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:36.228974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd94b9-6819-4487-a043-d3dd8462da01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:36.230476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd94b9-6819-4487-a043-d3dd8462da01 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:36.236163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 259/523] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:25:36 2022] GET /identity/v3/role_assignments?user.id=5d5a5ba6aecd46e79dc7199589384a4f&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=97f88c6182044737a47af038d94a74b8 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:36.236883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd94b9-6819-4487-a043-d3dd8462da01 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:36.276975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 265/524] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:25:35 2022] POST /identity/v3/users => generated 247 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:25:36.276975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71338935-e8eb-4263-8085-372ee6beec85 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:36.377442 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd94b9-6819-4487-a043-d3dd8462da01 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:36.408540 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71338935-e8eb-4263-8085-372ee6beec85 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:36.410531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:36.418523 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824a3d4-18e3-4a88-90ab-2e1d03df68e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:36.419224 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824a3d4-18e3-4a88-90ab-2e1d03df68e7 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:36.419515 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824a3d4-18e3-4a88-90ab-2e1d03df68e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:36.419800 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824a3d4-18e3-4a88-90ab-2e1d03df68e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:36.420636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824a3d4-18e3-4a88-90ab-2e1d03df68e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:36.420993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824a3d4-18e3-4a88-90ab-2e1d03df68e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:36.423160 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824a3d4-18e3-4a88-90ab-2e1d03df68e7 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:36.437446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 260/525] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:36.439182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824a3d4-18e3-4a88-90ab-2e1d03df68e7 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:36.451175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d2d58-f264-4c49-b45d-775c36efce8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:36.452004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d2d58-f264-4c49-b45d-775c36efce8e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:36.452316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d2d58-f264-4c49-b45d-775c36efce8e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:36.452664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d2d58-f264-4c49-b45d-775c36efce8e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:36.467424 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d2d58-f264-4c49-b45d-775c36efce8e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:36.469323 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d2d58-f264-4c49-b45d-775c36efce8e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:36.475454 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-552d2d58-f264-4c49-b45d-775c36efce8e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:36.487306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:36.488228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:36.490511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:36.490511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:36.490511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:36.490511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:36.490511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:36.490511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:36.490511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:36.490511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:36.490511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 01 17:25:36.490511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:36.490511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 266/526] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:36.490511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d2d58-f264-4c49-b45d-775c36efce8e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:36.555116 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824a3d4-18e3-4a88-90ab-2e1d03df68e7 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:36.598812 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dd59a-a0dc-4f94-aee9-5872b80598b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:36.599621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dd59a-a0dc-4f94-aee9-5872b80598b0 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:36.600003 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dd59a-a0dc-4f94-aee9-5872b80598b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:36.600285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dd59a-a0dc-4f94-aee9-5872b80598b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:36.612670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dd59a-a0dc-4f94-aee9-5872b80598b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:36.614243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dd59a-a0dc-4f94-aee9-5872b80598b0 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:36.624821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d2d58-f264-4c49-b45d-775c36efce8e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:36.634600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-631dd59a-a0dc-4f94-aee9-5872b80598b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:36.634600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:36.634600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:36.634600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:36.634600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:36.634600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:36.634600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:36.634600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:36.634600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:36.634600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:36.634600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:36.634600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:36.634600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:36.634600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:36.634600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:36.635473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:36.636322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:36.636322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:36.636322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:36.636322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:36.636322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 261/527] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:36.637064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dd59a-a0dc-4f94-aee9-5872b80598b0 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:36.674769 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4fa4-d1e7-4faa-83d6-2dca48976586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:36.675879 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4fa4-d1e7-4faa-83d6-2dca48976586 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:36.677135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4fa4-d1e7-4faa-83d6-2dca48976586 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:36.677427 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4fa4-d1e7-4faa-83d6-2dca48976586 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:36.686380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a4fa4-d1e7-4faa-83d6-2dca48976586 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:36.689114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a4fa4-d1e7-4faa-83d6-2dca48976586 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:36.709814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-f89a4fa4-d1e7-4faa-83d6-2dca48976586 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:36.709814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:36.709814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:36.709814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:36.709814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:36.709814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:36.709814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:36.709814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:36.709814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:36.709814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:36.709814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:36.709814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:36.709814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:36.709814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:36.709814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:36.711578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:36.713137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:36.713137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:36.713137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:36.713137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:36.713137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:36.713137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:36.713137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:36.713137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:36.713137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 267/528] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:36.713137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4fa4-d1e7-4faa-83d6-2dca48976586 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:36.742205 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:36.746931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:36.758559 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dd59a-a0dc-4f94-aee9-5872b80598b0 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:36.800500 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53088050-b610-45ad-902a-5ac5dad74743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:36.801428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53088050-b610-45ad-902a-5ac5dad74743 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:36.801997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53088050-b610-45ad-902a-5ac5dad74743 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:36.802298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53088050-b610-45ad-902a-5ac5dad74743 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:36.803426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53088050-b610-45ad-902a-5ac5dad74743 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:36.803740 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53088050-b610-45ad-902a-5ac5dad74743 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:36.805210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53088050-b610-45ad-902a-5ac5dad74743 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:36.839748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4fa4-d1e7-4faa-83d6-2dca48976586 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:36.855503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 262/529] 10.222.0.33 () {56 vars in 1139 bytes} [Wed Jun 1 17:25:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:36.856679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53088050-b610-45ad-902a-5ac5dad74743 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:36.877928 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692b44a-70cd-4c1d-a062-0649978278ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:36.878695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692b44a-70cd-4c1d-a062-0649978278ee None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:36.879046 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692b44a-70cd-4c1d-a062-0649978278ee None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:36.879392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692b44a-70cd-4c1d-a062-0649978278ee None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:36.880210 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692b44a-70cd-4c1d-a062-0649978278ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:36.880585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692b44a-70cd-4c1d-a062-0649978278ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:36.882236 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692b44a-70cd-4c1d-a062-0649978278ee None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:36.901067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 268/530] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:36.902053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692b44a-70cd-4c1d-a062-0649978278ee None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:36.992401 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:36.994334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53088050-b610-45ad-902a-5ac5dad74743 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:37.011110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692b44a-70cd-4c1d-a062-0649978278ee None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:37.042934 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6471259-fc45-4873-a912-586cbe44021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:37.044009 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6471259-fc45-4873-a912-586cbe44021a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:37.044293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6471259-fc45-4873-a912-586cbe44021a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:37.044828 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6471259-fc45-4873-a912-586cbe44021a None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:37.045679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6471259-fc45-4873-a912-586cbe44021a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:37.046209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6471259-fc45-4873-a912-586cbe44021a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:37.049268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6471259-fc45-4873-a912-586cbe44021a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:37.052419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fd966-c9ff-4878-a027-d5207f12c128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:37.053222 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fd966-c9ff-4878-a027-d5207f12c128 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:37.053620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fd966-c9ff-4878-a027-d5207f12c128 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:37.053996 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fd966-c9ff-4878-a027-d5207f12c128 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:37.064309 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 263/531] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:37.065204 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6471259-fc45-4873-a912-586cbe44021a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:37.067824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:37.148424 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fd966-c9ff-4878-a027-d5207f12c128 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:37.150876 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fd966-c9ff-4878-a027-d5207f12c128 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:37.186878 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6471259-fc45-4873-a912-586cbe44021a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:37.229938 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335d3c6-c7d2-4d04-9778-4d05bc889abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:37.230952 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335d3c6-c7d2-4d04-9778-4d05bc889abb None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:37.231339 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335d3c6-c7d2-4d04-9778-4d05bc889abb None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:37.231716 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335d3c6-c7d2-4d04-9778-4d05bc889abb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:37.239529 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335d3c6-c7d2-4d04-9778-4d05bc889abb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:37.241322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335d3c6-c7d2-4d04-9778-4d05bc889abb None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:37.244398 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:37.258746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-1335d3c6-c7d2-4d04-9778-4d05bc889abb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:37.258746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:37.258746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:37.258746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:37.258746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:37.258746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:37.258746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:37.258746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:37.258746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:37.258746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:37.258746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:37.258746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:37.258746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:37.258746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:37.258746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:37.262911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:37.264475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:37.264475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:37.264475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:37.264475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:37.264475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:37.264475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:37.264475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:37.264475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:37.264475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 264/532] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:37.265310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 269/533] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:37.266419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335d3c6-c7d2-4d04-9778-4d05bc889abb None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:37.270204 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fd966-c9ff-4878-a027-d5207f12c128 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:37.339881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:37.383127 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335d3c6-c7d2-4d04-9778-4d05bc889abb None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:37.394505 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fd966-c9ff-4878-a027-d5207f12c128 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:37.419082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cac9be-743c-4499-92dc-9edf29711caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:37.419771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cac9be-743c-4499-92dc-9edf29711caa None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:37.420129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cac9be-743c-4499-92dc-9edf29711caa None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:37.420478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cac9be-743c-4499-92dc-9edf29711caa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:37.421473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cac9be-743c-4499-92dc-9edf29711caa None admin] RBAC: Adding query filter params (role.id=97f88c6182044737a47af038d94a74b8, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=b34d05889f3c4d469f4661061457cb95) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:37.421854 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cac9be-743c-4499-92dc-9edf29711caa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:37.423986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cac9be-743c-4499-92dc-9edf29711caa None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:37.436997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 265/534] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:25:37 2022] GET /identity/v3/role_assignments?user.id=b34d05889f3c4d469f4661061457cb95&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=97f88c6182044737a47af038d94a74b8 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:37.438250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cac9be-743c-4499-92dc-9edf29711caa None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:37.448242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cd75b-2469-4be8-88b7-96da1a8065e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:37.449322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cd75b-2469-4be8-88b7-96da1a8065e9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:37.449972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cd75b-2469-4be8-88b7-96da1a8065e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:37.450451 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cd75b-2469-4be8-88b7-96da1a8065e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:37.451426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cd75b-2469-4be8-88b7-96da1a8065e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:37.452112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cd75b-2469-4be8-88b7-96da1a8065e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:37.455164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cd75b-2469-4be8-88b7-96da1a8065e9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:37.482088 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 270/535] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:37.490399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cd75b-2469-4be8-88b7-96da1a8065e9 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:37.544917 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:37.644548 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cac9be-743c-4499-92dc-9edf29711caa None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:37.659337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cd75b-2469-4be8-88b7-96da1a8065e9 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:37.702382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:37.717591 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1b98a-94c1-476e-ae6e-8c40e43039b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:37.718481 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1b98a-94c1-476e-ae6e-8c40e43039b5 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:37.718762 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1b98a-94c1-476e-ae6e-8c40e43039b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:37.720819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1b98a-94c1-476e-ae6e-8c40e43039b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:37.734056 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1b98a-94c1-476e-ae6e-8c40e43039b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:37.736372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1b98a-94c1-476e-ae6e-8c40e43039b5 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:37.736655 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caceb8-60c5-49af-8096-747e77c6b950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:37.738375 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caceb8-60c5-49af-8096-747e77c6b950 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:37.738863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caceb8-60c5-49af-8096-747e77c6b950 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:37.739335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caceb8-60c5-49af-8096-747e77c6b950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:37.740590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caceb8-60c5-49af-8096-747e77c6b950 None admin] RBAC: Adding query filter params (role.id=97f88c6182044737a47af038d94a74b8, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=98d9e5912b8c4f36922cde62830fb7ac) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:37.742480 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caceb8-60c5-49af-8096-747e77c6b950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:37.744156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caceb8-60c5-49af-8096-747e77c6b950 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:37.757154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 271/536] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:25:37 2022] GET /identity/v3/role_assignments?user.id=98d9e5912b8c4f36922cde62830fb7ac&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=97f88c6182044737a47af038d94a74b8 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:37.759186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-37f1b98a-94c1-476e-ae6e-8c40e43039b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:37.759186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:37.759186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:37.759186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:37.759186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:37.759186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:37.759186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:37.759186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:37.759186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:37.759186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:37.759186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:37.759186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:37.759186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:37.759186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:37.759186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:37.760010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:37.761064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:37.761064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:37.761064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:37.761064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:37.761064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 266/537] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:37.766230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caceb8-60c5-49af-8096-747e77c6b950 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:37.905122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caceb8-60c5-49af-8096-747e77c6b950 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:37.913562 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:37.954487 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c06e6a-91eb-458b-9ab3-c1e871880b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:37.955183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c06e6a-91eb-458b-9ab3-c1e871880b27 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:37.955491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c06e6a-91eb-458b-9ab3-c1e871880b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:37.955767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c06e6a-91eb-458b-9ab3-c1e871880b27 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:37.956499 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c06e6a-91eb-458b-9ab3-c1e871880b27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:37.956807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c06e6a-91eb-458b-9ab3-c1e871880b27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:37.958223 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c06e6a-91eb-458b-9ab3-c1e871880b27 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:37.975392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 272/538] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:37.980906 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1b98a-94c1-476e-ae6e-8c40e43039b5 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:38.110615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1b98a-94c1-476e-ae6e-8c40e43039b5 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:38.147703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873d392-a37c-4db6-b199-fbf1b7ce7b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:38.148848 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873d392-a37c-4db6-b199-fbf1b7ce7b90 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:38.149518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873d392-a37c-4db6-b199-fbf1b7ce7b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:38.150014 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873d392-a37c-4db6-b199-fbf1b7ce7b90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:38.157511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873d392-a37c-4db6-b199-fbf1b7ce7b90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:38.159378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873d392-a37c-4db6-b199-fbf1b7ce7b90 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:38.174763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-a873d392-a37c-4db6-b199-fbf1b7ce7b90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:38.174763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:38.174763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:38.174763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:38.174763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:38.174763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:38.174763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:38.174763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:38.174763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:38.174763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:38.174763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:38.174763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:38.174763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:38.174763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:38.174763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:38.175679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:38.176534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:38.176534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:38.176534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:38.176534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:38.176534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:38.176534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:38.176534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:38.176534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:38.179124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 267/539] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:38.184842 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c06e6a-91eb-458b-9ab3-c1e871880b27 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:38.340034 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c06e6a-91eb-458b-9ab3-c1e871880b27 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:38.380414 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc101ec-0bf4-4386-a36f-4df1ed458371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:38.381122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc101ec-0bf4-4386-a36f-4df1ed458371 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:38.381412 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc101ec-0bf4-4386-a36f-4df1ed458371 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:38.381695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc101ec-0bf4-4386-a36f-4df1ed458371 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:38.382497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc101ec-0bf4-4386-a36f-4df1ed458371 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:38.382813 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc101ec-0bf4-4386-a36f-4df1ed458371 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:38.384265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc101ec-0bf4-4386-a36f-4df1ed458371 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:38.401288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 273/540] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:38.407816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873d392-a37c-4db6-b199-fbf1b7ce7b90 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:38.481972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:38.552681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873d392-a37c-4db6-b199-fbf1b7ce7b90 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:38.611169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b39f03-4884-4306-bf1a-45fc7cb25169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:38.611857 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b39f03-4884-4306-bf1a-45fc7cb25169 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:38.612255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b39f03-4884-4306-bf1a-45fc7cb25169 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:38.612424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b39f03-4884-4306-bf1a-45fc7cb25169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:38.613303 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b39f03-4884-4306-bf1a-45fc7cb25169 None admin] RBAC: Adding query filter params (role.id=97f88c6182044737a47af038d94a74b8, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=4254398f2aac42f7b54f29294a73bfda) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:38.616960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b39f03-4884-4306-bf1a-45fc7cb25169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:38.616960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b39f03-4884-4306-bf1a-45fc7cb25169 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:38.647936 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 268/541] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:25:38 2022] GET /identity/v3/role_assignments?user.id=4254398f2aac42f7b54f29294a73bfda&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=97f88c6182044737a47af038d94a74b8 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:38.763405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ce968-2809-4f1d-aa1f-2c3a1f29062b None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:38.763776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ce968-2809-4f1d-aa1f-2c3a1f29062b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:38.763973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ce968-2809-4f1d-aa1f-2c3a1f29062b None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:38.766355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 274/542] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:38.772236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc20757-9c0c-48e0-82df-b448e3cfcb23 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:38.772557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc20757-9c0c-48e0-82df-b448e3cfcb23 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:38.772846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc20757-9c0c-48e0-82df-b448e3cfcb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:38.791801 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-2fc20757-9c0c-48e0-82df-b448e3cfcb23 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:38.793048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-2fc20757-9c0c-48e0-82df-b448e3cfcb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:38.964798 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 269/543] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:39.014181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ce968-2809-4f1d-aa1f-2c3a1f29062b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:39.054613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:39.137962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ce968-2809-4f1d-aa1f-2c3a1f29062b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:39.146655 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8f9f3-b9f3-4072-a207-3b93c6d01c33 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:39.146965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8f9f3-b9f3-4072-a207-3b93c6d01c33 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:39.147215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8f9f3-b9f3-4072-a207-3b93c6d01c33 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:39.148827 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 270/544] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:39.159775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bb936-5970-4c21-939b-ff53e1baf3d7 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:39.160052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bb936-5970-4c21-939b-ff53e1baf3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:39.160520 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bb936-5970-4c21-939b-ff53e1baf3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:39.186401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-973bb936-5970-4c21-939b-ff53e1baf3d7 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:39.191989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-973bb936-5970-4c21-939b-ff53e1baf3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:39.215301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef705e-98fe-4021-9674-4f7d8363fb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:39.216880 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef705e-98fe-4021-9674-4f7d8363fb39 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:39.218047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef705e-98fe-4021-9674-4f7d8363fb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:39.221882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef705e-98fe-4021-9674-4f7d8363fb39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:39.245793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef705e-98fe-4021-9674-4f7d8363fb39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-f2ef705e-98fe-4021-9674-4f7d8363fb39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:39.255640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:39.256694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:39.257595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:39.257595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:39.257595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:39.257595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:39.257595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:39.257595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:39.257595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:39.257595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:39.257595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:39.257595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:39.257595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:39.257595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:39.261019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:39.275344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 275/545] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:39.278607 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef705e-98fe-4021-9674-4f7d8363fb39 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:39.393622 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 271/546] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:25:39.455292 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bb936-5970-4c21-939b-ff53e1baf3d7 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:39.497340 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:39.517844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef705e-98fe-4021-9674-4f7d8363fb39 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:39.597763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b4e12-2af1-4030-af93-51782fe0e14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:39.598383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b4e12-2af1-4030-af93-51782fe0e14f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:39.598675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b4e12-2af1-4030-af93-51782fe0e14f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:39.598958 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b4e12-2af1-4030-af93-51782fe0e14f None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:39.599951 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b4e12-2af1-4030-af93-51782fe0e14f None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:39.600552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b4e12-2af1-4030-af93-51782fe0e14f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:39.602168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b4e12-2af1-4030-af93-51782fe0e14f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:39.629388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 276/547] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:39.630355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b4e12-2af1-4030-af93-51782fe0e14f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:39.630726 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bb936-5970-4c21-939b-ff53e1baf3d7 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:39.668019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0da9f-9ec1-4df3-baf4-1d0234493164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:39.669189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0da9f-9ec1-4df3-baf4-1d0234493164 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:39.669639 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0da9f-9ec1-4df3-baf4-1d0234493164 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:39.675848 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0da9f-9ec1-4df3-baf4-1d0234493164 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:39.681421 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0da9f-9ec1-4df3-baf4-1d0234493164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-5fc0da9f-9ec1-4df3-baf4-1d0234493164 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:39.689893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:39.690860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:39.692208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:39.692208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:39.692208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:39.692208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:39.692208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:39.692208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:39.692208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:39.692208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:39.692208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:39.692208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:39.692208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:39.692208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:39.695174 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 272/548] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:39.700580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0da9f-9ec1-4df3-baf4-1d0234493164 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:39.741393 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:39.811408 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0da9f-9ec1-4df3-baf4-1d0234493164 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:39.859991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b4e12-2af1-4030-af93-51782fe0e14f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:39.867552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7ae7f-d60b-4797-8bd9-e4ba1ab2a067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:39.872641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ae7f-d60b-4797-8bd9-e4ba1ab2a067 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:39.873191 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ae7f-d60b-4797-8bd9-e4ba1ab2a067 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:39.873688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ae7f-d60b-4797-8bd9-e4ba1ab2a067 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:39.874668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7ae7f-d60b-4797-8bd9-e4ba1ab2a067 None admin] RBAC: Adding query filter params (name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:39.875259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7ae7f-d60b-4797-8bd9-e4ba1ab2a067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:39.876862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7ae7f-d60b-4797-8bd9-e4ba1ab2a067 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:39.892264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 273/549] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:39.898439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7ae7f-d60b-4797-8bd9-e4ba1ab2a067 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:39.917753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47109a4-9765-46b8-8ab9-a8f58722f803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:39.918923 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47109a4-9765-46b8-8ab9-a8f58722f803 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:39.919417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47109a4-9765-46b8-8ab9-a8f58722f803 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:39.919978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47109a4-9765-46b8-8ab9-a8f58722f803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:39.932488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47109a4-9765-46b8-8ab9-a8f58722f803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:39.934483 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47109a4-9765-46b8-8ab9-a8f58722f803 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:39.945251 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:39.956882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-e47109a4-9765-46b8-8ab9-a8f58722f803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:39.956882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:39.956882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:39.956882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:39.956882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:39.956882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:39.956882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:39.956882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:39.956882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:39.956882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:39.956882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:39.956882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:39.956882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:39.956882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:39.956882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:39.959809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:39.960763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:39.960763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:39.960763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:39.960763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:39.962509 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 277/550] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:39.967841 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47109a4-9765-46b8-8ab9-a8f58722f803 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:40.068770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:40.085869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7ae7f-d60b-4797-8bd9-e4ba1ab2a067 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:40.122872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528ff9c-2fe1-4e9b-b6e2-a846fd4c759b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:40.124275 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528ff9c-2fe1-4e9b-b6e2-a846fd4c759b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:40.124767 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528ff9c-2fe1-4e9b-b6e2-a846fd4c759b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:40.125318 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528ff9c-2fe1-4e9b-b6e2-a846fd4c759b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:40.137598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528ff9c-2fe1-4e9b-b6e2-a846fd4c759b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:40.140234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528ff9c-2fe1-4e9b-b6e2-a846fd4c759b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:40.162308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-e528ff9c-2fe1-4e9b-b6e2-a846fd4c759b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:40.162308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:40.162308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:40.162308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:40.162308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:40.162308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:40.162308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:40.162308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:40.162308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:40.162308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:40.162308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:40.162308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:40.162308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:40.162308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:40.162308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:40.163260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:40.164137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:40.164137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:40.164137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:40.164137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:40.164137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 274/551] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:40.167233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528ff9c-2fe1-4e9b-b6e2-a846fd4c759b None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:40.204598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47109a4-9765-46b8-8ab9-a8f58722f803 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:40.272769 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c3415-3a91-4621-920b-3d6ea1bc07d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:40.275159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c3415-3a91-4621-920b-3d6ea1bc07d4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:40.276173 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c3415-3a91-4621-920b-3d6ea1bc07d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:40.276597 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c3415-3a91-4621-920b-3d6ea1bc07d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:40.277747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c3415-3a91-4621-920b-3d6ea1bc07d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:40.278867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c3415-3a91-4621-920b-3d6ea1bc07d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:40.282625 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c3415-3a91-4621-920b-3d6ea1bc07d4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:40.305399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 278/552] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:40.306979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c3415-3a91-4621-920b-3d6ea1bc07d4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:40.374517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:40.376693 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528ff9c-2fe1-4e9b-b6e2-a846fd4c759b None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:40.414269 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444ebce-9cf5-49b4-a5ae-fad5df313dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:40.415238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444ebce-9cf5-49b4-a5ae-fad5df313dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:40.415579 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444ebce-9cf5-49b4-a5ae-fad5df313dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:40.415862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444ebce-9cf5-49b4-a5ae-fad5df313dc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:40.416861 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444ebce-9cf5-49b4-a5ae-fad5df313dc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:40.417238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444ebce-9cf5-49b4-a5ae-fad5df313dc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:40.418639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c3415-3a91-4621-920b-3d6ea1bc07d4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:40.419058 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444ebce-9cf5-49b4-a5ae-fad5df313dc6 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:40.425757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:40.439108 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 275/553] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:40.440749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6724e-c2d1-4a99-a160-dc5be9ab6b99 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:40.441146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6724e-c2d1-4a99-a160-dc5be9ab6b99 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:40.441434 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6724e-c2d1-4a99-a160-dc5be9ab6b99 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:40.448109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 276/554] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:40.449054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6724e-c2d1-4a99-a160-dc5be9ab6b99 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:40.471945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace7f1e-cda4-4f8d-89b4-7b85d6e13a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:40.472777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace7f1e-cda4-4f8d-89b4-7b85d6e13a5b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:40.473140 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace7f1e-cda4-4f8d-89b4-7b85d6e13a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:40.473423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace7f1e-cda4-4f8d-89b4-7b85d6e13a5b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:40.488235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace7f1e-cda4-4f8d-89b4-7b85d6e13a5b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:40.490243 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace7f1e-cda4-4f8d-89b4-7b85d6e13a5b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-dace7f1e-cda4-4f8d-89b4-7b85d6e13a5b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:40.506891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:40.507891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:40.508914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:40.508914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:40.508914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:40.508914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:40.508914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:40.508914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:40.508914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:40.508914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:40.508914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:25:40.508914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:40.516871 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 279/555] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jun 1 17:25:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:40.518782 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b4313-b880-4753-9109-f23fff33d964 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:40.519301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b4313-b880-4753-9109-f23fff33d964 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:40.519776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b4313-b880-4753-9109-f23fff33d964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:40.539403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-9e3b4313-b880-4753-9109-f23fff33d964 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:40.541090 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9e3b4313-b880-4753-9109-f23fff33d964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:40.585086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6724e-c2d1-4a99-a160-dc5be9ab6b99 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:40.621544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca46a73-bf99-4119-920f-47e717585a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:40.622684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca46a73-bf99-4119-920f-47e717585a8c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:40.623169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca46a73-bf99-4119-920f-47e717585a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:40.623643 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca46a73-bf99-4119-920f-47e717585a8c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:40.633150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 280/556] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:40.634546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b4313-b880-4753-9109-f23fff33d964 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:40.635457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca46a73-bf99-4119-920f-47e717585a8c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:40.637136 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca46a73-bf99-4119-920f-47e717585a8c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-6ca46a73-bf99-4119-920f-47e717585a8c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:40.667465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:40.673796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:40.675212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:40.675212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:40.675212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:40.675212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:40.675212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:40.675212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:40.675212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:40.675212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:40.675212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 01 17:25:40.675212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:40.675212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 277/557] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:25:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:40.675212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca46a73-bf99-4119-920f-47e717585a8c None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:40.699222 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:40.735889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:40.766837 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b4313-b880-4753-9109-f23fff33d964 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:40.787684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca46a73-bf99-4119-920f-47e717585a8c None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:40.802351 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab840a88-c69e-4e51-8ecb-5f099fd898fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:40.803034 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab840a88-c69e-4e51-8ecb-5f099fd898fd None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:40.803323 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab840a88-c69e-4e51-8ecb-5f099fd898fd None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:40.803605 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab840a88-c69e-4e51-8ecb-5f099fd898fd None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:40.804454 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab840a88-c69e-4e51-8ecb-5f099fd898fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:40.804768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab840a88-c69e-4e51-8ecb-5f099fd898fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:40.806247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab840a88-c69e-4e51-8ecb-5f099fd898fd None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:40.828931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 281/558] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jun 1 17:25:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:40.828931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecba89f-edc9-4a9b-8f48-944d47ae112d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:40.828931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecba89f-edc9-4a9b-8f48-944d47ae112d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:40.828931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecba89f-edc9-4a9b-8f48-944d47ae112d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:40.828931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 282/559] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:40.828931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecba89f-edc9-4a9b-8f48-944d47ae112d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:40.836284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fdb8a-ca10-4d26-a7af-cc72c4cb4ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:40.837539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fdb8a-ca10-4d26-a7af-cc72c4cb4ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:40.837539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fdb8a-ca10-4d26-a7af-cc72c4cb4ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:40.837783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fdb8a-ca10-4d26-a7af-cc72c4cb4ff5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:40.849319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fdb8a-ca10-4d26-a7af-cc72c4cb4ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-256fdb8a-ca10-4d26-a7af-cc72c4cb4ff5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:40.857765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:40.858756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:40.860216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:40.860216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:40.860216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:40.860216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:40.860216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:40.860216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:40.860216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:40.860216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:40.860216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:40.860216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:40.860216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:40.860216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:40.860216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 278/560] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:40.860903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fdb8a-ca10-4d26-a7af-cc72c4cb4ff5 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:40.942316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecba89f-edc9-4a9b-8f48-944d47ae112d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:40.952172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:40.980580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fdb8a-ca10-4d26-a7af-cc72c4cb4ff5 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:40.981108 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a49fc-d0dd-49b0-973a-d9f182494874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:40.981728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a49fc-d0dd-49b0-973a-d9f182494874 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:40.982007 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a49fc-d0dd-49b0-973a-d9f182494874 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:40.982282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a49fc-d0dd-49b0-973a-d9f182494874 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:40.983117 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a49fc-d0dd-49b0-973a-d9f182494874 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:40.983430 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a49fc-d0dd-49b0-973a-d9f182494874 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:40.985610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a49fc-d0dd-49b0-973a-d9f182494874 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:41.002764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:41.007993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 283/561] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Jun 1 17:25:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:41.007993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1551e7f-b25b-4108-88dc-509708d0cfe9 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:41.007993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1551e7f-b25b-4108-88dc-509708d0cfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:41.007993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1551e7f-b25b-4108-88dc-509708d0cfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:41.022410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b1551e7f-b25b-4108-88dc-509708d0cfe9 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:41.023632 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b1551e7f-b25b-4108-88dc-509708d0cfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:41.034793 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3064fa-b174-4822-a37a-6cf507d8509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:41.036079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3064fa-b174-4822-a37a-6cf507d8509f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:41.037843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3064fa-b174-4822-a37a-6cf507d8509f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:41.038318 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3064fa-b174-4822-a37a-6cf507d8509f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:41.055449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3064fa-b174-4822-a37a-6cf507d8509f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:41.057763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3064fa-b174-4822-a37a-6cf507d8509f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:41.081289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-2f3064fa-b174-4822-a37a-6cf507d8509f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:41.081289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:41.081289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:41.081289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:41.081289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:41.081289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:41.081289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:41.081289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:41.081289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:41.081289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:41.081289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:41.081289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:41.081289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:41.081289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:41.081289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:41.082350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:41.083509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:41.083509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:41.083509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:41.083509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:41.085324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 279/562] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:41.086889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3064fa-b174-4822-a37a-6cf507d8509f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:41.116789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 284/563] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:41.116789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1551e7f-b25b-4108-88dc-509708d0cfe9 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:41.204984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3064fa-b174-4822-a37a-6cf507d8509f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:41.227668 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:41.233194 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1551e7f-b25b-4108-88dc-509708d0cfe9 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:41.245589 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d24f7-9972-4631-8785-00191dbfcd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:41.246266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d24f7-9972-4631-8785-00191dbfcd05 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:41.246559 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d24f7-9972-4631-8785-00191dbfcd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:41.246837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d24f7-9972-4631-8785-00191dbfcd05 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:41.249670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d24f7-9972-4631-8785-00191dbfcd05 None admin] RBAC: Adding query filter params (name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:41.249670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d24f7-9972-4631-8785-00191dbfcd05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:41.249670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d24f7-9972-4631-8785-00191dbfcd05 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:41.258340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 280/564] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:41.262869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d24f7-9972-4631-8785-00191dbfcd05 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:41.272588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091851f-1bcd-435f-a902-6d44d7991ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:41.273746 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091851f-1bcd-435f-a902-6d44d7991ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:41.274303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091851f-1bcd-435f-a902-6d44d7991ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:41.274303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091851f-1bcd-435f-a902-6d44d7991ae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:41.294091 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:41.341328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091851f-1bcd-435f-a902-6d44d7991ae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:41.342811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091851f-1bcd-435f-a902-6d44d7991ae4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:41.370114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d24f7-9972-4631-8785-00191dbfcd05 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:41.406121 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccacd8-8f06-43fb-a4ee-26ace16753ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:41.407334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccacd8-8f06-43fb-a4ee-26ace16753ae None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:41.407616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccacd8-8f06-43fb-a4ee-26ace16753ae None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:41.407894 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccacd8-8f06-43fb-a4ee-26ace16753ae None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:41.408602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccacd8-8f06-43fb-a4ee-26ace16753ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:41.408906 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccacd8-8f06-43fb-a4ee-26ace16753ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:41.410313 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccacd8-8f06-43fb-a4ee-26ace16753ae None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:41.429843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 281/565] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:41.429843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccacd8-8f06-43fb-a4ee-26ace16753ae None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:41.450934 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:41.460976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 285/566] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:41.460976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091851f-1bcd-435f-a902-6d44d7991ae4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:41.525761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:41.534974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccacd8-8f06-43fb-a4ee-26ace16753ae None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:41.569416 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9402c6-5b7b-49b2-9d1c-b40d9b28af28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:41.570220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9402c6-5b7b-49b2-9d1c-b40d9b28af28 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:41.570503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9402c6-5b7b-49b2-9d1c-b40d9b28af28 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:41.570786 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9402c6-5b7b-49b2-9d1c-b40d9b28af28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:41.573494 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091851f-1bcd-435f-a902-6d44d7991ae4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:41.581742 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9402c6-5b7b-49b2-9d1c-b40d9b28af28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-5d9402c6-5b7b-49b2-9d1c-b40d9b28af28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:41.589511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:41.591063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:41.592184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:41.592184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:41.592184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:41.592184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:41.592184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:41.592184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:41.592184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:41.592184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:41.592184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:41.592184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:41.592184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:41.592184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:41.592184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 282/567] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:41.592184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9402c6-5b7b-49b2-9d1c-b40d9b28af28 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:41.610696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daee752-5aac-4ac6-8cc2-98f3991db500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:41.611487 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daee752-5aac-4ac6-8cc2-98f3991db500 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:41.611776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daee752-5aac-4ac6-8cc2-98f3991db500 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:41.612056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daee752-5aac-4ac6-8cc2-98f3991db500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:41.622172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daee752-5aac-4ac6-8cc2-98f3991db500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:41.623621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daee752-5aac-4ac6-8cc2-98f3991db500 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:41.641679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-3daee752-5aac-4ac6-8cc2-98f3991db500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:41.641679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:41.641679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:41.641679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:41.641679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:41.641679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:41.641679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:41.641679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:41.641679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:41.641679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:41.641679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:41.641679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:41.641679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:41.641679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:41.641679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:41.642555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:41.643431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:41.643431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:41.643431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:41.643431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:41.643431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 286/568] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:41.643715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daee752-5aac-4ac6-8cc2-98f3991db500 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:41.693017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9402c6-5b7b-49b2-9d1c-b40d9b28af28 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:41.696173 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:41.727988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f5e89-c0b1-4622-94c4-52ec44b1c5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:41.728708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f5e89-c0b1-4622-94c4-52ec44b1c5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:41.729017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f5e89-c0b1-4622-94c4-52ec44b1c5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:41.729302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f5e89-c0b1-4622-94c4-52ec44b1c5f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:41.737054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f5e89-c0b1-4622-94c4-52ec44b1c5f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:41.738573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f5e89-c0b1-4622-94c4-52ec44b1c5f9 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:41.753111 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daee752-5aac-4ac6-8cc2-98f3991db500 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:41.754571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-8f4f5e89-c0b1-4622-94c4-52ec44b1c5f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:41.754571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:41.754571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:41.754571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:41.754571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:41.754571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:41.754571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:41.754571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:41.754571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:41.754571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:41.754571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:41.754571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:41.754571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:41.754571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:41.754571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:41.755494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:41.756394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:41.756394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:41.756394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:41.756394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:41.756394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:41.756394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:41.756394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:41.756394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:41.756394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 283/569] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:41.757335 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7c9da-1913-4e0f-a994-ebd23aac0642 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:41.757502 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7c9da-1913-4e0f-a994-ebd23aac0642 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:41.757782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7c9da-1913-4e0f-a994-ebd23aac0642 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:41.759054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 284/570] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:41.759759 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7c9da-1913-4e0f-a994-ebd23aac0642 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:41.772859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:41.795952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa1842-ac18-408e-94d1-a218ea9afef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:41.796787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa1842-ac18-408e-94d1-a218ea9afef6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:41.797098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa1842-ac18-408e-94d1-a218ea9afef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:41.797440 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa1842-ac18-408e-94d1-a218ea9afef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:41.807409 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa1842-ac18-408e-94d1-a218ea9afef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:41.808864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa1842-ac18-408e-94d1-a218ea9afef6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:41.825983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-50fa1842-ac18-408e-94d1-a218ea9afef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:41.825983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:41.825983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:41.825983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:41.825983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:41.825983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:41.825983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:41.825983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:41.825983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:41.825983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:41.825983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:41.825983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:41.825983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:41.825983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:41.825983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:41.826956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:41.827848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:41.827848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:41.827848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:41.827848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:41.827848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 287/571] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:41.828647 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa1842-ac18-408e-94d1-a218ea9afef6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:41.873922 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7c9da-1913-4e0f-a994-ebd23aac0642 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:41.913823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c1f12-35ef-4459-bb11-79a26c111196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:41.914673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c1f12-35ef-4459-bb11-79a26c111196 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:41.914673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c1f12-35ef-4459-bb11-79a26c111196 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:41.915209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c1f12-35ef-4459-bb11-79a26c111196 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:41.915849 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c1f12-35ef-4459-bb11-79a26c111196 None admin] RBAC: Adding query filter params (name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:41.916156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c1f12-35ef-4459-bb11-79a26c111196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:41.917563 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c1f12-35ef-4459-bb11-79a26c111196 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:41.928084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 285/572] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:41.928706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c1f12-35ef-4459-bb11-79a26c111196 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:41.950689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:41.954303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa1842-ac18-408e-94d1-a218ea9afef6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:41.993992 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19340c23-0f3e-43ea-9112-377d56f26bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:41.994638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19340c23-0f3e-43ea-9112-377d56f26bea None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:41.995010 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19340c23-0f3e-43ea-9112-377d56f26bea None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:41.995390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19340c23-0f3e-43ea-9112-377d56f26bea None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:41.996700 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19340c23-0f3e-43ea-9112-377d56f26bea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:41.997201 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19340c23-0f3e-43ea-9112-377d56f26bea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:41.998669 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19340c23-0f3e-43ea-9112-377d56f26bea None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:42.013579 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 288/573] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:42.014341 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:42.014878 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3f9c4-cce2-44fa-aa2c-4f728fc35668 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:42.015245 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3f9c4-cce2-44fa-aa2c-4f728fc35668 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:42.016097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3f9c4-cce2-44fa-aa2c-4f728fc35668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:42.033458 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-27b3f9c4-cce2-44fa-aa2c-4f728fc35668 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:42.034657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-27b3f9c4-cce2-44fa-aa2c-4f728fc35668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:42.057124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c1f12-35ef-4459-bb11-79a26c111196 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:42.095090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69572f27-c199-4692-a689-7338daf841b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:42.095767 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69572f27-c199-4692-a689-7338daf841b0 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:42.096055 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69572f27-c199-4692-a689-7338daf841b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:42.096348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69572f27-c199-4692-a689-7338daf841b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:42.097171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69572f27-c199-4692-a689-7338daf841b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:42.097482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69572f27-c199-4692-a689-7338daf841b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:42.098916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69572f27-c199-4692-a689-7338daf841b0 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:42.112047 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 286/574] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:42.116801 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 289/575] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:42.117001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69572f27-c199-4692-a689-7338daf841b0 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:42.117098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3f9c4-cce2-44fa-aa2c-4f728fc35668 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:42.232696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69572f27-c199-4692-a689-7338daf841b0 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:42.238988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:42.250535 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3f9c4-cce2-44fa-aa2c-4f728fc35668 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:42.264011 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:42.269570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08d4c0-f995-4cad-b437-f390f9093293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:42.270393 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08d4c0-f995-4cad-b437-f390f9093293 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:42.270678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08d4c0-f995-4cad-b437-f390f9093293 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:42.270946 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08d4c0-f995-4cad-b437-f390f9093293 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:42.271684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08d4c0-f995-4cad-b437-f390f9093293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:42.272013 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08d4c0-f995-4cad-b437-f390f9093293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:42.274196 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08d4c0-f995-4cad-b437-f390f9093293 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:42.286747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 287/576] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:42.287607 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08d4c0-f995-4cad-b437-f390f9093293 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:42.298951 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cfbaa-8d22-4ac9-8f50-7b4aeedb89da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:42.299996 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cfbaa-8d22-4ac9-8f50-7b4aeedb89da None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:42.300280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cfbaa-8d22-4ac9-8f50-7b4aeedb89da None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:42.300549 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cfbaa-8d22-4ac9-8f50-7b4aeedb89da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:42.318245 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cfbaa-8d22-4ac9-8f50-7b4aeedb89da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:42.319737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cfbaa-8d22-4ac9-8f50-7b4aeedb89da None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:42.342437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-505cfbaa-8d22-4ac9-8f50-7b4aeedb89da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:42.342437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:42.342437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:42.342437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:42.342437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:42.342437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:42.342437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:42.342437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:42.342437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:42.342437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:42.342437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:42.342437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:42.342437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:42.342437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:42.342437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:42.343425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:42.344344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:42.344344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:42.344344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:42.344344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:42.344344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 290/577] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:42.344634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cfbaa-8d22-4ac9-8f50-7b4aeedb89da None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:42.397802 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08d4c0-f995-4cad-b437-f390f9093293 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:42.431871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02585f-73e5-44c3-ab29-288d6e25b353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:42.432679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02585f-73e5-44c3-ab29-288d6e25b353 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:42.432975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02585f-73e5-44c3-ab29-288d6e25b353 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:42.433258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02585f-73e5-44c3-ab29-288d6e25b353 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:42.442327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02585f-73e5-44c3-ab29-288d6e25b353 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:42.443813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02585f-73e5-44c3-ab29-288d6e25b353 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:42.461068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cfbaa-8d22-4ac9-8f50-7b4aeedb89da None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-6b02585f-73e5-44c3-ab29-288d6e25b353 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:42.461254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:42.463252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:42.465635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:42.465635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:42.465635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:42.465635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:42.465635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:42.465635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:42.465635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:42.465635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:42.465635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 01 17:25:42.465635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:42.465635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 288/578] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:42.465635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02585f-73e5-44c3-ab29-288d6e25b353 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:42.507693 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94956bb5-57e7-476c-9c49-0f824b77f89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:42.508510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94956bb5-57e7-476c-9c49-0f824b77f89a None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:42.508792 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94956bb5-57e7-476c-9c49-0f824b77f89a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:42.509104 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94956bb5-57e7-476c-9c49-0f824b77f89a None admin] PATH_INFO: `/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/5d5a5ba6aecd46e79dc7199589384a4f/roles/97f88c6182044737a47af038d94a74b8` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:42.522498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:42.525592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:42.525771 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94956bb5-57e7-476c-9c49-0f824b77f89a None admin] RBAC: Authorizing `identity:create_grant(project_id=68bf9a1e88a64a02ba53d0bedb76072a, user_id=5d5a5ba6aecd46e79dc7199589384a4f, role_id=97f88c6182044737a47af038d94a74b8)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:42.527116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94956bb5-57e7-476c-9c49-0f824b77f89a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:42.584540 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02585f-73e5-44c3-ab29-288d6e25b353 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:42.603023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 291/579] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:25:42 2022] PUT /identity/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/5d5a5ba6aecd46e79dc7199589384a4f/roles/97f88c6182044737a47af038d94a74b8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:25:42.603871 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94956bb5-57e7-476c-9c49-0f824b77f89a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:42.631861 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b39215-7464-4914-95aa-66541163b15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:42.632694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b39215-7464-4914-95aa-66541163b15c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:42.632985 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b39215-7464-4914-95aa-66541163b15c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:42.633271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b39215-7464-4914-95aa-66541163b15c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:42.648169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b39215-7464-4914-95aa-66541163b15c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-20b39215-7464-4914-95aa-66541163b15c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:42.663347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:42.668462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:42.670348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:42.670348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:42.670348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:42.670348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:42.670348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:42.670348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:42.670348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:42.670348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:42.670348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:42.670348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:42.670348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:42.670348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:42.670348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 289/580] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:42.670348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b39215-7464-4914-95aa-66541163b15c None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:42.774736 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94956bb5-57e7-476c-9c49-0f824b77f89a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:42.804756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b39215-7464-4914-95aa-66541163b15c None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:42.815656 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416e04d-3f07-474a-9295-dc7793e15e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:42.816686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416e04d-3f07-474a-9295-dc7793e15e08 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:42.817161 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416e04d-3f07-474a-9295-dc7793e15e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:42.817587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416e04d-3f07-474a-9295-dc7793e15e08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:42.821619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:42.825348 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416e04d-3f07-474a-9295-dc7793e15e08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:42.827028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416e04d-3f07-474a-9295-dc7793e15e08 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:42.841708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-4416e04d-3f07-474a-9295-dc7793e15e08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:42.841708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:42.841708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:42.841708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:42.841708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:42.841708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:42.841708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:42.841708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:42.841708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:42.841708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:42.841708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:42.841708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:42.841708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:42.841708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:42.841708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:42.842666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:42.843551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:42.843551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:42.843551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:42.843551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:42.843551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:42.843551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:42.843551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:42.843551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:42.843551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 292/581] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:42.845284 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416e04d-3f07-474a-9295-dc7793e15e08 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:42.853148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96153f0b-0fe4-4f00-95c8-5eb4ca912a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:42.854018 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96153f0b-0fe4-4f00-95c8-5eb4ca912a18 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:42.854313 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96153f0b-0fe4-4f00-95c8-5eb4ca912a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:42.854596 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96153f0b-0fe4-4f00-95c8-5eb4ca912a18 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:42.855333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96153f0b-0fe4-4f00-95c8-5eb4ca912a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:42.855648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96153f0b-0fe4-4f00-95c8-5eb4ca912a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:42.857125 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96153f0b-0fe4-4f00-95c8-5eb4ca912a18 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:42.872991 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 290/582] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:42.872991 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96153f0b-0fe4-4f00-95c8-5eb4ca912a18 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:42.905232 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:42.961576 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416e04d-3f07-474a-9295-dc7793e15e08 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:42.982429 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96153f0b-0fe4-4f00-95c8-5eb4ca912a18 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:42.995754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d843c0-1612-4559-b7c4-08478186ad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:42.996436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d843c0-1612-4559-b7c4-08478186ad66 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:42.996719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d843c0-1612-4559-b7c4-08478186ad66 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:42.997029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d843c0-1612-4559-b7c4-08478186ad66 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:42.997896 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d843c0-1612-4559-b7c4-08478186ad66 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:42.998204 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d843c0-1612-4559-b7c4-08478186ad66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:42.999665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d843c0-1612-4559-b7c4-08478186ad66 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:43.022689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 293/583] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Jun 1 17:25:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:43.022689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d843c0-1612-4559-b7c4-08478186ad66 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:43.028244 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc082ca-24e0-4490-b193-825302f671da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:43.028912 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc082ca-24e0-4490-b193-825302f671da None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:43.029493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc082ca-24e0-4490-b193-825302f671da None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:43.029612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc082ca-24e0-4490-b193-825302f671da None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:43.030367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc082ca-24e0-4490-b193-825302f671da None admin] RBAC: Adding query filter params (name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:43.030668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc082ca-24e0-4490-b193-825302f671da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:43.032860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc082ca-24e0-4490-b193-825302f671da None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:43.042678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 291/584] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:43.042678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc082ca-24e0-4490-b193-825302f671da None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:43.079885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:43.136062 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d843c0-1612-4559-b7c4-08478186ad66 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:43.147906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:43.151566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc082ca-24e0-4490-b193-825302f671da None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:43.173364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f0c59-61ff-4660-9b6a-a775d8df0e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:43.174029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f0c59-61ff-4660-9b6a-a775d8df0e1e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:43.174327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f0c59-61ff-4660-9b6a-a775d8df0e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:43.174591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f0c59-61ff-4660-9b6a-a775d8df0e1e None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:43.175379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f0c59-61ff-4660-9b6a-a775d8df0e1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:43.175803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f0c59-61ff-4660-9b6a-a775d8df0e1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:43.177361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f0c59-61ff-4660-9b6a-a775d8df0e1e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:43.186982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8443a-3c26-400f-a7f4-74e561196e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:43.187988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8443a-3c26-400f-a7f4-74e561196e04 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:43.188275 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8443a-3c26-400f-a7f4-74e561196e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:43.188560 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8443a-3c26-400f-a7f4-74e561196e04 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:43.190739 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 294/585] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:43.191869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f0c59-61ff-4660-9b6a-a775d8df0e1e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:43.201518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8443a-3c26-400f-a7f4-74e561196e04 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:43.203016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8443a-3c26-400f-a7f4-74e561196e04 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-82b8443a-3c26-400f-a7f4-74e561196e04 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:43.217747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:43.219400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:43.220667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:43.220667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:43.220667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:43.220667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:43.220667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:43.220667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:43.220667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:43.220667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:43.220667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 17:25:43.220667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:43.220667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 292/586] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:43.224797 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8443a-3c26-400f-a7f4-74e561196e04 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:43.311360 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f0c59-61ff-4660-9b6a-a775d8df0e1e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:43.330496 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:43.337145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8443a-3c26-400f-a7f4-74e561196e04 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:43.351754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac53a1-c753-4d68-a632-67aa2bc4e824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:43.352823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac53a1-c753-4d68-a632-67aa2bc4e824 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:43.353135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac53a1-c753-4d68-a632-67aa2bc4e824 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:43.366943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac53a1-c753-4d68-a632-67aa2bc4e824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:43.366943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac53a1-c753-4d68-a632-67aa2bc4e824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:43.366943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac53a1-c753-4d68-a632-67aa2bc4e824 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:43.372778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb3e3b-4dbd-48d5-97eb-39afd989e9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:43.373615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb3e3b-4dbd-48d5-97eb-39afd989e9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:43.373904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb3e3b-4dbd-48d5-97eb-39afd989e9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:43.374183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb3e3b-4dbd-48d5-97eb-39afd989e9a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:43.385102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-51ac53a1-c753-4d68-a632-67aa2bc4e824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:43.385102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:43.385102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:43.385102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:43.385102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:43.385102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:43.385102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:43.385102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:43.385102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:43.385102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:43.385102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:43.385102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:43.385102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:43.385102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:43.385102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:43.386004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:43.386930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:43.386930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:43.386930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:43.386930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:43.387164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb3e3b-4dbd-48d5-97eb-39afd989e9a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:43.387164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb3e3b-4dbd-48d5-97eb-39afd989e9a4 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:43.391137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 295/587] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:43.391999 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac53a1-c753-4d68-a632-67aa2bc4e824 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:43.407778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-e3fb3e3b-4dbd-48d5-97eb-39afd989e9a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:43.407778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:43.407778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:43.407778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:43.407778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:43.407778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:43.407778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:43.407778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:43.407778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:43.407778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:43.407778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:43.407778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:43.407778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:43.407778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:43.407778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:43.408702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:43.409984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:43.409984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:43.409984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:43.409984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:43.409984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 293/588] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:43.409984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb3e3b-4dbd-48d5-97eb-39afd989e9a4 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:43.423072 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:43.503886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac53a1-c753-4d68-a632-67aa2bc4e824 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:43.531150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb3e3b-4dbd-48d5-97eb-39afd989e9a4 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:43.538047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b24b4-42f7-497b-b8de-63aea8e4ad3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:43.538707 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b24b4-42f7-497b-b8de-63aea8e4ad3b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:43.538995 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b24b4-42f7-497b-b8de-63aea8e4ad3b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:43.539283 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b24b4-42f7-497b-b8de-63aea8e4ad3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:43.540110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b24b4-42f7-497b-b8de-63aea8e4ad3b None admin] RBAC: Adding query filter params (role.id=97f88c6182044737a47af038d94a74b8, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=3f43a4bb5a18445b8836f4613cd5e14b) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:43.540431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b24b4-42f7-497b-b8de-63aea8e4ad3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:43.541977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b24b4-42f7-497b-b8de-63aea8e4ad3b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:43.548446 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 296/589] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:25:43 2022] GET /identity/v3/role_assignments?user.id=3f43a4bb5a18445b8836f4613cd5e14b&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=97f88c6182044737a47af038d94a74b8 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:43.557955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b24b4-42f7-497b-b8de-63aea8e4ad3b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:43.570918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8a9de-e632-4e4d-8077-d87217df981a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:43.571868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8a9de-e632-4e4d-8077-d87217df981a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:43.572302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8a9de-e632-4e4d-8077-d87217df981a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:43.572771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8a9de-e632-4e4d-8077-d87217df981a None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:43.573836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8a9de-e632-4e4d-8077-d87217df981a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:43.574357 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8a9de-e632-4e4d-8077-d87217df981a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:43.576040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8a9de-e632-4e4d-8077-d87217df981a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:43.601341 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 294/590] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Jun 1 17:25:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:43.602885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8a9de-e632-4e4d-8077-d87217df981a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:43.608065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:43.669531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:43.688818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b24b4-42f7-497b-b8de-63aea8e4ad3b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:43.719650 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8a9de-e632-4e4d-8077-d87217df981a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:43.730153 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2399c78-9325-424b-814b-8ee13dc29866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:43.730942 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2399c78-9325-424b-814b-8ee13dc29866 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:43.731297 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2399c78-9325-424b-814b-8ee13dc29866 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:43.731667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2399c78-9325-424b-814b-8ee13dc29866 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:43.732522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2399c78-9325-424b-814b-8ee13dc29866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:43.732900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2399c78-9325-424b-814b-8ee13dc29866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:43.734875 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2399c78-9325-424b-814b-8ee13dc29866 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:43.748718 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 297/591] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:43.750550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2399c78-9325-424b-814b-8ee13dc29866 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:43.835207 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd251c5-fc6b-48fa-a60d-5d80249815b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:43.836225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd251c5-fc6b-48fa-a60d-5d80249815b1 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:43.836839 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd251c5-fc6b-48fa-a60d-5d80249815b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:43.837346 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd251c5-fc6b-48fa-a60d-5d80249815b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:43.838298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd251c5-fc6b-48fa-a60d-5d80249815b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:43.838862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd251c5-fc6b-48fa-a60d-5d80249815b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:43.840536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd251c5-fc6b-48fa-a60d-5d80249815b1 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:43.858362 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 295/592] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:43.860269 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd251c5-fc6b-48fa-a60d-5d80249815b1 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:43.900572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2399c78-9325-424b-814b-8ee13dc29866 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:43.930475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:43.935655 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cf519-de6c-4717-80f3-1c6a3f42ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:43.936911 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cf519-de6c-4717-80f3-1c6a3f42ba92 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:43.936911 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cf519-de6c-4717-80f3-1c6a3f42ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:43.937128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cf519-de6c-4717-80f3-1c6a3f42ba92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:43.948954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cf519-de6c-4717-80f3-1c6a3f42ba92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:43.950422 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cf519-de6c-4717-80f3-1c6a3f42ba92 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:43.957910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:43.969631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-307cf519-de6c-4717-80f3-1c6a3f42ba92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:43.969631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:43.969631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:43.969631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:43.969631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:43.969631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:43.969631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:43.969631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:43.969631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:43.969631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:43.969631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:43.969631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:43.969631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:43.969631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:43.969631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:43.970550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:43.971514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:43.971514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:43.971514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:43.971514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:43.975337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 298/593] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:43.976273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cf519-de6c-4717-80f3-1c6a3f42ba92 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:43.980776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd251c5-fc6b-48fa-a60d-5d80249815b1 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:44.019759 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533d810-35d0-478f-9e64-996b86586f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:44.020983 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533d810-35d0-478f-9e64-996b86586f27 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:44.021571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533d810-35d0-478f-9e64-996b86586f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:44.022050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533d810-35d0-478f-9e64-996b86586f27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:44.029891 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533d810-35d0-478f-9e64-996b86586f27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:44.032114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533d810-35d0-478f-9e64-996b86586f27 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:44.049761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-7533d810-35d0-478f-9e64-996b86586f27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:44.049761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:44.049761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:44.049761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:44.049761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:44.049761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:44.049761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:44.049761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:44.049761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:44.049761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:44.049761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:44.049761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:44.049761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:44.049761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:44.049761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:44.050708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:44.051621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:44.051621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:44.051621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:44.051621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:44.051621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:44.051621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:44.051621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:44.051621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:44.054207 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 296/594] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:44.055235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533d810-35d0-478f-9e64-996b86586f27 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:44.081620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cf519-de6c-4717-80f3-1c6a3f42ba92 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:44.117171 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec069706-0e51-47ef-9580-6333a53bbc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:44.117928 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec069706-0e51-47ef-9580-6333a53bbc18 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:44.118221 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec069706-0e51-47ef-9580-6333a53bbc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:44.118484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec069706-0e51-47ef-9580-6333a53bbc18 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:44.127131 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec069706-0e51-47ef-9580-6333a53bbc18 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:44.128592 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec069706-0e51-47ef-9580-6333a53bbc18 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-ec069706-0e51-47ef-9580-6333a53bbc18 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:44.143411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:44.144410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:44.145396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:44.145396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:44.145396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:44.145396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:44.145396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:44.145396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:44.145396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:44.145396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:44.145396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 01 17:25:44.145396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:44.149265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 299/595] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:44.149904 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec069706-0e51-47ef-9580-6333a53bbc18 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:44.174353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533d810-35d0-478f-9e64-996b86586f27 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:44.201453 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:44.210482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:44.215033 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d272dd-cde3-41bd-9050-2530d33dee5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:44.216115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d272dd-cde3-41bd-9050-2530d33dee5e None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:44.216611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d272dd-cde3-41bd-9050-2530d33dee5e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:44.217148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d272dd-cde3-41bd-9050-2530d33dee5e None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:44.218107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d272dd-cde3-41bd-9050-2530d33dee5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:44.218667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d272dd-cde3-41bd-9050-2530d33dee5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:44.220598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d272dd-cde3-41bd-9050-2530d33dee5e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:44.233585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 297/596] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:44.235950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d272dd-cde3-41bd-9050-2530d33dee5e None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:44.256836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec069706-0e51-47ef-9580-6333a53bbc18 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:44.292563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e52b17-2f42-47b0-841a-d4a6510ef2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:44.293280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e52b17-2f42-47b0-841a-d4a6510ef2cf None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:44.293565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e52b17-2f42-47b0-841a-d4a6510ef2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:44.293847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e52b17-2f42-47b0-841a-d4a6510ef2cf None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:44.294645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e52b17-2f42-47b0-841a-d4a6510ef2cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:44.294978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e52b17-2f42-47b0-841a-d4a6510ef2cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:44.296403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e52b17-2f42-47b0-841a-d4a6510ef2cf None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:44.310312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 300/597] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:44.311243 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e52b17-2f42-47b0-841a-d4a6510ef2cf None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:44.353646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d272dd-cde3-41bd-9050-2530d33dee5e None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:44.396548 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a60d8-ed76-411f-a4d9-f362194788eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:44.397757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a60d8-ed76-411f-a4d9-f362194788eb None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:44.398273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a60d8-ed76-411f-a4d9-f362194788eb None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:44.398804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a60d8-ed76-411f-a4d9-f362194788eb None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:44.399898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a60d8-ed76-411f-a4d9-f362194788eb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:44.400416 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a60d8-ed76-411f-a4d9-f362194788eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:44.402315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a60d8-ed76-411f-a4d9-f362194788eb None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:44.417742 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e52b17-2f42-47b0-841a-d4a6510ef2cf None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:44.424694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 298/598] 10.222.0.33 () {56 vars in 1139 bytes} [Wed Jun 1 17:25:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:44.425826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a60d8-ed76-411f-a4d9-f362194788eb None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:44.441553 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:44.461464 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022f3ef-f4ea-4408-80a4-cbaf09027b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:44.462324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022f3ef-f4ea-4408-80a4-cbaf09027b38 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:44.462610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022f3ef-f4ea-4408-80a4-cbaf09027b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:44.462887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022f3ef-f4ea-4408-80a4-cbaf09027b38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:44.471224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022f3ef-f4ea-4408-80a4-cbaf09027b38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:44.472172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022f3ef-f4ea-4408-80a4-cbaf09027b38 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:44.484412 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:44.491361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-7022f3ef-f4ea-4408-80a4-cbaf09027b38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:44.491361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:44.491361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:44.491361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:44.491361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:44.491361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:44.491361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:44.491361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:44.491361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:44.491361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:44.491361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:44.491361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:44.491361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:44.491361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:44.491361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:44.496831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:44.497881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:44.497881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:44.497881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:44.497881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:44.497881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:44.497881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:44.497881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:44.497881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:44.497881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 301/599] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:44.497881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022f3ef-f4ea-4408-80a4-cbaf09027b38 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:44.554554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a60d8-ed76-411f-a4d9-f362194788eb None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:44.594437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf254243-d616-4e11-a141-a303bdc67b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:44.595780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf254243-d616-4e11-a141-a303bdc67b42 None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:44.596260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf254243-d616-4e11-a141-a303bdc67b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:44.596757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf254243-d616-4e11-a141-a303bdc67b42 None admin] PATH_INFO: `/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/b34d05889f3c4d469f4661061457cb95/roles/97f88c6182044737a47af038d94a74b8` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:44.605760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022f3ef-f4ea-4408-80a4-cbaf09027b38 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:44.614464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf254243-d616-4e11-a141-a303bdc67b42 None admin] RBAC: Authorizing `identity:create_grant(project_id=68bf9a1e88a64a02ba53d0bedb76072a, user_id=b34d05889f3c4d469f4661061457cb95, role_id=97f88c6182044737a47af038d94a74b8)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:44.616326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf254243-d616-4e11-a141-a303bdc67b42 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:44.642436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3fd18-354b-4c88-b5d8-4f8b0653ad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:44.643238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3fd18-354b-4c88-b5d8-4f8b0653ad7a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:44.643520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3fd18-354b-4c88-b5d8-4f8b0653ad7a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:44.643848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3fd18-354b-4c88-b5d8-4f8b0653ad7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:44.660476 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3fd18-354b-4c88-b5d8-4f8b0653ad7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:44.660476 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3fd18-354b-4c88-b5d8-4f8b0653ad7a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:44.674555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-09a3fd18-354b-4c88-b5d8-4f8b0653ad7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:44.674555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:44.674555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:44.674555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:44.674555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:44.674555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:44.674555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:44.674555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:44.674555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:44.674555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:44.674555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:44.674555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:44.674555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:44.674555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:44.674555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:44.675436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:44.676364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:44.676364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:44.676364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:44.676364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:44.677138 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 302/600] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:44.678182 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3fd18-354b-4c88-b5d8-4f8b0653ad7a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:44.689356 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 299/601] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:25:44 2022] PUT /identity/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/b34d05889f3c4d469f4661061457cb95/roles/97f88c6182044737a47af038d94a74b8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:25:44.696425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf254243-d616-4e11-a141-a303bdc67b42 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:44.718123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:44.801004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3fd18-354b-4c88-b5d8-4f8b0653ad7a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:44.850461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:44.863358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf254243-d616-4e11-a141-a303bdc67b42 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:44.891194 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd7b6f-b5a7-47cc-bd82-5c56e00c40e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:44.892175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7b6f-b5a7-47cc-bd82-5c56e00c40e1 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:44.892359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7b6f-b5a7-47cc-bd82-5c56e00c40e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:44.892701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7b6f-b5a7-47cc-bd82-5c56e00c40e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:44.893519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd7b6f-b5a7-47cc-bd82-5c56e00c40e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:44.893900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd7b6f-b5a7-47cc-bd82-5c56e00c40e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:44.895355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd7b6f-b5a7-47cc-bd82-5c56e00c40e1 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:44.907693 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fda010-f5f4-40f7-98bd-7d3f9829b62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:44.908797 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fda010-f5f4-40f7-98bd-7d3f9829b62a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:44.909419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fda010-f5f4-40f7-98bd-7d3f9829b62a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:44.909901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fda010-f5f4-40f7-98bd-7d3f9829b62a None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:44.911019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fda010-f5f4-40f7-98bd-7d3f9829b62a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:44.911538 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fda010-f5f4-40f7-98bd-7d3f9829b62a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:44.913424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fda010-f5f4-40f7-98bd-7d3f9829b62a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:44.916664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 303/602] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:44.918157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae0c77-d1b6-47a9-ad0c-64951bd63e74 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:44.918451 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae0c77-d1b6-47a9-ad0c-64951bd63e74 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:44.918729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae0c77-d1b6-47a9-ad0c-64951bd63e74 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:44.924911 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 304/603] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:44.925853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae0c77-d1b6-47a9-ad0c-64951bd63e74 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:44.931032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 300/604] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:44.932778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a5559-e207-4fad-a4ae-8501d03a415a None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:44.933299 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a5559-e207-4fad-a4ae-8501d03a415a None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:44.933862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a5559-e207-4fad-a4ae-8501d03a415a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:44.953702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-eb2a5559-e207-4fad-a4ae-8501d03a415a None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:44.955348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-eb2a5559-e207-4fad-a4ae-8501d03a415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:45.038569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:45.051621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 301/605] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:45.052501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a5559-e207-4fad-a4ae-8501d03a415a None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:45.052634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae0c77-d1b6-47a9-ad0c-64951bd63e74 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:45.100618 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc959497-a089-4b32-b809-0aced648e5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:45.101978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc959497-a089-4b32-b809-0aced648e5c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:45.102524 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc959497-a089-4b32-b809-0aced648e5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:45.102806 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc959497-a089-4b32-b809-0aced648e5c9 None admin] PATH_INFO: `/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/98d9e5912b8c4f36922cde62830fb7ac/roles/97f88c6182044737a47af038d94a74b8` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:45.121683 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc959497-a089-4b32-b809-0aced648e5c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=68bf9a1e88a64a02ba53d0bedb76072a, user_id=98d9e5912b8c4f36922cde62830fb7ac, role_id=97f88c6182044737a47af038d94a74b8)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:45.123147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc959497-a089-4b32-b809-0aced648e5c9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:45.148574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:45.167439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a5559-e207-4fad-a4ae-8501d03a415a None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:45.202373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e4891-6152-4826-bb6f-42740701b52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:45.204142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e4891-6152-4826-bb6f-42740701b52b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:45.204634 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e4891-6152-4826-bb6f-42740701b52b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:45.205142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e4891-6152-4826-bb6f-42740701b52b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:45.220165 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e4891-6152-4826-bb6f-42740701b52b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:45.220860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 305/606] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:25:44 2022] PUT /identity/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/98d9e5912b8c4f36922cde62830fb7ac/roles/97f88c6182044737a47af038d94a74b8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:25:45.222132 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc959497-a089-4b32-b809-0aced648e5c9 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:45.222241 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e4891-6152-4826-bb6f-42740701b52b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:45.241889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-a76e4891-6152-4826-bb6f-42740701b52b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:45.241889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:45.241889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:45.241889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:45.241889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:45.241889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:45.241889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:45.241889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:45.241889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:45.241889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:45.241889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:45.241889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:45.241889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:45.241889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:45.241889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:45.242868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:45.244162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:45.244162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:45.244162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:45.244162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:45.244162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:45.244162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:45.244162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:45.244162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:45.244797 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 302/607] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:45.254266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e4891-6152-4826-bb6f-42740701b52b None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:45.441337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc959497-a089-4b32-b809-0aced648e5c9 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:45.482027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e4891-6152-4826-bb6f-42740701b52b None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:45.497685 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c7dd2-268b-4467-9628-78360263ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:45.498620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c7dd2-268b-4467-9628-78360263ad2d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:45.498828 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c7dd2-268b-4467-9628-78360263ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:45.499053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c7dd2-268b-4467-9628-78360263ad2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:45.511378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:45.515791 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c7dd2-268b-4467-9628-78360263ad2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:45.523375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52324e-ab9c-4b04-8e84-85a48f23e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:45.524300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52324e-ab9c-4b04-8e84-85a48f23e134 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-b72c7dd2-268b-4467-9628-78360263ad2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:45.530803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:45.531760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:45.532684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:45.532684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:45.532684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:45.532684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:45.532684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:45.532684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:45.532684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:45.532684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:45.532684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:45.532684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:45.532684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:45.532684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:45.533845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52324e-ab9c-4b04-8e84-85a48f23e134 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:45.533845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52324e-ab9c-4b04-8e84-85a48f23e134 None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:45.533845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52324e-ab9c-4b04-8e84-85a48f23e134 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:45.533845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52324e-ab9c-4b04-8e84-85a48f23e134 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:45.534116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 306/608] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:45.534188 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52324e-ab9c-4b04-8e84-85a48f23e134 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:45.534263 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c7dd2-268b-4467-9628-78360263ad2d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:45.547573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 303/609] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:45.550434 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52324e-ab9c-4b04-8e84-85a48f23e134 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:45.553561 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:45.647199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c7dd2-268b-4467-9628-78360263ad2d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:45.664581 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52324e-ab9c-4b04-8e84-85a48f23e134 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:45.711223 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0c714-3a4f-4fda-adf0-2608111f230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:45.712069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0c714-3a4f-4fda-adf0-2608111f230b None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:45.712358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0c714-3a4f-4fda-adf0-2608111f230b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:45.712640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0c714-3a4f-4fda-adf0-2608111f230b None admin] PATH_INFO: `/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/4254398f2aac42f7b54f29294a73bfda/roles/97f88c6182044737a47af038d94a74b8` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:45.715166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2dec7-512a-4b4b-bf6a-a071722d587a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:45.716022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2dec7-512a-4b4b-bf6a-a071722d587a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:45.716309 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2dec7-512a-4b4b-bf6a-a071722d587a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:45.716590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2dec7-512a-4b4b-bf6a-a071722d587a None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:45.717716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2dec7-512a-4b4b-bf6a-a071722d587a None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:45.718030 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2dec7-512a-4b4b-bf6a-a071722d587a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:45.719462 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2dec7-512a-4b4b-bf6a-a071722d587a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:45.743755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 307/610] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:45.750577 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0c714-3a4f-4fda-adf0-2608111f230b None admin] RBAC: Authorizing `identity:create_grant(project_id=68bf9a1e88a64a02ba53d0bedb76072a, user_id=4254398f2aac42f7b54f29294a73bfda, role_id=97f88c6182044737a47af038d94a74b8)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:45.751518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2dec7-512a-4b4b-bf6a-a071722d587a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:45.752184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0c714-3a4f-4fda-adf0-2608111f230b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:45.820208 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:45.845080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 304/611] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:25:45 2022] PUT /identity/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/4254398f2aac42f7b54f29294a73bfda/roles/97f88c6182044737a47af038d94a74b8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:25:45.866281 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2dec7-512a-4b4b-bf6a-a071722d587a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:45.903627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be650b1d-5597-4037-b598-36731c480709 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:45.904155 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be650b1d-5597-4037-b598-36731c480709 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:45.904390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be650b1d-5597-4037-b598-36731c480709 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:45.904491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c69b9-3490-4b8b-90ad-fb63dcca17aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:45.905305 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c69b9-3490-4b8b-90ad-fb63dcca17aa None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:45.905650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c69b9-3490-4b8b-90ad-fb63dcca17aa None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:45.906522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c69b9-3490-4b8b-90ad-fb63dcca17aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:45.906628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 305/612] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:45.912506 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fef41-cde2-4954-94b4-7a3b38609519 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:45.912835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fef41-cde2-4954-94b4-7a3b38609519 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:45.913095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fef41-cde2-4954-94b4-7a3b38609519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:45.926270 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c69b9-3490-4b8b-90ad-fb63dcca17aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:45.927774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c69b9-3490-4b8b-90ad-fb63dcca17aa None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:45.947568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-717c69b9-3490-4b8b-90ad-fb63dcca17aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:45.947568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:45.947568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:45.947568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:45.947568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:45.947568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:45.947568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:45.947568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:45.947568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:45.947568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:45.947568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:45.947568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:45.947568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:45.947568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:45.947568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:45.948536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:45.949497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:45.949497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:45.949497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:45.949497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:45.949497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 308/613] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:45.955626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c69b9-3490-4b8b-90ad-fb63dcca17aa None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:45.961436 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-7f3fef41-cde2-4954-94b4-7a3b38609519 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:45.969362 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7f3fef41-cde2-4954-94b4-7a3b38609519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:46.044017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:46.071762 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 306/614] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 01 17:25:46.103509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fef41-cde2-4954-94b4-7a3b38609519 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:46.151726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c69b9-3490-4b8b-90ad-fb63dcca17aa None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:46.180342 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:46.225164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fef41-cde2-4954-94b4-7a3b38609519 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:46.234253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8c794-219d-48a8-a5b8-2198c365535d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:46.234948 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8c794-219d-48a8-a5b8-2198c365535d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:46.235232 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8c794-219d-48a8-a5b8-2198c365535d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:46.235507 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8c794-219d-48a8-a5b8-2198c365535d None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:46.236242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8c794-219d-48a8-a5b8-2198c365535d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:46.236545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8c794-219d-48a8-a5b8-2198c365535d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:46.237955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8c794-219d-48a8-a5b8-2198c365535d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:46.264313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 309/615] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:46.265956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d922d-1953-4af0-9b18-96e2d9c8e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:46.266948 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d922d-1953-4af0-9b18-96e2d9c8e18f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:46.267235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d922d-1953-4af0-9b18-96e2d9c8e18f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:46.267606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d922d-1953-4af0-9b18-96e2d9c8e18f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:46.268996 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8c794-219d-48a8-a5b8-2198c365535d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:46.290897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d922d-1953-4af0-9b18-96e2d9c8e18f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-797d922d-1953-4af0-9b18-96e2d9c8e18f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:46.315326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:46.316342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:46.317247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:46.317247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:46.317247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:46.317247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:46.317247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:46.317247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:46.317247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:46.317247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:46.317247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:46.317247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:46.317247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:46.317247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:46.317897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 307/616] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:46.323830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d922d-1953-4af0-9b18-96e2d9c8e18f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:46.405330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:46.478374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8c794-219d-48a8-a5b8-2198c365535d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:46.519675 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d922d-1953-4af0-9b18-96e2d9c8e18f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:46.545887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95683c11-9130-4ba8-b680-fdcef1e71cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:46.547338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95683c11-9130-4ba8-b680-fdcef1e71cca None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:46.547831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95683c11-9130-4ba8-b680-fdcef1e71cca None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:46.548139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95683c11-9130-4ba8-b680-fdcef1e71cca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:46.559972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95683c11-9130-4ba8-b680-fdcef1e71cca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:46.562851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95683c11-9130-4ba8-b680-fdcef1e71cca None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-95683c11-9130-4ba8-b680-fdcef1e71cca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:46.584174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:46.585393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:46.586368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:46.586368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:46.586368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:46.586368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:46.586368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:46.586368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:46.586368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:46.586368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:46.586368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:25:46.586368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:46.588086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeca2bc-e1c9-4cac-b580-6dbf7963deae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:46.588763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeca2bc-e1c9-4cac-b580-6dbf7963deae None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:46.589074 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeca2bc-e1c9-4cac-b580-6dbf7963deae None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:46.589358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeca2bc-e1c9-4cac-b580-6dbf7963deae None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:46.590116 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeca2bc-e1c9-4cac-b580-6dbf7963deae None admin] RBAC: Adding query filter params (name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:46.590430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeca2bc-e1c9-4cac-b580-6dbf7963deae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:46.591802 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeca2bc-e1c9-4cac-b580-6dbf7963deae None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:46.595281 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 310/617] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jun 1 17:25:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:46.600217 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95683c11-9130-4ba8-b680-fdcef1e71cca None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:46.606413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 308/618] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:46.611352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeca2bc-e1c9-4cac-b580-6dbf7963deae None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:46.652040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:46.738909 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95683c11-9130-4ba8-b680-fdcef1e71cca None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:46.745344 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeca2bc-e1c9-4cac-b580-6dbf7963deae None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:46.761290 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:46.801672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b13fa-c802-4727-86bd-10a2a98aa0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:46.802753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b13fa-c802-4727-86bd-10a2a98aa0fc None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:46.803074 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa3576-086b-4287-a7bc-eca3345cf931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:46.803499 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b13fa-c802-4727-86bd-10a2a98aa0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:46.803906 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa3576-086b-4287-a7bc-eca3345cf931 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:46.804187 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa3576-086b-4287-a7bc-eca3345cf931 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:46.804383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b13fa-c802-4727-86bd-10a2a98aa0fc None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:46.804483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa3576-086b-4287-a7bc-eca3345cf931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:46.805588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b13fa-c802-4727-86bd-10a2a98aa0fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:46.806127 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b13fa-c802-4727-86bd-10a2a98aa0fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:46.814257 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b13fa-c802-4727-86bd-10a2a98aa0fc None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:46.815836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa3576-086b-4287-a7bc-eca3345cf931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:46.817508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa3576-086b-4287-a7bc-eca3345cf931 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:46.842238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-abaa3576-086b-4287-a7bc-eca3345cf931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:46.842238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:46.842238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:46.842238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:46.842238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:46.842238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:46.842238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:46.842238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:46.842238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:46.842238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:46.842238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:46.842238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:46.842238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:46.842238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:46.842238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:46.843266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:46.844715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:46.844715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:46.844715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:46.844715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:46.844715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 309/619] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:46.851791 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa3576-086b-4287-a7bc-eca3345cf931 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:46.859884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 311/620] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jun 1 17:25:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:46.866549 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b13fa-c802-4727-86bd-10a2a98aa0fc None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:47.007365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa3576-086b-4287-a7bc-eca3345cf931 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:47.043544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3fb8b-b3ef-4e62-ae50-b2ba7e96ef46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:47.044207 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3fb8b-b3ef-4e62-ae50-b2ba7e96ef46 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:47.044488 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3fb8b-b3ef-4e62-ae50-b2ba7e96ef46 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:47.044762 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3fb8b-b3ef-4e62-ae50-b2ba7e96ef46 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:47.045515 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3fb8b-b3ef-4e62-ae50-b2ba7e96ef46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:47.045849 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3fb8b-b3ef-4e62-ae50-b2ba7e96ef46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:47.047878 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3fb8b-b3ef-4e62-ae50-b2ba7e96ef46 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:47.060897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 310/621] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:47.067198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3fb8b-b3ef-4e62-ae50-b2ba7e96ef46 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:47.093418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:47.142251 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:47.180796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3fb8b-b3ef-4e62-ae50-b2ba7e96ef46 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:47.186900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b13fa-c802-4727-86bd-10a2a98aa0fc None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:47.218413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e11073-5d8c-4cf2-a948-237cb5f9e3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:47.219726 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e11073-5d8c-4cf2-a948-237cb5f9e3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:47.220009 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e11073-5d8c-4cf2-a948-237cb5f9e3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:47.220278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e11073-5d8c-4cf2-a948-237cb5f9e3a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:47.228138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e11073-5d8c-4cf2-a948-237cb5f9e3a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:47.229638 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e11073-5d8c-4cf2-a948-237cb5f9e3a7 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-33e11073-5d8c-4cf2-a948-237cb5f9e3a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:47.246211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:47.248451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:47.251081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:47.251081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:47.251081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:47.251081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:47.251081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:47.251081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:47.251081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:47.251081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:47.251081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 01 17:25:47.251081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:47.251081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 311/622] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:25:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:47.257025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e11073-5d8c-4cf2-a948-237cb5f9e3a7 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:47.285564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14064c-e5d2-481b-a35c-58bf0df3eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:47.286289 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14064c-e5d2-481b-a35c-58bf0df3eaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:47.286577 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14064c-e5d2-481b-a35c-58bf0df3eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:47.286856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14064c-e5d2-481b-a35c-58bf0df3eaf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:47.358377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14064c-e5d2-481b-a35c-58bf0df3eaf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:47.360493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14064c-e5d2-481b-a35c-58bf0df3eaf6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:47.403044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:47.432197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e11073-5d8c-4cf2-a948-237cb5f9e3a7 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:47.479883 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:47.491331 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b442a-b863-4074-93df-481af5e77700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:47.492263 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b442a-b863-4074-93df-481af5e77700 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:47.492695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b442a-b863-4074-93df-481af5e77700 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:47.493202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b442a-b863-4074-93df-481af5e77700 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:47.493653 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 312/623] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 01 17:25:47.494348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b442a-b863-4074-93df-481af5e77700 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:47.494805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b442a-b863-4074-93df-481af5e77700 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:47.494987 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee1558-7651-4a02-8b79-9ff39cdf4a87 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:47.495274 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee1558-7651-4a02-8b79-9ff39cdf4a87 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:47.495549 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee1558-7651-4a02-8b79-9ff39cdf4a87 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:47.500859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b442a-b863-4074-93df-481af5e77700 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:47.501024 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 313/624] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:47.501024 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee1558-7651-4a02-8b79-9ff39cdf4a87 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:47.535953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 312/625] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Jun 1 17:25:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:47.535953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d87fed-c137-4c42-a73f-50d66c36a51d None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:47.535953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d87fed-c137-4c42-a73f-50d66c36a51d None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:47.535953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d87fed-c137-4c42-a73f-50d66c36a51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:47.557252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b6d87fed-c137-4c42-a73f-50d66c36a51d None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:47.558485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b6d87fed-c137-4c42-a73f-50d66c36a51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:47.636959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 313/626] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:47.636959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d87fed-c137-4c42-a73f-50d66c36a51d None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:47.654450 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee1558-7651-4a02-8b79-9ff39cdf4a87 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:47.703209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1379c-8aba-4ee0-bc75-dcced55476e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:47.704993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1379c-8aba-4ee0-bc75-dcced55476e0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:47.705710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1379c-8aba-4ee0-bc75-dcced55476e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:47.706157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1379c-8aba-4ee0-bc75-dcced55476e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:47.714266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:47.724319 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1379c-8aba-4ee0-bc75-dcced55476e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:47.725933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1379c-8aba-4ee0-bc75-dcced55476e0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:47.749272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-6ed1379c-8aba-4ee0-bc75-dcced55476e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:47.749272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:47.749272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:47.749272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:47.749272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:47.749272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:47.749272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:47.749272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:47.749272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:47.749272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:47.749272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:47.749272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:47.749272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:47.749272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:47.749272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:47.750800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:47.751697 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:47.751697 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:47.751697 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:47.751697 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:47.751697 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 314/627] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:47.752491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1379c-8aba-4ee0-bc75-dcced55476e0 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:47.761192 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d87fed-c137-4c42-a73f-50d66c36a51d None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:47.799356 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7e840-75ac-484d-a14a-0fc70d52b90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:47.800489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7e840-75ac-484d-a14a-0fc70d52b90b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:47.801021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7e840-75ac-484d-a14a-0fc70d52b90b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:47.801532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7e840-75ac-484d-a14a-0fc70d52b90b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:47.813100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:47.816082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7e840-75ac-484d-a14a-0fc70d52b90b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:47.817577 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7e840-75ac-484d-a14a-0fc70d52b90b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:47.836124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-fcb7e840-75ac-484d-a14a-0fc70d52b90b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:47.836124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:47.836124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:47.836124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:47.836124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:47.836124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:47.836124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:47.836124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:47.836124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:47.836124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:47.836124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:47.836124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:47.836124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:47.836124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:47.836124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:47.837120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:47.838210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:47.838210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:47.838210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:47.838210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:47.838210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 314/628] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:47.838970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7e840-75ac-484d-a14a-0fc70d52b90b None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:47.888502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1379c-8aba-4ee0-bc75-dcced55476e0 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:47.927101 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb4f3e-41eb-42ae-8819-1946a0a521a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:47.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb4f3e-41eb-42ae-8819-1946a0a521a3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:47.928183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb4f3e-41eb-42ae-8819-1946a0a521a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:47.928456 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb4f3e-41eb-42ae-8819-1946a0a521a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:47.940335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb4f3e-41eb-42ae-8819-1946a0a521a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:47.948254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7e840-75ac-484d-a14a-0fc70d52b90b None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-58fb4f3e-41eb-42ae-8819-1946a0a521a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:47.948537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:47.949654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:47.950511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:47.950511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:47.950511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:47.950511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:47.950511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:47.950511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:47.950511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:47.950511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:47.950511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:47.950511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:47.950511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:47.950511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:47.950511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 315/629] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:47.951900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb4f3e-41eb-42ae-8819-1946a0a521a3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:47.971250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:47.991041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaa251-470d-4e7e-91e9-97023a1c665d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:47.991721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa251-470d-4e7e-91e9-97023a1c665d None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:47.992026 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa251-470d-4e7e-91e9-97023a1c665d None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:47.992289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa251-470d-4e7e-91e9-97023a1c665d None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:47.993100 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaa251-470d-4e7e-91e9-97023a1c665d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:47.993358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaa251-470d-4e7e-91e9-97023a1c665d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:47.994794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaa251-470d-4e7e-91e9-97023a1c665d None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:48.012267 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 315/630] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:48.012267 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b948ce4-0630-4e92-99ef-d190cec77cb0 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:48.012267 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b948ce4-0630-4e92-99ef-d190cec77cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:48.012267 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b948ce4-0630-4e92-99ef-d190cec77cb0 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:48.012267 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 316/631] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:48.012267 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b948ce4-0630-4e92-99ef-d190cec77cb0 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:48.067518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb4f3e-41eb-42ae-8819-1946a0a521a3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:48.071080 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:48.103603 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec7505-1440-4838-8b3f-da90ef65e928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:48.104400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec7505-1440-4838-8b3f-da90ef65e928 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:48.105095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec7505-1440-4838-8b3f-da90ef65e928 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:48.105640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec7505-1440-4838-8b3f-da90ef65e928 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:48.106687 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec7505-1440-4838-8b3f-da90ef65e928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:48.107100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec7505-1440-4838-8b3f-da90ef65e928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:48.108911 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec7505-1440-4838-8b3f-da90ef65e928 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:48.120726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 316/632] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:48.121593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec7505-1440-4838-8b3f-da90ef65e928 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:48.128628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b948ce4-0630-4e92-99ef-d190cec77cb0 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:48.165234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1cc7d-16bc-427f-a758-873661b4e855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:48.165914 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1cc7d-16bc-427f-a758-873661b4e855 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:48.166194 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1cc7d-16bc-427f-a758-873661b4e855 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:48.166476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1cc7d-16bc-427f-a758-873661b4e855 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:48.167233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1cc7d-16bc-427f-a758-873661b4e855 None admin] RBAC: Adding query filter params (name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:48.167552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1cc7d-16bc-427f-a758-873661b4e855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:48.168961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1cc7d-16bc-427f-a758-873661b4e855 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:48.182139 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 317/633] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:48.182139 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa1c81-9726-4cb4-806a-dc26f5cc478e None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:48.182139 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa1c81-9726-4cb4-806a-dc26f5cc478e None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:48.182139 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa1c81-9726-4cb4-806a-dc26f5cc478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:48.198987 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-54aa1c81-9726-4cb4-806a-dc26f5cc478e None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:48.200218 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-54aa1c81-9726-4cb4-806a-dc26f5cc478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:48.234793 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:48.239052 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec7505-1440-4838-8b3f-da90ef65e928 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:48.275397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 318/634] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:48.276057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa1c81-9726-4cb4-806a-dc26f5cc478e None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:48.283151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd10ccf-ad0b-4e0e-a7cb-fe756571d9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:48.284318 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd10ccf-ad0b-4e0e-a7cb-fe756571d9fe None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:48.285355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd10ccf-ad0b-4e0e-a7cb-fe756571d9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:48.285895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd10ccf-ad0b-4e0e-a7cb-fe756571d9fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:48.296206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd10ccf-ad0b-4e0e-a7cb-fe756571d9fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:48.299546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd10ccf-ad0b-4e0e-a7cb-fe756571d9fe None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:48.319644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-1cd10ccf-ad0b-4e0e-a7cb-fe756571d9fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:48.319644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:48.319644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:48.319644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:48.319644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:48.319644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:48.319644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:48.319644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:48.319644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:48.319644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:48.319644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:48.319644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:48.319644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:48.319644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:48.319644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:48.320555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:48.321504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:48.321504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:48.321504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:48.321504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:48.321504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:48.321504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:48.321504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:48.321504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:48.321504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 317/635] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:48.322011 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd10ccf-ad0b-4e0e-a7cb-fe756571d9fe None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:48.350127 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:48.388843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa1c81-9726-4cb4-806a-dc26f5cc478e None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:48.429836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fd0d6-e6aa-4314-a88e-b90855ebcadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:48.430081 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd10ccf-ad0b-4e0e-a7cb-fe756571d9fe None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:48.430637 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fd0d6-e6aa-4314-a88e-b90855ebcadd None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:48.430916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fd0d6-e6aa-4314-a88e-b90855ebcadd None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:48.431184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fd0d6-e6aa-4314-a88e-b90855ebcadd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:48.438321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fd0d6-e6aa-4314-a88e-b90855ebcadd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:48.439843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fd0d6-e6aa-4314-a88e-b90855ebcadd None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:48.457066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-564fd0d6-e6aa-4314-a88e-b90855ebcadd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:48.457066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:48.457066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:48.457066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:48.457066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:48.457066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:48.457066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:48.457066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:48.457066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:48.457066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:48.457066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:48.457066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:48.457066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:48.457066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:48.457066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:48.458024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:48.458966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:48.458966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:48.458966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:48.458966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:48.458966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:48.458966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:48.458966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:48.458966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:48.459413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 319/636] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:48.460116 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fd0d6-e6aa-4314-a88e-b90855ebcadd None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:48.470484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcb98f-84ff-49eb-ac97-58a6dd754ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:48.471291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcb98f-84ff-49eb-ac97-58a6dd754ffa None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:48.471578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcb98f-84ff-49eb-ac97-58a6dd754ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:48.471861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcb98f-84ff-49eb-ac97-58a6dd754ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:48.486976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcb98f-84ff-49eb-ac97-58a6dd754ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:48.488439 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcb98f-84ff-49eb-ac97-58a6dd754ffa None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:48.493241 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:48.506947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-a8dcb98f-84ff-49eb-ac97-58a6dd754ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:48.506947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:48.506947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:48.506947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:48.506947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:48.506947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:48.506947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:48.506947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:48.506947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:48.506947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:48.506947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:48.506947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:48.506947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:48.506947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:48.506947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:48.513853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:48.515026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:48.515026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:48.515026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:48.515026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:48.515026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 318/637] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:48.515026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcb98f-84ff-49eb-ac97-58a6dd754ffa None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:48.576273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fd0d6-e6aa-4314-a88e-b90855ebcadd None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:48.592146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:48.610341 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65b17b-5a2e-4a3a-8966-bc06742fd52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:48.618076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65b17b-5a2e-4a3a-8966-bc06742fd52a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:48.618076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65b17b-5a2e-4a3a-8966-bc06742fd52a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:48.618076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65b17b-5a2e-4a3a-8966-bc06742fd52a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:48.618324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcb98f-84ff-49eb-ac97-58a6dd754ffa None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:48.621892 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65b17b-5a2e-4a3a-8966-bc06742fd52a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-3f65b17b-5a2e-4a3a-8966-bc06742fd52a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:48.629708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:48.630758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:48.632161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:48.632161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:48.632161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:48.632161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:48.632161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:48.632161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:48.632161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:48.632161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:48.632161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:48.632161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:48.632161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:48.632161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:48.632161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 320/638] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:48.632161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65b17b-5a2e-4a3a-8966-bc06742fd52a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:48.652012 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0bea2-c488-4558-8b5c-5ebf2fb8c13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:48.652681 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0bea2-c488-4558-8b5c-5ebf2fb8c13a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:48.652997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0bea2-c488-4558-8b5c-5ebf2fb8c13a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:48.653282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0bea2-c488-4558-8b5c-5ebf2fb8c13a None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:48.654081 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0bea2-c488-4558-8b5c-5ebf2fb8c13a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:48.654398 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0bea2-c488-4558-8b5c-5ebf2fb8c13a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:48.656439 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0bea2-c488-4558-8b5c-5ebf2fb8c13a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:48.667714 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 319/639] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:48.668521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0bea2-c488-4558-8b5c-5ebf2fb8c13a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:48.732714 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:48.744803 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65b17b-5a2e-4a3a-8966-bc06742fd52a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:48.775578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0bea2-c488-4558-8b5c-5ebf2fb8c13a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:48.778027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37ad87-a692-4c2a-bf82-0e828849ec22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:48.778772 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37ad87-a692-4c2a-bf82-0e828849ec22 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:48.779057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37ad87-a692-4c2a-bf82-0e828849ec22 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:48.779331 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37ad87-a692-4c2a-bf82-0e828849ec22 None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:48.780108 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37ad87-a692-4c2a-bf82-0e828849ec22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:48.780414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37ad87-a692-4c2a-bf82-0e828849ec22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:48.782445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37ad87-a692-4c2a-bf82-0e828849ec22 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:48.794445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 321/640] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:48.795692 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b81efb-980b-4ec9-950e-ccdf2230f457 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:48.795990 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b81efb-980b-4ec9-950e-ccdf2230f457 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:48.796270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b81efb-980b-4ec9-950e-ccdf2230f457 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:48.798273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 322/641] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:48.799033 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b81efb-980b-4ec9-950e-ccdf2230f457 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:48.811086 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692571f-3476-45e6-b1f7-f8cd5cf4c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:48.811761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692571f-3476-45e6-b1f7-f8cd5cf4c0fe None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:48.812436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692571f-3476-45e6-b1f7-f8cd5cf4c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:48.813029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692571f-3476-45e6-b1f7-f8cd5cf4c0fe None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:48.813323 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692571f-3476-45e6-b1f7-f8cd5cf4c0fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:48.813641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692571f-3476-45e6-b1f7-f8cd5cf4c0fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:48.815023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692571f-3476-45e6-b1f7-f8cd5cf4c0fe None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:48.817702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:48.833643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 320/642] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:48.833643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692571f-3476-45e6-b1f7-f8cd5cf4c0fe None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:48.907951 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b81efb-980b-4ec9-950e-ccdf2230f457 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:48.928130 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692571f-3476-45e6-b1f7-f8cd5cf4c0fe None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:48.940825 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2543c-e4ac-42a2-b2b0-790d804bbe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:48.941531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2543c-e4ac-42a2-b2b0-790d804bbe8e None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:48.941816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2543c-e4ac-42a2-b2b0-790d804bbe8e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:48.942102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2543c-e4ac-42a2-b2b0-790d804bbe8e None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:48.942846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2543c-e4ac-42a2-b2b0-790d804bbe8e None admin] RBAC: Adding query filter params (name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:48.943152 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2543c-e4ac-42a2-b2b0-790d804bbe8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:48.944521 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2543c-e4ac-42a2-b2b0-790d804bbe8e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:48.957872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 323/643] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:48.957872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2543c-e4ac-42a2-b2b0-790d804bbe8e None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:48.963623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71eb9bf-1508-4269-a695-836e16b46460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:48.964307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71eb9bf-1508-4269-a695-836e16b46460 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:48.964589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71eb9bf-1508-4269-a695-836e16b46460 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:48.964868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71eb9bf-1508-4269-a695-836e16b46460 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:48.965728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71eb9bf-1508-4269-a695-836e16b46460 None admin] RBAC: Adding query filter params (role.id=97f88c6182044737a47af038d94a74b8, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=5d5a5ba6aecd46e79dc7199589384a4f) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:48.966043 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71eb9bf-1508-4269-a695-836e16b46460 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:48.967485 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71eb9bf-1508-4269-a695-836e16b46460 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:48.967897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:48.973671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 321/644] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:25:48 2022] GET /identity/v3/role_assignments?user.id=5d5a5ba6aecd46e79dc7199589384a4f&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=97f88c6182044737a47af038d94a74b8 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:48.974991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4488ad-1ce6-41e3-afab-a1264e9acac4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:48.975282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4488ad-1ce6-41e3-afab-a1264e9acac4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:48.975560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4488ad-1ce6-41e3-afab-a1264e9acac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:49.002295 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6b4488ad-1ce6-41e3-afab-a1264e9acac4 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:49.003528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6b4488ad-1ce6-41e3-afab-a1264e9acac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:49.071457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:49.074977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2543c-e4ac-42a2-b2b0-790d804bbe8e None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:49.097051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 322/645] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:49.097051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4488ad-1ce6-41e3-afab-a1264e9acac4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:49.114579 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5847d-6230-40d6-bbdf-e691a8c7c241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:49.115572 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5847d-6230-40d6-bbdf-e691a8c7c241 None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:49.115854 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5847d-6230-40d6-bbdf-e691a8c7c241 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:49.116168 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5847d-6230-40d6-bbdf-e691a8c7c241 None admin] PATH_INFO: `/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/3f43a4bb5a18445b8836f4613cd5e14b/roles/97f88c6182044737a47af038d94a74b8` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:49.133141 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5847d-6230-40d6-bbdf-e691a8c7c241 None admin] RBAC: Authorizing `identity:create_grant(project_id=68bf9a1e88a64a02ba53d0bedb76072a, user_id=3f43a4bb5a18445b8836f4613cd5e14b, role_id=97f88c6182044737a47af038d94a74b8)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:49.134616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5847d-6230-40d6-bbdf-e691a8c7c241 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:49.209598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4488ad-1ce6-41e3-afab-a1264e9acac4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:49.218969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 324/646] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:25:48 2022] PUT /identity/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/3f43a4bb5a18445b8836f4613cd5e14b/roles/97f88c6182044737a47af038d94a74b8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:25:49.225857 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5847d-6230-40d6-bbdf-e691a8c7c241 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:49.251529 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce7ef7-2c4a-4265-ae48-671d80abdc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:49.252364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce7ef7-2c4a-4265-ae48-671d80abdc32 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:49.252655 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce7ef7-2c4a-4265-ae48-671d80abdc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:49.252958 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce7ef7-2c4a-4265-ae48-671d80abdc32 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:49.263847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce7ef7-2c4a-4265-ae48-671d80abdc32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:49.265990 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce7ef7-2c4a-4265-ae48-671d80abdc32 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-7cce7ef7-2c4a-4265-ae48-671d80abdc32 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:49.285971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:49.286988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:49.288094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:49.288094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:49.288094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:49.288094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:49.288094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:49.288094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:49.288094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:49.288094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:49.288094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 01 17:25:49.288094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:49.290470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 323/647] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:49.291481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce7ef7-2c4a-4265-ae48-671d80abdc32 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:49.300466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:49.361028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:49.363109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5847d-6230-40d6-bbdf-e691a8c7c241 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:49.409133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8dc7c-557f-48eb-9cca-d4656164995e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:49.409961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8dc7c-557f-48eb-9cca-d4656164995e None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:49.410236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8dc7c-557f-48eb-9cca-d4656164995e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:49.410509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8dc7c-557f-48eb-9cca-d4656164995e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:49.423951 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8dc7c-557f-48eb-9cca-d4656164995e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:49.425497 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8dc7c-557f-48eb-9cca-d4656164995e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:49.436393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce7ef7-2c4a-4265-ae48-671d80abdc32 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:49.445258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-c4b8dc7c-557f-48eb-9cca-d4656164995e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:49.445258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:49.445258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:49.445258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:49.445258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:49.445258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:49.445258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:49.445258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:49.445258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:49.445258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:49.445258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:49.445258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:49.445258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:49.445258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:49.445258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:49.446215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:49.447321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:49.447321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:49.447321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:49.447321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:49.447321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 325/648] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:49.447712 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8dc7c-557f-48eb-9cca-d4656164995e None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:49.490884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523f3fe-04b3-493b-a07a-9450d1afe3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:49.490884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523f3fe-04b3-493b-a07a-9450d1afe3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:49.491486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523f3fe-04b3-493b-a07a-9450d1afe3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:49.491486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523f3fe-04b3-493b-a07a-9450d1afe3e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:49.510096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523f3fe-04b3-493b-a07a-9450d1afe3e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-0523f3fe-04b3-493b-a07a-9450d1afe3e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:49.521036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:49.522028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:49.522869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:49.522869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:49.522869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:49.522869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:49.522869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:49.522869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:49.522869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:49.522869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:49.522869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:49.522869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:49.522869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:49.522869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:49.529004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 324/649] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:49.529004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523f3fe-04b3-493b-a07a-9450d1afe3e2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:49.606349 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8dc7c-557f-48eb-9cca-d4656164995e None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:49.626402 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:49.636240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523f3fe-04b3-493b-a07a-9450d1afe3e2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:49.648498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:49.658890 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebd995-7a2e-4ac1-b3e9-19efad0dfa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:49.660276 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebd995-7a2e-4ac1-b3e9-19efad0dfa54 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:49.660742 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebd995-7a2e-4ac1-b3e9-19efad0dfa54 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:49.661359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebd995-7a2e-4ac1-b3e9-19efad0dfa54 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:49.662504 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebd995-7a2e-4ac1-b3e9-19efad0dfa54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:49.663113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebd995-7a2e-4ac1-b3e9-19efad0dfa54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:49.665380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebd995-7a2e-4ac1-b3e9-19efad0dfa54 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:49.682057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d25b49-8e43-44ac-beaf-d20d73a8b096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:49.687767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d25b49-8e43-44ac-beaf-d20d73a8b096 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:49.687767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d25b49-8e43-44ac-beaf-d20d73a8b096 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:49.687767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d25b49-8e43-44ac-beaf-d20d73a8b096 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:49.687767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d25b49-8e43-44ac-beaf-d20d73a8b096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:49.687767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d25b49-8e43-44ac-beaf-d20d73a8b096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:49.688104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 326/650] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Jun 1 17:25:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:49.688195 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d25b49-8e43-44ac-beaf-d20d73a8b096 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:49.688866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebd995-7a2e-4ac1-b3e9-19efad0dfa54 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:49.704029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 325/651] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:49.704995 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d25b49-8e43-44ac-beaf-d20d73a8b096 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:49.804998 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebd995-7a2e-4ac1-b3e9-19efad0dfa54 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:49.839290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d25b49-8e43-44ac-beaf-d20d73a8b096 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:49.841288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ac0b4-50e0-4529-a74f-ff29ac4b12f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:49.842036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ac0b4-50e0-4529-a74f-ff29ac4b12f5 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:49.842951 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ac0b4-50e0-4529-a74f-ff29ac4b12f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:49.842951 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ac0b4-50e0-4529-a74f-ff29ac4b12f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:49.844032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ac0b4-50e0-4529-a74f-ff29ac4b12f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:49.844401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ac0b4-50e0-4529-a74f-ff29ac4b12f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:49.845921 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ac0b4-50e0-4529-a74f-ff29ac4b12f5 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:49.860545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 327/652] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:49.860545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ac0b4-50e0-4529-a74f-ff29ac4b12f5 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:49.885192 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d2849-e50c-4658-a2e8-77119711af57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:49.886643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d2849-e50c-4658-a2e8-77119711af57 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:49.887082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d2849-e50c-4658-a2e8-77119711af57 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:49.887507 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d2849-e50c-4658-a2e8-77119711af57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:49.888612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:49.932880 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:49.963400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ac0b4-50e0-4529-a74f-ff29ac4b12f5 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:49.965443 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d2849-e50c-4658-a2e8-77119711af57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:49.967369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d2849-e50c-4658-a2e8-77119711af57 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:49.998883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ad248-162b-4878-84c5-0dd0e33ff59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:50.000235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ad248-162b-4878-84c5-0dd0e33ff59c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:50.000632 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ad248-162b-4878-84c5-0dd0e33ff59c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:50.000861 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ad248-162b-4878-84c5-0dd0e33ff59c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:50.009589 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ad248-162b-4878-84c5-0dd0e33ff59c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:50.011055 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ad248-162b-4878-84c5-0dd0e33ff59c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-476ad248-162b-4878-84c5-0dd0e33ff59c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:50.026110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:50.027288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:50.028702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:50.028702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:50.028702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:50.028702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:50.028702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:50.028702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:50.028702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:50.028702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:50.028702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 17:25:50.028702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:50.032034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 328/653] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:50.032882 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ad248-162b-4878-84c5-0dd0e33ff59c None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:50.083782 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 326/654] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:50.085090 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d2849-e50c-4658-a2e8-77119711af57 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:50.127309 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:50.144788 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ad248-162b-4878-84c5-0dd0e33ff59c None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:50.161275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:50.170251 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f226d2d-2e5c-47f1-94e1-5657109002b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:50.171068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f226d2d-2e5c-47f1-94e1-5657109002b2 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:50.171883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f226d2d-2e5c-47f1-94e1-5657109002b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:50.172167 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f226d2d-2e5c-47f1-94e1-5657109002b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:50.182737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f226d2d-2e5c-47f1-94e1-5657109002b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:50.184183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f226d2d-2e5c-47f1-94e1-5657109002b2 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:50.193624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d2849-e50c-4658-a2e8-77119711af57 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:50.202041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-1f226d2d-2e5c-47f1-94e1-5657109002b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:50.202041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:50.202041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:50.202041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:50.202041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:50.202041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:50.202041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:50.202041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:50.202041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:50.202041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:50.202041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:50.202041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:50.202041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:50.202041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:50.202041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:50.203813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:50.205040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:50.205040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:50.205040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:50.205040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:50.214523 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 329/655] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:50.214523 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f226d2d-2e5c-47f1-94e1-5657109002b2 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:50.235910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416021b8-33eb-4fab-b803-4aee65d745c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:50.237007 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416021b8-33eb-4fab-b803-4aee65d745c5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:50.237455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416021b8-33eb-4fab-b803-4aee65d745c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:50.237877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416021b8-33eb-4fab-b803-4aee65d745c5 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:50.238864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416021b8-33eb-4fab-b803-4aee65d745c5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:50.239431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416021b8-33eb-4fab-b803-4aee65d745c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:50.241130 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416021b8-33eb-4fab-b803-4aee65d745c5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:50.260757 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 327/656] 10.222.0.33 () {56 vars in 1137 bytes} [Wed Jun 1 17:25:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:50.261855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416021b8-33eb-4fab-b803-4aee65d745c5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:50.331166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f226d2d-2e5c-47f1-94e1-5657109002b2 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:50.367319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca482439-d01d-46b0-85cb-4b9cbe7a1b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:50.368120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca482439-d01d-46b0-85cb-4b9cbe7a1b28 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:50.368406 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca482439-d01d-46b0-85cb-4b9cbe7a1b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:50.368682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca482439-d01d-46b0-85cb-4b9cbe7a1b28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:50.369766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416021b8-33eb-4fab-b803-4aee65d745c5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:50.380258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca482439-d01d-46b0-85cb-4b9cbe7a1b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:50.381837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca482439-d01d-46b0-85cb-4b9cbe7a1b28 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:50.384447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:50.407933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:50.408114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-ca482439-d01d-46b0-85cb-4b9cbe7a1b28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:50.408114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:50.408114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:50.408114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:50.408114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:50.408114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:50.408114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:50.408114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:50.408114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:50.408114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:50.408114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:50.408114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:50.408114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:50.408114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:50.408114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:50.408986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:50.410177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:50.410177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:50.410177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:50.410177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:50.410177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 330/657] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:50.410177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca482439-d01d-46b0-85cb-4b9cbe7a1b28 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:50.410780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ecedf-4b14-4488-a72f-51618b30b49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:50.417002 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ecedf-4b14-4488-a72f-51618b30b49b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:50.417002 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ecedf-4b14-4488-a72f-51618b30b49b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:50.417002 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ecedf-4b14-4488-a72f-51618b30b49b None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:50.417002 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ecedf-4b14-4488-a72f-51618b30b49b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:50.417002 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ecedf-4b14-4488-a72f-51618b30b49b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:50.417002 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ecedf-4b14-4488-a72f-51618b30b49b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:50.427781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 328/658] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:50.428848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ecedf-4b14-4488-a72f-51618b30b49b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:50.525016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca482439-d01d-46b0-85cb-4b9cbe7a1b28 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:50.553248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ecedf-4b14-4488-a72f-51618b30b49b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:50.566809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817a9e0-9e7f-4e04-97dc-00fcee5f590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:50.567877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817a9e0-9e7f-4e04-97dc-00fcee5f590f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:50.568278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817a9e0-9e7f-4e04-97dc-00fcee5f590f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:50.568656 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817a9e0-9e7f-4e04-97dc-00fcee5f590f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:50.596467 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7126246-4cd1-4575-a83c-58c16131781e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:50.597641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7126246-4cd1-4575-a83c-58c16131781e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:50.597925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7126246-4cd1-4575-a83c-58c16131781e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:50.598200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7126246-4cd1-4575-a83c-58c16131781e None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:50.598916 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7126246-4cd1-4575-a83c-58c16131781e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:50.599216 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7126246-4cd1-4575-a83c-58c16131781e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:50.600583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7126246-4cd1-4575-a83c-58c16131781e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:50.613823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 329/659] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:50.614717 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7126246-4cd1-4575-a83c-58c16131781e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:50.660310 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:50.664581 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:50.670588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817a9e0-9e7f-4e04-97dc-00fcee5f590f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:50.674768 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817a9e0-9e7f-4e04-97dc-00fcee5f590f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:50.719091 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7126246-4cd1-4575-a83c-58c16131781e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:50.758295 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e7503-0bc7-4bfd-998f-1c2a95b5267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:50.759227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e7503-0bc7-4bfd-998f-1c2a95b5267f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:50.759506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e7503-0bc7-4bfd-998f-1c2a95b5267f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:50.759777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e7503-0bc7-4bfd-998f-1c2a95b5267f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:50.768303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e7503-0bc7-4bfd-998f-1c2a95b5267f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:50.769848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e7503-0bc7-4bfd-998f-1c2a95b5267f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-b15e7503-0bc7-4bfd-998f-1c2a95b5267f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:50.786572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:50.787559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:50.789136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:50.789136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:50.789136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:50.789136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:50.789136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:50.789136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:50.789136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:50.789136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:50.789136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 01 17:25:50.789136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:50.789136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 330/660] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:50.789136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e7503-0bc7-4bfd-998f-1c2a95b5267f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:50.808558 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 331/661] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:50.810193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817a9e0-9e7f-4e04-97dc-00fcee5f590f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:50.904776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e7503-0bc7-4bfd-998f-1c2a95b5267f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:50.916242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:50.941046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:50.943561 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449adde-3c19-49c2-9900-e1aa318f2195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:50.944366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449adde-3c19-49c2-9900-e1aa318f2195 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:50.944647 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449adde-3c19-49c2-9900-e1aa318f2195 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:50.944920 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449adde-3c19-49c2-9900-e1aa318f2195 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:50.948838 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817a9e0-9e7f-4e04-97dc-00fcee5f590f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:50.952220 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449adde-3c19-49c2-9900-e1aa318f2195 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:50.953990 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449adde-3c19-49c2-9900-e1aa318f2195 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:50.970564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-f449adde-3c19-49c2-9900-e1aa318f2195 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:50.970564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:50.970564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:50.970564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:50.970564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:50.970564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:50.970564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:50.970564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:50.970564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:50.970564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:50.970564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:50.970564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:50.970564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:50.970564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:50.970564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:50.971588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:50.973082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:50.973082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:50.973082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:50.973082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:50.973082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:50.973082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:50.973082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:50.973082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:50.973082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 331/662] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:50.973082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449adde-3c19-49c2-9900-e1aa318f2195 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:50.992162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2b9d8-a9e8-453a-90d2-894deb76a9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:50.992852 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2b9d8-a9e8-453a-90d2-894deb76a9da None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:50.993440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2b9d8-a9e8-453a-90d2-894deb76a9da None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:50.993440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2b9d8-a9e8-453a-90d2-894deb76a9da None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:50.994261 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2b9d8-a9e8-453a-90d2-894deb76a9da None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:50.994777 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2b9d8-a9e8-453a-90d2-894deb76a9da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:50.996273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2b9d8-a9e8-453a-90d2-894deb76a9da None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:51.021349 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 332/663] 10.222.0.33 () {56 vars in 1139 bytes} [Wed Jun 1 17:25:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:51.022496 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2b9d8-a9e8-453a-90d2-894deb76a9da None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:51.100694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449adde-3c19-49c2-9900-e1aa318f2195 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:51.133913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2b9d8-a9e8-453a-90d2-894deb76a9da None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:51.139789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b62643-a75c-49a0-bfa9-815ee921541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:51.141191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b62643-a75c-49a0-bfa9-815ee921541a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:51.141540 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b62643-a75c-49a0-bfa9-815ee921541a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:51.141746 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b62643-a75c-49a0-bfa9-815ee921541a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:51.154952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b62643-a75c-49a0-bfa9-815ee921541a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:51.157129 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b62643-a75c-49a0-bfa9-815ee921541a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:51.175220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e962e8-6bfa-47e4-a57a-728667eb4c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:51.175984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e962e8-6bfa-47e4-a57a-728667eb4c07 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:51.176361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e962e8-6bfa-47e4-a57a-728667eb4c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:51.176764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e962e8-6bfa-47e4-a57a-728667eb4c07 None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:51.176891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-07b62643-a75c-49a0-bfa9-815ee921541a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:51.176891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:51.176891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:51.176891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:51.176891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:51.176891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:51.176891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:51.176891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:51.176891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:51.176891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:51.176891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:51.176891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:51.176891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:51.176891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:51.176891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:51.177935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:51.179099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:51.179099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:51.179099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:51.179099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:51.181204 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e962e8-6bfa-47e4-a57a-728667eb4c07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:51.181204 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e962e8-6bfa-47e4-a57a-728667eb4c07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:51.181807 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e962e8-6bfa-47e4-a57a-728667eb4c07 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:51.182550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 332/664] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:51.183238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b62643-a75c-49a0-bfa9-815ee921541a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:51.195677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 333/665] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:51.196653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e962e8-6bfa-47e4-a57a-728667eb4c07 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:51.207947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:51.213635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:51.298391 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b62643-a75c-49a0-bfa9-815ee921541a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:51.310506 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e962e8-6bfa-47e4-a57a-728667eb4c07 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:51.336035 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b844f3-4712-428c-a187-7d46ce5725eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:51.336918 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b844f3-4712-428c-a187-7d46ce5725eb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:51.337390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b844f3-4712-428c-a187-7d46ce5725eb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:51.337945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b844f3-4712-428c-a187-7d46ce5725eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:51.348126 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204b48f-5f69-47a0-b9de-36a575f94f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:51.349014 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204b48f-5f69-47a0-b9de-36a575f94f4d None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:51.349397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204b48f-5f69-47a0-b9de-36a575f94f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:51.349768 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204b48f-5f69-47a0-b9de-36a575f94f4d None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:51.350614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204b48f-5f69-47a0-b9de-36a575f94f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:51.351375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204b48f-5f69-47a0-b9de-36a575f94f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:51.353211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204b48f-5f69-47a0-b9de-36a575f94f4d None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:51.371199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 334/666] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:51.371199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204b48f-5f69-47a0-b9de-36a575f94f4d None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:51.428351 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b844f3-4712-428c-a187-7d46ce5725eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:51.430550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b844f3-4712-428c-a187-7d46ce5725eb None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:51.456603 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:51.468888 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:51.501518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204b48f-5f69-47a0-b9de-36a575f94f4d None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:51.537047 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fcbc3-803d-40f3-84e2-361deca81337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:51.537710 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcbc3-803d-40f3-84e2-361deca81337 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:51.538005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcbc3-803d-40f3-84e2-361deca81337 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:51.538271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fcbc3-803d-40f3-84e2-361deca81337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:51.539105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fcbc3-803d-40f3-84e2-361deca81337 None admin] RBAC: Adding query filter params (role.id=97f88c6182044737a47af038d94a74b8, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=b34d05889f3c4d469f4661061457cb95) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:51.539427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fcbc3-803d-40f3-84e2-361deca81337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:51.541086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fcbc3-803d-40f3-84e2-361deca81337 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:51.545470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 333/667] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:51.546117 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b844f3-4712-428c-a187-7d46ce5725eb None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:51.560976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 335/668] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:25:51 2022] GET /identity/v3/role_assignments?user.id=b34d05889f3c4d469f4661061457cb95&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=97f88c6182044737a47af038d94a74b8 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:51.560976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f4052-f0ad-4c06-a2f2-57064670b7d9 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:51.560976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f4052-f0ad-4c06-a2f2-57064670b7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:51.560976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f4052-f0ad-4c06-a2f2-57064670b7d9 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:51.560976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 336/669] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:51.560976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f4052-f0ad-4c06-a2f2-57064670b7d9 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:51.680658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b844f3-4712-428c-a187-7d46ce5725eb None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:51.684714 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f4052-f0ad-4c06-a2f2-57064670b7d9 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:51.704892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:51.720468 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f445be4-56fc-4e77-9505-e3e468230ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:51.721316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f445be4-56fc-4e77-9505-e3e468230ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:51.721613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f445be4-56fc-4e77-9505-e3e468230ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:51.721896 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f445be4-56fc-4e77-9505-e3e468230ca9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:51.723577 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fef9e0-b8a8-4e2d-9b10-1c56512fcd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:51.724387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fef9e0-b8a8-4e2d-9b10-1c56512fcd02 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:51.724667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fef9e0-b8a8-4e2d-9b10-1c56512fcd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:51.724944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fef9e0-b8a8-4e2d-9b10-1c56512fcd02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:51.729775 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f445be4-56fc-4e77-9505-e3e468230ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:51.731277 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f445be4-56fc-4e77-9505-e3e468230ca9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:51.733207 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:51.737382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fef9e0-b8a8-4e2d-9b10-1c56512fcd02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:51.738849 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fef9e0-b8a8-4e2d-9b10-1c56512fcd02 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:51.748186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-9f445be4-56fc-4e77-9505-e3e468230ca9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:51.748186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:51.748186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:51.748186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:51.748186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:51.748186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:51.748186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:51.748186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:51.748186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:51.748186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:51.748186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:51.748186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:51.748186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:51.748186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:51.748186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:51.755139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:51.756056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:51.756056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:51.756056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:51.756056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:51.756056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:51.756056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:51.756056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:51.756056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:51.756056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 334/670] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:51.756056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3131a23-6944-4048-b50b-dc5f87ea6f81 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:51.756056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3131a23-6944-4048-b50b-dc5f87ea6f81 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:51.756774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3131a23-6944-4048-b50b-dc5f87ea6f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:51.762679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-87fef9e0-b8a8-4e2d-9b10-1c56512fcd02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:51.762679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:51.762679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:51.762679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:51.762679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:51.762679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:51.762679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:51.762679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:51.762679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:51.762679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:51.762679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:51.762679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:51.762679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:51.762679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:51.762679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:51.763601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:51.764511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:51.764511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:51.764511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:51.764511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:51.764511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 337/671] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:51.765513 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd5007-4d41-410e-b2d3-82ecf19417c0 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:51.769375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd5007-4d41-410e-b2d3-82ecf19417c0 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:51.769707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd5007-4d41-410e-b2d3-82ecf19417c0 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:51.771287 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 338/672] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:51.771946 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd5007-4d41-410e-b2d3-82ecf19417c0 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:51.774324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a3131a23-6944-4048-b50b-dc5f87ea6f81 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:51.775521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a3131a23-6944-4048-b50b-dc5f87ea6f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:51.857040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 335/673] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:51.857040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3131a23-6944-4048-b50b-dc5f87ea6f81 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:51.890197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd5007-4d41-410e-b2d3-82ecf19417c0 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:51.927251 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e8be5-35d3-4424-8020-37876ff6f073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:51.928014 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e8be5-35d3-4424-8020-37876ff6f073 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:51.928308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e8be5-35d3-4424-8020-37876ff6f073 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:51.928589 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e8be5-35d3-4424-8020-37876ff6f073 None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:51.929441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e8be5-35d3-4424-8020-37876ff6f073 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:51.929758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e8be5-35d3-4424-8020-37876ff6f073 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:51.931262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e8be5-35d3-4424-8020-37876ff6f073 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:51.947953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 339/674] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:51.947953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f58569-ff65-40fb-b473-258b46101241 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:51.947953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f58569-ff65-40fb-b473-258b46101241 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:51.947953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f58569-ff65-40fb-b473-258b46101241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:51.964153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-60f58569-ff65-40fb-b473-258b46101241 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:51.964419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3131a23-6944-4048-b50b-dc5f87ea6f81 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:51.965374 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-60f58569-ff65-40fb-b473-258b46101241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:51.976237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:52.000707 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6132eb-ab97-403b-8913-8fb4d2df6064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:52.001542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6132eb-ab97-403b-8913-8fb4d2df6064 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:52.001793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6132eb-ab97-403b-8913-8fb4d2df6064 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:52.002076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6132eb-ab97-403b-8913-8fb4d2df6064 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:52.002794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6132eb-ab97-403b-8913-8fb4d2df6064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:52.003098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6132eb-ab97-403b-8913-8fb4d2df6064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:52.004468 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6132eb-ab97-403b-8913-8fb4d2df6064 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:52.016009 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 336/675] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:52.016410 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:52.016831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6132eb-ab97-403b-8913-8fb4d2df6064 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:52.052962 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 340/676] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:52.052962 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f58569-ff65-40fb-b473-258b46101241 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:52.143758 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6132eb-ab97-403b-8913-8fb4d2df6064 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:52.148090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f58569-ff65-40fb-b473-258b46101241 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:52.180994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614aeb85-4dd4-4804-b17c-cf7760268e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:52.181857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aeb85-4dd4-4804-b17c-cf7760268e17 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:52.182155 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aeb85-4dd4-4804-b17c-cf7760268e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:52.182372 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aeb85-4dd4-4804-b17c-cf7760268e17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:52.183218 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e43f37-45c6-410e-95fd-a31ac800928e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:52.183869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e43f37-45c6-410e-95fd-a31ac800928e None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:52.184153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e43f37-45c6-410e-95fd-a31ac800928e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:52.184425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e43f37-45c6-410e-95fd-a31ac800928e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:52.185303 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e43f37-45c6-410e-95fd-a31ac800928e None admin] RBAC: Adding query filter params (role.id=97f88c6182044737a47af038d94a74b8, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=98d9e5912b8c4f36922cde62830fb7ac) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:52.185613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e43f37-45c6-410e-95fd-a31ac800928e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:52.187573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e43f37-45c6-410e-95fd-a31ac800928e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:52.193454 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614aeb85-4dd4-4804-b17c-cf7760268e17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:52.200738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 341/677] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:25:52 2022] GET /identity/v3/role_assignments?user.id=98d9e5912b8c4f36922cde62830fb7ac&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=97f88c6182044737a47af038d94a74b8 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:52.200738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e43f37-45c6-410e-95fd-a31ac800928e None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-614aeb85-4dd4-4804-b17c-cf7760268e17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:52.203240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:52.204146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:52.205027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:52.205027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:52.205027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:52.205027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:52.205027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:52.205027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:52.205027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:52.205027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:52.205027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:52.205027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:52.205027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:25:52.205027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:52.205027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 337/678] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:52.205027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614aeb85-4dd4-4804-b17c-cf7760268e17 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:52.257332 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:52.265922 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:52.326653 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614aeb85-4dd4-4804-b17c-cf7760268e17 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:52.331212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e43f37-45c6-410e-95fd-a31ac800928e None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:52.365979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0656d-a3e4-4f16-bbcb-095005bb4dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:52.366980 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0656d-a3e4-4f16-bbcb-095005bb4dae None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:52.367213 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0656d-a3e4-4f16-bbcb-095005bb4dae None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:52.368708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0656d-a3e4-4f16-bbcb-095005bb4dae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:52.375573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43b7c1-fe52-4839-8c5a-0251139a98b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:52.376881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43b7c1-fe52-4839-8c5a-0251139a98b5 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:52.377394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43b7c1-fe52-4839-8c5a-0251139a98b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:52.377869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43b7c1-fe52-4839-8c5a-0251139a98b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:52.383535 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0656d-a3e4-4f16-bbcb-095005bb4dae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:52.389617 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43b7c1-fe52-4839-8c5a-0251139a98b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:52.391509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43b7c1-fe52-4839-8c5a-0251139a98b5 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-e7d0656d-a3e4-4f16-bbcb-095005bb4dae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:52.392525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:52.393513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:52.394383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:52.394383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:52.394383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:52.394383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:52.394383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:52.394383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:52.394383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:52.394383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:52.394383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:52.394383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:52.394383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:52.394383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:52.398979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 338/679] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:52.399915 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0656d-a3e4-4f16-bbcb-095005bb4dae None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:52.410997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-7b43b7c1-fe52-4839-8c5a-0251139a98b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:52.410997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:52.410997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:52.410997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:52.410997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:52.410997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:52.410997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:52.410997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:52.410997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:52.410997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:52.410997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:52.410997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:52.410997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:52.410997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:52.410997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:52.411956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:52.412873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:52.412873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:52.412873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:52.412873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:52.412873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:52.412873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:52.412873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:52.412873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:52.417778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 342/680] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:52.417778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43b7c1-fe52-4839-8c5a-0251139a98b5 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:52.526336 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:52.539323 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0656d-a3e4-4f16-bbcb-095005bb4dae None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:52.544384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43b7c1-fe52-4839-8c5a-0251139a98b5 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:52.548392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:52.580834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e63fc1-34b1-4c5b-8946-e2a9a666810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:52.581715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e63fc1-34b1-4c5b-8946-e2a9a666810a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:52.582093 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e63fc1-34b1-4c5b-8946-e2a9a666810a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:52.582467 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e63fc1-34b1-4c5b-8946-e2a9a666810a None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:52.583375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e63fc1-34b1-4c5b-8946-e2a9a666810a None admin] RBAC: Adding query filter params (name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:52.583777 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e63fc1-34b1-4c5b-8946-e2a9a666810a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:52.584319 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba26ca1-8df9-4f8d-b794-533cd5c0f05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:52.585027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba26ca1-8df9-4f8d-b794-533cd5c0f05e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:52.585310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba26ca1-8df9-4f8d-b794-533cd5c0f05e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:52.585586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba26ca1-8df9-4f8d-b794-533cd5c0f05e None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:52.585693 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e63fc1-34b1-4c5b-8946-e2a9a666810a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:52.586389 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba26ca1-8df9-4f8d-b794-533cd5c0f05e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:52.586694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba26ca1-8df9-4f8d-b794-533cd5c0f05e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:52.588558 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba26ca1-8df9-4f8d-b794-533cd5c0f05e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:52.597064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 343/681] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:52.598314 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 339/682] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:52.600993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e63fc1-34b1-4c5b-8946-e2a9a666810a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:52.603819 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba26ca1-8df9-4f8d-b794-533cd5c0f05e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:52.712713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e63fc1-34b1-4c5b-8946-e2a9a666810a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:52.715676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba26ca1-8df9-4f8d-b794-533cd5c0f05e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:52.768285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b0b8e-09a6-48d1-aafd-a1995eccb3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:52.769652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b0b8e-09a6-48d1-aafd-a1995eccb3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:52.770146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b0b8e-09a6-48d1-aafd-a1995eccb3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:52.770635 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b0b8e-09a6-48d1-aafd-a1995eccb3d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:52.774989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47090513-169d-415f-b9b6-f52a181f2fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:52.776571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47090513-169d-415f-b9b6-f52a181f2fcd None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:52.777348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47090513-169d-415f-b9b6-f52a181f2fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:52.778084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47090513-169d-415f-b9b6-f52a181f2fcd None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:52.779974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47090513-169d-415f-b9b6-f52a181f2fcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:52.781410 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47090513-169d-415f-b9b6-f52a181f2fcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:52.791169 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b0b8e-09a6-48d1-aafd-a1995eccb3d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:52.792125 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47090513-169d-415f-b9b6-f52a181f2fcd None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:52.793743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b0b8e-09a6-48d1-aafd-a1995eccb3d1 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:52.820176 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 344/683] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:52.822307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47090513-169d-415f-b9b6-f52a181f2fcd None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:52.826271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-117b0b8e-09a6-48d1-aafd-a1995eccb3d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:52.826271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:52.826271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:52.826271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:52.826271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:52.826271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:52.826271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:52.826271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:52.826271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:52.826271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:52.826271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:52.826271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:52.826271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:52.826271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:52.826271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:52.828137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:52.829924 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:52.829924 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:52.829924 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:52.829924 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:52.835809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 340/684] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:52.837385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b0b8e-09a6-48d1-aafd-a1995eccb3d1 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:52.844517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:52.901990 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:53.006349 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47090513-169d-415f-b9b6-f52a181f2fcd None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:53.016846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b0b8e-09a6-48d1-aafd-a1995eccb3d1 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:53.062934 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9ef37-05ce-40f8-8490-8cb2b2ab8e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:53.064282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9ef37-05ce-40f8-8490-8cb2b2ab8e8f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:53.064921 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9ef37-05ce-40f8-8490-8cb2b2ab8e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:53.065513 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9ef37-05ce-40f8-8490-8cb2b2ab8e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:53.076071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dc245-c243-462c-bf0e-711bcf048f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:53.077465 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dc245-c243-462c-bf0e-711bcf048f42 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:53.078167 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dc245-c243-462c-bf0e-711bcf048f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:53.078916 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dc245-c243-462c-bf0e-711bcf048f42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:53.080700 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4dc245-c243-462c-bf0e-711bcf048f42 None admin] RBAC: Adding query filter params (role.id=97f88c6182044737a47af038d94a74b8, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=4254398f2aac42f7b54f29294a73bfda) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:53.081520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4dc245-c243-462c-bf0e-711bcf048f42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:53.084334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4dc245-c243-462c-bf0e-711bcf048f42 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:53.085112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9ef37-05ce-40f8-8490-8cb2b2ab8e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:53.087620 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9ef37-05ce-40f8-8490-8cb2b2ab8e8f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:53.096509 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 341/685] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:25:52 2022] GET /identity/v3/role_assignments?user.id=4254398f2aac42f7b54f29294a73bfda&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=97f88c6182044737a47af038d94a74b8 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:53.098342 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dc245-c243-462c-bf0e-711bcf048f42 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:53.122713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-18e9ef37-05ce-40f8-8490-8cb2b2ab8e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:53.122713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:53.122713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:53.122713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:53.122713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:53.122713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:53.122713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:53.122713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:53.122713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:53.122713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:53.122713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:53.122713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:53.122713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:53.122713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:53.122713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:53.123738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:53.125447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:53.125447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:53.125447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:53.125447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:53.125447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 345/686] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:53.136117 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9ef37-05ce-40f8-8490-8cb2b2ab8e8f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:53.257320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:53.278981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9ef37-05ce-40f8-8490-8cb2b2ab8e8f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:53.293330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:53.319889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8217bef-7eac-4e29-8bfc-d2baa5f17043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:53.320495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8217bef-7eac-4e29-8bfc-d2baa5f17043 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:53.320777 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8217bef-7eac-4e29-8bfc-d2baa5f17043 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:53.321084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8217bef-7eac-4e29-8bfc-d2baa5f17043 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:53.321819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8217bef-7eac-4e29-8bfc-d2baa5f17043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:53.322129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8217bef-7eac-4e29-8bfc-d2baa5f17043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:53.324125 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8217bef-7eac-4e29-8bfc-d2baa5f17043 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:53.338871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 346/687] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:53.345267 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8217bef-7eac-4e29-8bfc-d2baa5f17043 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:53.372528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dc245-c243-462c-bf0e-711bcf048f42 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:53.424280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeae310-f660-404a-a38f-49db16d192dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:53.425004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeae310-f660-404a-a38f-49db16d192dc None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:53.425293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeae310-f660-404a-a38f-49db16d192dc None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:53.425569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeae310-f660-404a-a38f-49db16d192dc None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:53.426303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeae310-f660-404a-a38f-49db16d192dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:53.426614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeae310-f660-404a-a38f-49db16d192dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:53.427999 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeae310-f660-404a-a38f-49db16d192dc None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:53.443362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 342/688] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:53.448641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeae310-f660-404a-a38f-49db16d192dc None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:53.484523 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8217bef-7eac-4e29-8bfc-d2baa5f17043 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:53.532484 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711557a-9396-4cf5-a3db-8cddfc08a42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:53.534045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711557a-9396-4cf5-a3db-8cddfc08a42c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:53.534338 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711557a-9396-4cf5-a3db-8cddfc08a42c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:53.534615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711557a-9396-4cf5-a3db-8cddfc08a42c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:53.542972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711557a-9396-4cf5-a3db-8cddfc08a42c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:53.544439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711557a-9396-4cf5-a3db-8cddfc08a42c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:53.546781 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-c711557a-9396-4cf5-a3db-8cddfc08a42c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:53.570860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:53.572065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:53.573286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:53.573286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:53.573286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:53.573286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:53.573286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:53.573286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:53.573286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:53.573286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:53.573286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:25:53.573286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:53.575618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 347/689] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jun 1 17:25:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:53.581961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711557a-9396-4cf5-a3db-8cddfc08a42c None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:53.605102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeae310-f660-404a-a38f-49db16d192dc None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:53.636982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:53.647300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816099b-6a65-4d73-8ce8-0f5803a723e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:53.648139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816099b-6a65-4d73-8ce8-0f5803a723e0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:53.648849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816099b-6a65-4d73-8ce8-0f5803a723e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:53.649163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816099b-6a65-4d73-8ce8-0f5803a723e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:53.659275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816099b-6a65-4d73-8ce8-0f5803a723e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:53.660752 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816099b-6a65-4d73-8ce8-0f5803a723e0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-2816099b-6a65-4d73-8ce8-0f5803a723e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:53.679164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:53.680385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:53.681652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:53.681652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:53.681652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:53.681652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:53.681652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:53.681652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:53.681652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:53.681652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:53.681652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 01 17:25:53.681652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:53.689092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 343/690] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:25:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:53.691609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816099b-6a65-4d73-8ce8-0f5803a723e0 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:53.815750 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711557a-9396-4cf5-a3db-8cddfc08a42c None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:53.875887 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483204a-4df1-47a5-8421-0b3ea5df7058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:53.876460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483204a-4df1-47a5-8421-0b3ea5df7058 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:53.876739 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483204a-4df1-47a5-8421-0b3ea5df7058 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:53.877030 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483204a-4df1-47a5-8421-0b3ea5df7058 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:53.877877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483204a-4df1-47a5-8421-0b3ea5df7058 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:53.878182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483204a-4df1-47a5-8421-0b3ea5df7058 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:53.879627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483204a-4df1-47a5-8421-0b3ea5df7058 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:53.915016 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816099b-6a65-4d73-8ce8-0f5803a723e0 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:53.925246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 348/691] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jun 1 17:25:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:53.930314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483204a-4df1-47a5-8421-0b3ea5df7058 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:53.993024 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e528a-b8fe-40dc-85a2-6a4e50d7ab41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:53.993705 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e528a-b8fe-40dc-85a2-6a4e50d7ab41 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:53.993989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e528a-b8fe-40dc-85a2-6a4e50d7ab41 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:53.994288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e528a-b8fe-40dc-85a2-6a4e50d7ab41 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:53.995128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e528a-b8fe-40dc-85a2-6a4e50d7ab41 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:53.995436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e528a-b8fe-40dc-85a2-6a4e50d7ab41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:53.996870 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e528a-b8fe-40dc-85a2-6a4e50d7ab41 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:54.005447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:54.047585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 344/692] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Jun 1 17:25:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:25:54.057960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e528a-b8fe-40dc-85a2-6a4e50d7ab41 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:54.078379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483204a-4df1-47a5-8421-0b3ea5df7058 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:54.109568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:54.119102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e1a0e-e59d-417e-acf5-16c904d2fa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:54.120069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e1a0e-e59d-417e-acf5-16c904d2fa66 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:54.126240 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e1a0e-e59d-417e-acf5-16c904d2fa66 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:54.126240 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e1a0e-e59d-417e-acf5-16c904d2fa66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:54.167789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e528a-b8fe-40dc-85a2-6a4e50d7ab41 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:54.205294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aacb03-0cae-4dad-8697-52d81619daf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:54.205956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aacb03-0cae-4dad-8697-52d81619daf9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:54.206241 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aacb03-0cae-4dad-8697-52d81619daf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:54.206520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aacb03-0cae-4dad-8697-52d81619daf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:54.213239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e1a0e-e59d-417e-acf5-16c904d2fa66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:54.214737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e1a0e-e59d-417e-acf5-16c904d2fa66 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:54.277015 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:54.280212 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aacb03-0cae-4dad-8697-52d81619daf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:54.281800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aacb03-0cae-4dad-8697-52d81619daf9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:54.326419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 349/693] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 01 17:25:54.328672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b1bc-db48-476c-8773-36d9c22b0372 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:54.329118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:54.330111 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b1bc-db48-476c-8773-36d9c22b0372 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:54.330653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b1bc-db48-476c-8773-36d9c22b0372 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:54.336501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 350/694] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:54.337564 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80b1bc-db48-476c-8773-36d9c22b0372 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:54.388889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 345/695] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:25:54.391477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d2ce-203b-40b3-8ebe-d0fac6e5f3bd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:54.391477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d2ce-203b-40b3-8ebe-d0fac6e5f3bd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:54.391477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d2ce-203b-40b3-8ebe-d0fac6e5f3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:54.409626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-db88d2ce-203b-40b3-8ebe-d0fac6e5f3bd None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:54.411100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-db88d2ce-203b-40b3-8ebe-d0fac6e5f3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:54.489366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80b1bc-db48-476c-8773-36d9c22b0372 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:54.512963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 346/696] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:54.512963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88d2ce-203b-40b3-8ebe-d0fac6e5f3bd None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:54.552411 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282b042-e89d-4499-9dc9-8b66a26a5380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:54.553741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282b042-e89d-4499-9dc9-8b66a26a5380 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:54.554211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282b042-e89d-4499-9dc9-8b66a26a5380 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:54.554724 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282b042-e89d-4499-9dc9-8b66a26a5380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:54.569236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282b042-e89d-4499-9dc9-8b66a26a5380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:54.571175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282b042-e89d-4499-9dc9-8b66a26a5380 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:54.592381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-5282b042-e89d-4499-9dc9-8b66a26a5380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:54.592381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:54.592381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:54.592381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:54.592381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:54.592381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:54.592381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:54.592381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:54.592381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:54.592381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:54.592381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:54.592381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:54.592381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:54.592381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:54.592381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:54.593482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:54.594443 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:54.594443 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:54.594443 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:54.594443 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:54.596697 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 351/697] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:54.597826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282b042-e89d-4499-9dc9-8b66a26a5380 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:54.605142 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:54.612270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:54.638261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88d2ce-203b-40b3-8ebe-d0fac6e5f3bd None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:54.677167 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88414001-07e8-47de-8b19-efadf0b673ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:54.677900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88414001-07e8-47de-8b19-efadf0b673ed None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:54.678188 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88414001-07e8-47de-8b19-efadf0b673ed None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:54.678466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88414001-07e8-47de-8b19-efadf0b673ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:54.694920 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88414001-07e8-47de-8b19-efadf0b673ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:54.696466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88414001-07e8-47de-8b19-efadf0b673ed None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:54.717175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-88414001-07e8-47de-8b19-efadf0b673ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:54.717175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:54.717175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:54.717175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:54.717175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:54.717175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:54.717175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:54.717175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:54.717175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:54.717175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:54.717175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:54.717175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:54.717175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:54.717175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:54.717175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:54.718163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:54.719310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:54.719310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:54.719310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:54.719310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:54.719310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 347/698] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:54.720200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88414001-07e8-47de-8b19-efadf0b673ed None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:54.725408 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282b042-e89d-4499-9dc9-8b66a26a5380 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:54.763059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649977c-8311-4fcb-9791-859b07c9ca37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:54.763870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649977c-8311-4fcb-9791-859b07c9ca37 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:54.764151 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649977c-8311-4fcb-9791-859b07c9ca37 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:54.764422 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649977c-8311-4fcb-9791-859b07c9ca37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:54.776240 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649977c-8311-4fcb-9791-859b07c9ca37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:54.777900 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649977c-8311-4fcb-9791-859b07c9ca37 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:54.797915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-0649977c-8311-4fcb-9791-859b07c9ca37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:54.797915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:54.797915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:54.797915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:54.797915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:54.797915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:54.797915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:54.797915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:54.797915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:54.797915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:54.797915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:54.797915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:54.797915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:54.797915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:54.797915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:54.798869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:54.799820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:54.799820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:54.799820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:54.799820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:54.799820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 352/699] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:54.800135 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649977c-8311-4fcb-9791-859b07c9ca37 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:54.844305 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88414001-07e8-47de-8b19-efadf0b673ed None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:54.875294 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:54.880823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:54.888302 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8397ed6-7d65-4394-b3a2-6371b78a0a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:54.889011 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8397ed6-7d65-4394-b3a2-6371b78a0a04 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:54.889302 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8397ed6-7d65-4394-b3a2-6371b78a0a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:54.889584 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8397ed6-7d65-4394-b3a2-6371b78a0a04 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:54.898406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8397ed6-7d65-4394-b3a2-6371b78a0a04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:54.898406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8397ed6-7d65-4394-b3a2-6371b78a0a04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:54.898406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8397ed6-7d65-4394-b3a2-6371b78a0a04 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:54.908589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 348/700] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:54.908589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f09c4-aec7-42dd-9e27-31a21c54a400 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:54.908589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f09c4-aec7-42dd-9e27-31a21c54a400 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:54.908589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f09c4-aec7-42dd-9e27-31a21c54a400 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:54.908589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 349/701] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:54.908589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f09c4-aec7-42dd-9e27-31a21c54a400 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:54.930363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649977c-8311-4fcb-9791-859b07c9ca37 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:54.970073 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e709af0-7a64-4c94-9605-435335673e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:54.971451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e709af0-7a64-4c94-9605-435335673e9c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:54.971798 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e709af0-7a64-4c94-9605-435335673e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:54.972140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e709af0-7a64-4c94-9605-435335673e9c None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:54.972869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e709af0-7a64-4c94-9605-435335673e9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:54.973228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e709af0-7a64-4c94-9605-435335673e9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:54.974624 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e709af0-7a64-4c94-9605-435335673e9c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:54.991272 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 353/702] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:54.991272 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e709af0-7a64-4c94-9605-435335673e9c None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:55.020888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f09c4-aec7-42dd-9e27-31a21c54a400 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:55.059151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c9ea0-fae5-4338-8f9e-e95a97c3f1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:55.059825 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c9ea0-fae5-4338-8f9e-e95a97c3f1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:55.060114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c9ea0-fae5-4338-8f9e-e95a97c3f1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:55.060394 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c9ea0-fae5-4338-8f9e-e95a97c3f1f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:55.061138 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c9ea0-fae5-4338-8f9e-e95a97c3f1f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:55.061458 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c9ea0-fae5-4338-8f9e-e95a97c3f1f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:55.063031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c9ea0-fae5-4338-8f9e-e95a97c3f1f4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:55.079225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 350/703] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:55.079225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f8ed0-9d81-439c-8641-950d13dd5a17 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:55.079225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f8ed0-9d81-439c-8641-950d13dd5a17 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:55.079225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f8ed0-9d81-439c-8641-950d13dd5a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:55.095036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-bc6f8ed0-9d81-439c-8641-950d13dd5a17 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:55.096231 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-bc6f8ed0-9d81-439c-8641-950d13dd5a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:55.098296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e709af0-7a64-4c94-9605-435335673e9c None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:55.119172 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:55.134195 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979c003-22e8-4b05-a867-1f68b036c85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:55.137390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979c003-22e8-4b05-a867-1f68b036c85d None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:55.137390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979c003-22e8-4b05-a867-1f68b036c85d None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:55.137390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979c003-22e8-4b05-a867-1f68b036c85d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:55.141322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:55.143167 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979c003-22e8-4b05-a867-1f68b036c85d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:55.144602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979c003-22e8-4b05-a867-1f68b036c85d None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:55.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-2979c003-22e8-4b05-a867-1f68b036c85d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:55.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:55.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:55.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:55.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:55.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:55.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:55.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:55.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:55.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:55.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:55.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:55.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:55.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:55.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:55.167872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:55.168981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:55.168981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:55.168981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:55.168981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:55.168981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:55.168981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:55.168981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:55.168981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:55.168981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 354/704] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:55.168981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979c003-22e8-4b05-a867-1f68b036c85d None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:55.172620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 351/705] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:55.173675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f8ed0-9d81-439c-8641-950d13dd5a17 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:55.284574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979c003-22e8-4b05-a867-1f68b036c85d None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:55.291736 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f8ed0-9d81-439c-8641-950d13dd5a17 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:55.325976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a284e-932c-48f7-951a-60276f628620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:55.326846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a284e-932c-48f7-951a-60276f628620 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:55.327229 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a284e-932c-48f7-951a-60276f628620 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:55.328076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a284e-932c-48f7-951a-60276f628620 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:55.328649 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82db97-be4c-4f1a-b2bb-91ef9d53c0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:55.329124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82db97-be4c-4f1a-b2bb-91ef9d53c0f2 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:55.329407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82db97-be4c-4f1a-b2bb-91ef9d53c0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:55.329681 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82db97-be4c-4f1a-b2bb-91ef9d53c0f2 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:55.330383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82db97-be4c-4f1a-b2bb-91ef9d53c0f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:55.331821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82db97-be4c-4f1a-b2bb-91ef9d53c0f2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:55.335933 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a284e-932c-48f7-951a-60276f628620 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:55.337409 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a284e-932c-48f7-951a-60276f628620 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:55.353029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-7c5a284e-932c-48f7-951a-60276f628620 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:55.353029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:55.353029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:55.353029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:55.353029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:55.353029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:55.353029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:55.353029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:55.353029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:55.353029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:55.353029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:55.353029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:55.353029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:25:55.353029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:25:55.353029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:55.354208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:55.360514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:25:55.360514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:25:55.360514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:25:55.360514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:25:55.360514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:25:55.360514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:25:55.360514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:25:55.360514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:55.360514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 355/706] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:55.360514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a284e-932c-48f7-951a-60276f628620 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:55.400098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:55.416980 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 352/707] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:25:55 2022] POST /identity/v3/users => generated 254 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:25:55.416980 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82db97-be4c-4f1a-b2bb-91ef9d53c0f2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:55.481508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:55.497806 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a284e-932c-48f7-951a-60276f628620 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:55.551314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b0949-00a8-4624-8a1b-442804f9d79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:55.552589 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b0949-00a8-4624-8a1b-442804f9d79a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:55.553004 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b0949-00a8-4624-8a1b-442804f9d79a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:55.553573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b0949-00a8-4624-8a1b-442804f9d79a None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:55.554447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b0949-00a8-4624-8a1b-442804f9d79a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:55.554766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b0949-00a8-4624-8a1b-442804f9d79a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:55.557072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b0949-00a8-4624-8a1b-442804f9d79a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:55.565605 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82db97-be4c-4f1a-b2bb-91ef9d53c0f2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:55.577131 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 356/708] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:55.578729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b0949-00a8-4624-8a1b-442804f9d79a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:55.614207 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a696f-5b52-474c-bb34-d943c3ee10db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:55.615040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a696f-5b52-474c-bb34-d943c3ee10db None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:55.615325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a696f-5b52-474c-bb34-d943c3ee10db None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:55.615604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a696f-5b52-474c-bb34-d943c3ee10db None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:55.616275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a696f-5b52-474c-bb34-d943c3ee10db None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:55.619371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a696f-5b52-474c-bb34-d943c3ee10db None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-095a696f-5b52-474c-bb34-d943c3ee10db None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:55.635288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:55.636300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:55.638026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:55.638026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:55.638026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:55.638026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:55.638026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:55.638026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:55.638026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:55.638026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:55.638026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:55.638026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:55.638026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:55.638026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:25:55.638026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:25:55.638026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 17:25:55.638026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:55.642003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 353/709] 10.222.0.33 () {56 vars in 1129 bytes} [Wed Jun 1 17:25:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:55.642905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a696f-5b52-474c-bb34-d943c3ee10db None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:55.725563 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:55.728776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b0949-00a8-4624-8a1b-442804f9d79a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:55.769326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:55.772711 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a696f-5b52-474c-bb34-d943c3ee10db None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:55.773598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd9198-9a3d-457b-8fad-eeaabf387b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:55.774273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd9198-9a3d-457b-8fad-eeaabf387b5b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:55.774557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd9198-9a3d-457b-8fad-eeaabf387b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:55.774834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd9198-9a3d-457b-8fad-eeaabf387b5b None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:55.775633 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd9198-9a3d-457b-8fad-eeaabf387b5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:55.775947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd9198-9a3d-457b-8fad-eeaabf387b5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:55.777824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd9198-9a3d-457b-8fad-eeaabf387b5b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:55.794435 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 357/710] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:55.795574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd9198-9a3d-457b-8fad-eeaabf387b5b None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:55.815301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8caee91-1392-4275-811f-b89a8435f91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:55.816290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caee91-1392-4275-811f-b89a8435f91b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:55.816786 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caee91-1392-4275-811f-b89a8435f91b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:55.817296 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caee91-1392-4275-811f-b89a8435f91b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:55.818322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8caee91-1392-4275-811f-b89a8435f91b None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=5d5a5ba6aecd46e79dc7199589384a4f) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:55.818846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8caee91-1392-4275-811f-b89a8435f91b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:55.820438 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8caee91-1392-4275-811f-b89a8435f91b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:55.832965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 354/711] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:25:55 2022] GET /identity/v3/role_assignments?user.id=5d5a5ba6aecd46e79dc7199589384a4f&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:55.832965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ae05b-7786-49c3-8fcb-5c9ae71ea32f None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:55.832965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ae05b-7786-49c3-8fcb-5c9ae71ea32f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:55.832965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ae05b-7786-49c3-8fcb-5c9ae71ea32f None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:55.832965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 355/712] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:55.832965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ae05b-7786-49c3-8fcb-5c9ae71ea32f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:55.938134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd9198-9a3d-457b-8fad-eeaabf387b5b None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:55.960974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ae05b-7786-49c3-8fcb-5c9ae71ea32f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:55.988578 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113a753-88ff-4fdd-8610-4c22afb98baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:55.989563 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113a753-88ff-4fdd-8610-4c22afb98baf None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:55.990327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113a753-88ff-4fdd-8610-4c22afb98baf None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:55.990609 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113a753-88ff-4fdd-8610-4c22afb98baf None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:55.991616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113a753-88ff-4fdd-8610-4c22afb98baf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:55.991929 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113a753-88ff-4fdd-8610-4c22afb98baf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:55.994128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113a753-88ff-4fdd-8610-4c22afb98baf None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:56.002486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ab717-62a9-4306-b3a1-2a41212b69b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:56.003303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ab717-62a9-4306-b3a1-2a41212b69b4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:56.003666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ab717-62a9-4306-b3a1-2a41212b69b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:56.004019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ab717-62a9-4306-b3a1-2a41212b69b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:56.005062 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ab717-62a9-4306-b3a1-2a41212b69b4 None admin] RBAC: Adding query filter params (role.id=97f88c6182044737a47af038d94a74b8, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=3f43a4bb5a18445b8836f4613cd5e14b) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:56.005410 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 358/713] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Jun 1 17:25:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:56.005514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ab717-62a9-4306-b3a1-2a41212b69b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:56.006876 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595d28a-7fe2-46af-b5de-966358f2269b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:56.007128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ab717-62a9-4306-b3a1-2a41212b69b4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:56.007230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595d28a-7fe2-46af-b5de-966358f2269b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:56.007428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595d28a-7fe2-46af-b5de-966358f2269b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:56.021124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 356/714] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:25:55 2022] GET /identity/v3/role_assignments?user.id=3f43a4bb5a18445b8836f4613cd5e14b&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=97f88c6182044737a47af038d94a74b8 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:56.022265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ab717-62a9-4306-b3a1-2a41212b69b4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:56.027840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-7595d28a-7fe2-46af-b5de-966358f2269b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:56.029146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7595d28a-7fe2-46af-b5de-966358f2269b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:56.052618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:56.084850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:56.112640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 359/715] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:56.154205 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595d28a-7fe2-46af-b5de-966358f2269b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:56.215821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ab717-62a9-4306-b3a1-2a41212b69b4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:56.262438 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0e5f0-e380-4440-bf03-837915cacc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:56.263134 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0e5f0-e380-4440-bf03-837915cacc12 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:56.263422 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0e5f0-e380-4440-bf03-837915cacc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:56.263700 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0e5f0-e380-4440-bf03-837915cacc12 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:56.264438 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0e5f0-e380-4440-bf03-837915cacc12 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:56.264753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0e5f0-e380-4440-bf03-837915cacc12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:56.266424 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0e5f0-e380-4440-bf03-837915cacc12 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:56.276460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 357/716] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Jun 1 17:25:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:56.340043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595d28a-7fe2-46af-b5de-966358f2269b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:56.381415 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca8bfb-52b4-480a-a138-56ad175dd134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:56.382251 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca8bfb-52b4-480a-a138-56ad175dd134 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:56.382535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca8bfb-52b4-480a-a138-56ad175dd134 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:56.382816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca8bfb-52b4-480a-a138-56ad175dd134 None admin] PATH_INFO: `/v3/services/network` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:56.383491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca8bfb-52b4-480a-a138-56ad175dd134 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:56.385076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca8bfb-52b4-480a-a138-56ad175dd134 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-76ca8bfb-52b4-480a-a138-56ad175dd134 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:56.401007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:56.402060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:56.402901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:56.402901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:56.402901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:56.402901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:56.402901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:56.402901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:56.402901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:56.402901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:56.402901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:56.402901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:56.402901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:25:56.402901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:25:56.402901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 17:25:56.402901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:56.402901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 360/717] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:25:56 2022] GET /identity/v3/services/network => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:25:56.410105 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0e5f0-e380-4440-bf03-837915cacc12 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:56.527437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:56.538990 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0e5f0-e380-4440-bf03-837915cacc12 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:56.574693 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24383343-11cc-4f0f-af9a-aaf211cfd5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:56.575877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24383343-11cc-4f0f-af9a-aaf211cfd5ba None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:56.576537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24383343-11cc-4f0f-af9a-aaf211cfd5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:56.578586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24383343-11cc-4f0f-af9a-aaf211cfd5ba None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:56.579282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24383343-11cc-4f0f-af9a-aaf211cfd5ba None admin] RBAC: Adding query filter params (name=network) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:56.579590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24383343-11cc-4f0f-af9a-aaf211cfd5ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:56.580996 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24383343-11cc-4f0f-af9a-aaf211cfd5ba None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:56.585884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 358/718] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jun 1 17:25:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:56.591383 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca8bfb-52b4-480a-a138-56ad175dd134 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:56.622969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:56.711145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca8bfb-52b4-480a-a138-56ad175dd134 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:56.754795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424cbd5-b4dd-4da7-92e2-970a9dbad58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:56.755817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424cbd5-b4dd-4da7-92e2-970a9dbad58a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:56.756297 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424cbd5-b4dd-4da7-92e2-970a9dbad58a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:56.756747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424cbd5-b4dd-4da7-92e2-970a9dbad58a None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:56.757651 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424cbd5-b4dd-4da7-92e2-970a9dbad58a None admin] RBAC: Adding query filter params (type=network) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:56.758133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424cbd5-b4dd-4da7-92e2-970a9dbad58a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:56.759700 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424cbd5-b4dd-4da7-92e2-970a9dbad58a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:56.766826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 361/719] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jun 1 17:25:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:58.077898 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751a9b7-f978-4a4d-b433-c95ebbcdbd37 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:58.078419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751a9b7-f978-4a4d-b433-c95ebbcdbd37 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:58.078709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751a9b7-f978-4a4d-b433-c95ebbcdbd37 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:58.080191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 359/720] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:58.085216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4400832-0a17-4e2e-bac7-6e3e0870806b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:58.085602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4400832-0a17-4e2e-bac7-6e3e0870806b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:58.085779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4400832-0a17-4e2e-bac7-6e3e0870806b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:58.105232 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-e4400832-0a17-4e2e-bac7-6e3e0870806b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:58.106428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e4400832-0a17-4e2e-bac7-6e3e0870806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:58.193616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 362/721] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:58.229332 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751a9b7-f978-4a4d-b433-c95ebbcdbd37 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:58.360964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751a9b7-f978-4a4d-b433-c95ebbcdbd37 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:58.407576 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d0cbe-6fcc-46e4-bc85-6c56202c8c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:58.408392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d0cbe-6fcc-46e4-bc85-6c56202c8c18 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:58.408677 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d0cbe-6fcc-46e4-bc85-6c56202c8c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:58.408979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d0cbe-6fcc-46e4-bc85-6c56202c8c18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:58.429886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d0cbe-6fcc-46e4-bc85-6c56202c8c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-a96d0cbe-6fcc-46e4-bc85-6c56202c8c18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:58.437998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:58.438922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:58.440369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:58.440369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:58.440369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:58.440369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:58.440369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:58.440369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:58.440369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:58.440369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:58.440369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:58.440369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:58.440369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:25:58.440369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:58.440369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 360/722] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:25:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:58.445039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4400832-0a17-4e2e-bac7-6e3e0870806b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:58.465460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:58.552761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4400832-0a17-4e2e-bac7-6e3e0870806b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:58.589985 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79392a-c5ac-4c2c-8c8c-5a8a3d6ef998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:58.590906 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79392a-c5ac-4c2c-8c8c-5a8a3d6ef998 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:58.591360 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79392a-c5ac-4c2c-8c8c-5a8a3d6ef998 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:58.591792 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79392a-c5ac-4c2c-8c8c-5a8a3d6ef998 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:58.592708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79392a-c5ac-4c2c-8c8c-5a8a3d6ef998 None admin] RBAC: Adding query filter params (name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:58.593344 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79392a-c5ac-4c2c-8c8c-5a8a3d6ef998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:58.594903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79392a-c5ac-4c2c-8c8c-5a8a3d6ef998 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:58.604176 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 363/723] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:25:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:58.609862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d0cbe-6fcc-46e4-bc85-6c56202c8c18 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:58.638220 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:58.751493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d0cbe-6fcc-46e4-bc85-6c56202c8c18 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:58.755821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d20e15-7722-4680-8daf-945131543062 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:58.756114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d20e15-7722-4680-8daf-945131543062 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:58.756397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d20e15-7722-4680-8daf-945131543062 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:58.757929 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 364/724] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:25:58.763662 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dcb78-7f1f-42fd-8678-95278a1988e4 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:58.763956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dcb78-7f1f-42fd-8678-95278a1988e4 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:58.764237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dcb78-7f1f-42fd-8678-95278a1988e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:58.787414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-8d4dcb78-7f1f-42fd-8678-95278a1988e4 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:58.788636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8d4dcb78-7f1f-42fd-8678-95278a1988e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:58.825512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bd19c-fe5c-4e81-96cf-5f6f4ac11511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:58.826340 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bd19c-fe5c-4e81-96cf-5f6f4ac11511 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:58.826634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bd19c-fe5c-4e81-96cf-5f6f4ac11511 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:58.826915 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bd19c-fe5c-4e81-96cf-5f6f4ac11511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:58.851413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bd19c-fe5c-4e81-96cf-5f6f4ac11511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:58.853230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bd19c-fe5c-4e81-96cf-5f6f4ac11511 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:58.889426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-194bd19c-fe5c-4e81-96cf-5f6f4ac11511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:58.889426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:58.889426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:58.889426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:58.889426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:58.889426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:58.889426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:58.889426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:58.889426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:58.889426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:58.889426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:58.889426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:58.889426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:58.889426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:58.889426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:58.891203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:58.893154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:58.893154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:58.893154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:58.893154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:58.893154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 361/725] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:58.899039 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bd19c-fe5c-4e81-96cf-5f6f4ac11511 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:58.963145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 365/726] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:58.989346 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:59.026449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4dcb78-7f1f-42fd-8678-95278a1988e4 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:59.030993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:59.032536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bd19c-fe5c-4e81-96cf-5f6f4ac11511 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:59.099030 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fbd0d-2684-42c4-a715-0d3a4b0715b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:59.099810 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fbd0d-2684-42c4-a715-0d3a4b0715b5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:59.099983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fbd0d-2684-42c4-a715-0d3a4b0715b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:59.100266 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fbd0d-2684-42c4-a715-0d3a4b0715b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:59.101018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fbd0d-2684-42c4-a715-0d3a4b0715b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:59.101332 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fbd0d-2684-42c4-a715-0d3a4b0715b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:59.102985 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fbd0d-2684-42c4-a715-0d3a4b0715b5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:59.126634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 362/727] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:59.132361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fbd0d-2684-42c4-a715-0d3a4b0715b5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:59.198346 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4dcb78-7f1f-42fd-8678-95278a1988e4 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:59.249374 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7942b-9dcd-4791-828e-2182ea6a6ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:59.251189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7942b-9dcd-4791-828e-2182ea6a6ecc None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:59.251631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7942b-9dcd-4791-828e-2182ea6a6ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:59.252368 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7942b-9dcd-4791-828e-2182ea6a6ecc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:59.269107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7942b-9dcd-4791-828e-2182ea6a6ecc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:59.270519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fbd0d-2684-42c4-a715-0d3a4b0715b5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-71d7942b-9dcd-4791-828e-2182ea6a6ecc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:59.279148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:59.280928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:59.281967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:59.281967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:59.281967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:59.281967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:59.281967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:59.281967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:59.281967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:59.281967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:59.281967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:59.281967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:59.281967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:25:59.281967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:59.289101 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 366/728] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:25:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:59.290598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1cbc3-56f9-4de1-8054-ec02c3d70d70 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:59.290894 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1cbc3-56f9-4de1-8054-ec02c3d70d70 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:59.291173 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1cbc3-56f9-4de1-8054-ec02c3d70d70 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:59.292636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 367/729] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:59.293602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a1b91-deea-474c-9c9d-8046643d13e1 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:59.293948 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a1b91-deea-474c-9c9d-8046643d13e1 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:59.294229 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a1b91-deea-474c-9c9d-8046643d13e1 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:59.295556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 368/730] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:59.298063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a1b91-deea-474c-9c9d-8046643d13e1 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:59.309259 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:59.317940 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8beaa6-a189-449d-a6b7-7f6398fc1f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:59.319011 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8beaa6-a189-449d-a6b7-7f6398fc1f02 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:59.321828 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8beaa6-a189-449d-a6b7-7f6398fc1f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:59.321828 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8beaa6-a189-449d-a6b7-7f6398fc1f02 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:59.326585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8beaa6-a189-449d-a6b7-7f6398fc1f02 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:59.328588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8beaa6-a189-449d-a6b7-7f6398fc1f02 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-5f8beaa6-a189-449d-a6b7-7f6398fc1f02 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:25:59.344626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:59.345856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:59.346838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:59.346838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:59.346838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:25:59.346838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:25:59.346838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:25:59.346838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:25:59.346838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:25:59.346838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:25:59.346838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 17:25:59.346838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:59.346838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 363/731] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jun 1 17:25:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:59.347431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5f544-6c1a-45e9-a693-8827554b9bf5 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:59.347431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5f544-6c1a-45e9-a693-8827554b9bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:59.347632 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5f544-6c1a-45e9-a693-8827554b9bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:59.367348 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-26e5f544-6c1a-45e9-a693-8827554b9bf5 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:59.368601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-26e5f544-6c1a-45e9-a693-8827554b9bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:59.379748 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:59.421618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a1b91-deea-474c-9c9d-8046643d13e1 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:59.443947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 364/732] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:59.445275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25f3dd-0adc-4499-8db9-78e01bf62c23 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:59.445568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25f3dd-0adc-4499-8db9-78e01bf62c23 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:59.445849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25f3dd-0adc-4499-8db9-78e01bf62c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:59.465738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf644745-f257-4c40-ac14-99724af8327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:59.466725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf644745-f257-4c40-ac14-99724af8327f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:59.467221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf644745-f257-4c40-ac14-99724af8327f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:59.468286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf644745-f257-4c40-ac14-99724af8327f None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:59.469230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf644745-f257-4c40-ac14-99724af8327f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:59.469564 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf644745-f257-4c40-ac14-99724af8327f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:59.469924 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8b25f3dd-0adc-4499-8db9-78e01bf62c23 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:25:59.470934 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf644745-f257-4c40-ac14-99724af8327f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:59.471108 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8b25f3dd-0adc-4499-8db9-78e01bf62c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:25:59.486537 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 369/733] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:59.486537 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf644745-f257-4c40-ac14-99724af8327f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:59.544128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 365/734] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:25:59.545413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25f3dd-0adc-4499-8db9-78e01bf62c23 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:59.597328 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf644745-f257-4c40-ac14-99724af8327f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:59.603097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:59.625770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:59.634648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3656ba2-9556-4f76-9c0e-d8d2978b7dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:59.635327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3656ba2-9556-4f76-9c0e-d8d2978b7dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:59.635614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3656ba2-9556-4f76-9c0e-d8d2978b7dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:59.636023 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3656ba2-9556-4f76-9c0e-d8d2978b7dc3 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:59.636736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3656ba2-9556-4f76-9c0e-d8d2978b7dc3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:25:59.637079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3656ba2-9556-4f76-9c0e-d8d2978b7dc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:59.638660 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3656ba2-9556-4f76-9c0e-d8d2978b7dc3 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:59.657428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 370/735] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Jun 1 17:25:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:25:59.658251 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3656ba2-9556-4f76-9c0e-d8d2978b7dc3 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:59.667098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25f3dd-0adc-4499-8db9-78e01bf62c23 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:59.705550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99673b-26a2-4731-b955-b9d07b9de17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:59.706356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99673b-26a2-4731-b955-b9d07b9de17b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:59.706641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99673b-26a2-4731-b955-b9d07b9de17b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:59.706920 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99673b-26a2-4731-b955-b9d07b9de17b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:59.717291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99673b-26a2-4731-b955-b9d07b9de17b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-dd99673b-26a2-4731-b955-b9d07b9de17b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:25:59.725026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:59.725979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:59.727166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:59.727166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:59.727166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:59.727166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:59.727166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:25:59.727166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:25:59.727166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:25:59.727166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:25:59.727166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:25:59.727166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:25:59.727166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:25:59.727166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:25:59.727166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 366/736] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:25:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:59.727856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99673b-26a2-4731-b955-b9d07b9de17b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:59.766704 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3656ba2-9556-4f76-9c0e-d8d2978b7dc3 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:59.800387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920e835-a316-4fb5-8043-7a915edbc4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:59.801208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920e835-a316-4fb5-8043-7a915edbc4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:59.801495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920e835-a316-4fb5-8043-7a915edbc4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:59.801771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920e835-a316-4fb5-8043-7a915edbc4b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:59.812320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920e835-a316-4fb5-8043-7a915edbc4b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:59.814074 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920e835-a316-4fb5-8043-7a915edbc4b5 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:59.830088 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99673b-26a2-4731-b955-b9d07b9de17b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:59.834619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-8920e835-a316-4fb5-8043-7a915edbc4b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:59.834619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:25:59.834619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:25:59.834619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:25:59.834619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:25:59.834619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:25:59.834619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:25:59.834619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:25:59.834619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:25:59.834619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:25:59.834619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:25:59.834619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:25:59.834619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:25:59.834619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:25:59.834619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:25:59.835518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:25:59.836423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:25:59.836423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:25:59.836423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:25:59.836423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:25:59.836423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 371/737] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:25:59.836708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920e835-a316-4fb5-8043-7a915edbc4b5 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:25:59.837479 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:59.868104 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c69b8-240f-419a-bd37-1adb3e8faedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:25:59.868884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c69b8-240f-419a-bd37-1adb3e8faedd None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:59.869201 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c69b8-240f-419a-bd37-1adb3e8faedd None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:59.869489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c69b8-240f-419a-bd37-1adb3e8faedd None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:59.870213 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c69b8-240f-419a-bd37-1adb3e8faedd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:25:59.871591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c69b8-240f-419a-bd37-1adb3e8faedd None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:25:59.873551 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:25:59.937810 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920e835-a316-4fb5-8043-7a915edbc4b5 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:25:59.956077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 367/738] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jun 1 17:25:59 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:25:59.957478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161c0d-7b0e-4678-a17f-9517656441a0 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:25:59.957766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161c0d-7b0e-4678-a17f-9517656441a0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:25:59.958039 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161c0d-7b0e-4678-a17f-9517656441a0 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:25:59.959281 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 368/739] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:25:59.959992 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82161c0d-7b0e-4678-a17f-9517656441a0 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:00.001397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a5447-efdb-4443-a06e-4b20899b3129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:00.001988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a5447-efdb-4443-a06e-4b20899b3129 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:00.002276 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a5447-efdb-4443-a06e-4b20899b3129 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:00.002563 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a5447-efdb-4443-a06e-4b20899b3129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:00.080246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82161c0d-7b0e-4678-a17f-9517656441a0 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:00.081318 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a5447-efdb-4443-a06e-4b20899b3129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:00.082976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a5447-efdb-4443-a06e-4b20899b3129 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:00.117365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:00.118587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa24fcb-381d-4f4f-b7a1-85fba7a458bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:00.119200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa24fcb-381d-4f4f-b7a1-85fba7a458bf None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:00.119506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa24fcb-381d-4f4f-b7a1-85fba7a458bf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:00.119769 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa24fcb-381d-4f4f-b7a1-85fba7a458bf None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:00.120540 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa24fcb-381d-4f4f-b7a1-85fba7a458bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:00.120852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa24fcb-381d-4f4f-b7a1-85fba7a458bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:00.122286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa24fcb-381d-4f4f-b7a1-85fba7a458bf None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:00.133070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 369/740] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:25:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:00.133953 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa24fcb-381d-4f4f-b7a1-85fba7a458bf None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:00.166203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:00.208159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 372/741] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:25:59 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 01 17:26:00.213438 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4ded-233c-48a6-9c80-2d25461dd7b4 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:00.213733 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4ded-233c-48a6-9c80-2d25461dd7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:00.214010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e4ded-233c-48a6-9c80-2d25461dd7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:00.231899 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-be4e4ded-233c-48a6-9c80-2d25461dd7b4 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:00.233111 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-be4e4ded-233c-48a6-9c80-2d25461dd7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:00.245286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa24fcb-381d-4f4f-b7a1-85fba7a458bf None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:00.281507 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da914f73-0413-4fd4-b05f-182b36b5cc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:00.282184 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da914f73-0413-4fd4-b05f-182b36b5cc94 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:00.282468 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da914f73-0413-4fd4-b05f-182b36b5cc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:00.282747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da914f73-0413-4fd4-b05f-182b36b5cc94 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:00.283475 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da914f73-0413-4fd4-b05f-182b36b5cc94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:00.283783 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da914f73-0413-4fd4-b05f-182b36b5cc94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:00.285191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da914f73-0413-4fd4-b05f-182b36b5cc94 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:00.301745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 370/742] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:00.301745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da914f73-0413-4fd4-b05f-182b36b5cc94 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:00.316958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 373/743] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 01 17:26:00.316958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e4ded-233c-48a6-9c80-2d25461dd7b4 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:00.379112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:00.398347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:00.410784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da914f73-0413-4fd4-b05f-182b36b5cc94 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:00.421650 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e4ded-233c-48a6-9c80-2d25461dd7b4 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:00.447386 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70ee4a-17a8-4a44-87a5-089d489cece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:00.449021 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70ee4a-17a8-4a44-87a5-089d489cece4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:00.449305 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70ee4a-17a8-4a44-87a5-089d489cece4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:00.449582 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70ee4a-17a8-4a44-87a5-089d489cece4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:00.461935 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a291aea-a733-4528-9fc9-72dd4e362e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:00.462670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a291aea-a733-4528-9fc9-72dd4e362e3d None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:00.462941 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a291aea-a733-4528-9fc9-72dd4e362e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:00.463220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a291aea-a733-4528-9fc9-72dd4e362e3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:00.463975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70ee4a-17a8-4a44-87a5-089d489cece4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:00.466328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70ee4a-17a8-4a44-87a5-089d489cece4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:00.473970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a291aea-a733-4528-9fc9-72dd4e362e3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:00.475441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a291aea-a733-4528-9fc9-72dd4e362e3d None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:00.486684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-3c70ee4a-17a8-4a44-87a5-089d489cece4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:00.486684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:00.486684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:00.486684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:00.486684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:00.486684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:00.486684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:00.486684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:00.486684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:00.486684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:00.486684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:00.486684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:00.486684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:00.486684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:00.486684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:00.487565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:00.488466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:00.488466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:00.488466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:00.488466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:00.488466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 371/744] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:00.488750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70ee4a-17a8-4a44-87a5-089d489cece4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:00.499925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-7a291aea-a733-4528-9fc9-72dd4e362e3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:00.499925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:00.499925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:00.499925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:00.499925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:00.499925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:00.499925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:00.499925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:00.499925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:00.499925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:00.499925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:00.499925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:00.499925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:00.499925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:00.499925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:00.500846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:00.502404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:00.502404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:00.502404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:00.502404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:00.502404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 374/745] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:00.502404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a291aea-a733-4528-9fc9-72dd4e362e3d None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:00.605889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70ee4a-17a8-4a44-87a5-089d489cece4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:00.610493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a291aea-a733-4528-9fc9-72dd4e362e3d None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:00.625162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:00.644374 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601987d7-28f8-4eb9-b7d5-a4989ba3ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:00.645070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601987d7-28f8-4eb9-b7d5-a4989ba3ff4e None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:00.645354 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601987d7-28f8-4eb9-b7d5-a4989ba3ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:00.645457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a01dd-6110-4fd3-a938-d51f384b91bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:00.645633 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601987d7-28f8-4eb9-b7d5-a4989ba3ff4e None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:00.646167 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a01dd-6110-4fd3-a938-d51f384b91bf None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:00.646357 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601987d7-28f8-4eb9-b7d5-a4989ba3ff4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:00.646453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a01dd-6110-4fd3-a938-d51f384b91bf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:00.646723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a01dd-6110-4fd3-a938-d51f384b91bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:00.647706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601987d7-28f8-4eb9-b7d5-a4989ba3ff4e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:00.654961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a01dd-6110-4fd3-a938-d51f384b91bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:00.656821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a01dd-6110-4fd3-a938-d51f384b91bf None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:00.659720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-058a01dd-6110-4fd3-a938-d51f384b91bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:26:00.672310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:00.673345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:00.674749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:00.674749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:00.674749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:26:00.674749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:26:00.674749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:26:00.674749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:26:00.674749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:26:00.674749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:26:00.674749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:26:00.674749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:00.674749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 372/746] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jun 1 17:26:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:00.674749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a01dd-6110-4fd3-a938-d51f384b91bf None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:00.737508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 375/747] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jun 1 17:26:00 2022] POST /identity/v3/services => generated 240 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:26:00.738846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601987d7-28f8-4eb9-b7d5-a4989ba3ff4e None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:00.812925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a01dd-6110-4fd3-a938-d51f384b91bf None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:00.878989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7407f3-7ac2-401e-9314-9375b9bfaf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:00.880692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7407f3-7ac2-401e-9314-9375b9bfaf14 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:00.881232 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7407f3-7ac2-401e-9314-9375b9bfaf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:00.881989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7407f3-7ac2-401e-9314-9375b9bfaf14 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:00.882934 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7407f3-7ac2-401e-9314-9375b9bfaf14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:00.883690 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7407f3-7ac2-401e-9314-9375b9bfaf14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:00.885926 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7407f3-7ac2-401e-9314-9375b9bfaf14 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:00.908095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601987d7-28f8-4eb9-b7d5-a4989ba3ff4e None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:00.908929 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 373/748] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:00.911162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7407f3-7ac2-401e-9314-9375b9bfaf14 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:00.954541 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af4f03-94c1-4f76-880d-b7d6e900f685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:00.955217 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af4f03-94c1-4f76-880d-b7d6e900f685 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:00.955621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af4f03-94c1-4f76-880d-b7d6e900f685 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:00.955904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af4f03-94c1-4f76-880d-b7d6e900f685 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:00.957544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af4f03-94c1-4f76-880d-b7d6e900f685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:00.958721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af4f03-94c1-4f76-880d-b7d6e900f685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:00.959244 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af4f03-94c1-4f76-880d-b7d6e900f685 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:00.974640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 376/749] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:00.975483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af4f03-94c1-4f76-880d-b7d6e900f685 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:00.981860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:01.013639 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:01.038100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7407f3-7ac2-401e-9314-9375b9bfaf14 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:01.088989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af4f03-94c1-4f76-880d-b7d6e900f685 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:01.092579 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f83b1-c418-4d47-b871-0dab84460bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:01.094448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f83b1-c418-4d47-b871-0dab84460bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:01.094733 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f83b1-c418-4d47-b871-0dab84460bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:01.095012 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f83b1-c418-4d47-b871-0dab84460bf5 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:01.095888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f83b1-c418-4d47-b871-0dab84460bf5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:01.096209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f83b1-c418-4d47-b871-0dab84460bf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:01.098826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f83b1-c418-4d47-b871-0dab84460bf5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:01.124997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 374/750] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jun 1 17:26:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:01.124997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f83b1-c418-4d47-b871-0dab84460bf5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:01.146509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca3dbe-8e75-4758-8643-2ed69059e2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:01.147680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca3dbe-8e75-4758-8643-2ed69059e2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:01.148191 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca3dbe-8e75-4758-8643-2ed69059e2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:01.148676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca3dbe-8e75-4758-8643-2ed69059e2d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:01.157880 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca3dbe-8e75-4758-8643-2ed69059e2d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:01.161197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca3dbe-8e75-4758-8643-2ed69059e2d9 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-3aca3dbe-8e75-4758-8643-2ed69059e2d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:26:01.178509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:01.179528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:01.180509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:01.180509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:01.180509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:26:01.180509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:26:01.180509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:26:01.180509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:26:01.180509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:26:01.180509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:26:01.180509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 01 17:26:01.180509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:01.183252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 377/751] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:26:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:01.184478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca3dbe-8e75-4758-8643-2ed69059e2d9 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:01.236530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f83b1-c418-4d47-b871-0dab84460bf5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:01.252002 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:01.274244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b99c0-2617-4a1a-9ff3-8bd50c699109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:01.275050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b99c0-2617-4a1a-9ff3-8bd50c699109 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:01.275360 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b99c0-2617-4a1a-9ff3-8bd50c699109 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:01.275869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b99c0-2617-4a1a-9ff3-8bd50c699109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:01.283700 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b99c0-2617-4a1a-9ff3-8bd50c699109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:01.285198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b99c0-2617-4a1a-9ff3-8bd50c699109 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:01.294832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:01.301180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-883b99c0-2617-4a1a-9ff3-8bd50c699109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:01.301180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:01.301180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:01.301180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:01.301180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:01.301180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:01.301180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:01.301180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:01.301180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:01.301180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:01.301180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:01.301180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:01.301180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:26:01.301180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:26:01.301180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:01.302159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:01.303148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:26:01.303148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:26:01.303148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:26:01.303148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:26:01.303148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:26:01.303148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:26:01.303148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:01.303148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:01.305795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca3dbe-8e75-4758-8643-2ed69059e2d9 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:01.307269 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 375/752] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:01.308133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b99c0-2617-4a1a-9ff3-8bd50c699109 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:01.352522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769aa3a-41e2-4097-bd1d-b7e90bd283d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:01.353840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769aa3a-41e2-4097-bd1d-b7e90bd283d1 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:01.354130 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769aa3a-41e2-4097-bd1d-b7e90bd283d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:01.354408 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769aa3a-41e2-4097-bd1d-b7e90bd283d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:01.369444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769aa3a-41e2-4097-bd1d-b7e90bd283d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:01.371162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769aa3a-41e2-4097-bd1d-b7e90bd283d1 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:01.392904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-9769aa3a-41e2-4097-bd1d-b7e90bd283d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:01.392904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:01.392904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:01.392904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:01.392904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:01.392904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:01.392904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:01.392904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:01.392904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:01.392904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:01.392904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:01.392904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:01.392904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:01.392904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:01.392904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:01.393865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:01.394785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:01.394785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:01.394785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:01.394785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:01.401473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 378/753] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:01.402667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769aa3a-41e2-4097-bd1d-b7e90bd283d1 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:01.428020 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b99c0-2617-4a1a-9ff3-8bd50c699109 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:01.466773 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b981b2-b0f3-4c4a-94a8-fb4bfe200214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:01.467971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b981b2-b0f3-4c4a-94a8-fb4bfe200214 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:01.469250 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b981b2-b0f3-4c4a-94a8-fb4bfe200214 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:01.471009 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b981b2-b0f3-4c4a-94a8-fb4bfe200214 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:01.472092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b981b2-b0f3-4c4a-94a8-fb4bfe200214 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:01.472687 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b981b2-b0f3-4c4a-94a8-fb4bfe200214 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:01.477581 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b981b2-b0f3-4c4a-94a8-fb4bfe200214 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:01.499045 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 376/754] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Jun 1 17:26:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:01.500795 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b981b2-b0f3-4c4a-94a8-fb4bfe200214 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:01.531973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769aa3a-41e2-4097-bd1d-b7e90bd283d1 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:01.534572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:01.574558 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e7bfa-c8ed-4e6a-b703-518efd36756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:01.575385 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e7bfa-c8ed-4e6a-b703-518efd36756e None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:01.575796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e7bfa-c8ed-4e6a-b703-518efd36756e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:01.576173 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e7bfa-c8ed-4e6a-b703-518efd36756e None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:01.577209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e7bfa-c8ed-4e6a-b703-518efd36756e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:01.578222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e7bfa-c8ed-4e6a-b703-518efd36756e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:01.579794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e7bfa-c8ed-4e6a-b703-518efd36756e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:01.598790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 379/755] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:01.599901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e7bfa-c8ed-4e6a-b703-518efd36756e None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:01.611753 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:01.616358 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b981b2-b0f3-4c4a-94a8-fb4bfe200214 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:01.653655 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185aaa7-d214-4cde-b564-7e7e2f4a9e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:01.654611 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185aaa7-d214-4cde-b564-7e7e2f4a9e63 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:01.655057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185aaa7-d214-4cde-b564-7e7e2f4a9e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:01.656047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185aaa7-d214-4cde-b564-7e7e2f4a9e63 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:01.657028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185aaa7-d214-4cde-b564-7e7e2f4a9e63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:01.657599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185aaa7-d214-4cde-b564-7e7e2f4a9e63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:01.659155 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185aaa7-d214-4cde-b564-7e7e2f4a9e63 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:01.672065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 377/756] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:01.673172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185aaa7-d214-4cde-b564-7e7e2f4a9e63 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:01.712529 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e7bfa-c8ed-4e6a-b703-518efd36756e None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:01.748455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f56131-80ee-4c1a-af73-5cd7f0a44a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:01.749390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f56131-80ee-4c1a-af73-5cd7f0a44a38 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:01.750535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f56131-80ee-4c1a-af73-5cd7f0a44a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:01.750978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f56131-80ee-4c1a-af73-5cd7f0a44a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:01.781403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185aaa7-d214-4cde-b564-7e7e2f4a9e63 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:01.817472 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c614d81-2585-4b5a-bfa3-bb0b53ef6118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:01.818502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c614d81-2585-4b5a-bfa3-bb0b53ef6118 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:01.818989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c614d81-2585-4b5a-bfa3-bb0b53ef6118 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:01.819441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c614d81-2585-4b5a-bfa3-bb0b53ef6118 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:01.820476 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c614d81-2585-4b5a-bfa3-bb0b53ef6118 None admin] RBAC: Adding query filter params (role.id=97f88c6182044737a47af038d94a74b8, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=253f9ffb48dd4eaab87aae5316fb5394) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:01.820979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c614d81-2585-4b5a-bfa3-bb0b53ef6118 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:01.822652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c614d81-2585-4b5a-bfa3-bb0b53ef6118 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:01.823937 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f56131-80ee-4c1a-af73-5cd7f0a44a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:01.825505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f56131-80ee-4c1a-af73-5cd7f0a44a38 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:01.837061 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 378/757] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:26:01 2022] GET /identity/v3/role_assignments?user.id=253f9ffb48dd4eaab87aae5316fb5394&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=97f88c6182044737a47af038d94a74b8 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:01.839854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c614d81-2585-4b5a-bfa3-bb0b53ef6118 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:01.850591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:02.025940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 380/758] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:26:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:26:02.027473 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c614d81-2585-4b5a-bfa3-bb0b53ef6118 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:02.032439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f56131-80ee-4c1a-af73-5cd7f0a44a38 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:02.105836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedbdde-d271-44a9-b58b-f61c5fcf95d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:02.106647 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedbdde-d271-44a9-b58b-f61c5fcf95d2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:02.106932 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedbdde-d271-44a9-b58b-f61c5fcf95d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:02.107211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedbdde-d271-44a9-b58b-f61c5fcf95d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:02.119887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedbdde-d271-44a9-b58b-f61c5fcf95d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:02.121657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedbdde-d271-44a9-b58b-f61c5fcf95d2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:02.137122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-5eedbdde-d271-44a9-b58b-f61c5fcf95d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:02.137122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:02.137122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:02.137122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:02.137122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:02.137122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:02.137122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:02.137122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:02.137122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:02.137122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:02.137122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:02.137122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:02.137122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:26:02.137122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:26:02.137122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:02.138566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:02.140096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:26:02.140096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:26:02.140096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:26:02.140096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:26:02.140096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:26:02.140096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:26:02.140096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:02.140096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:02.142963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 379/759] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:02.150061 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedbdde-d271-44a9-b58b-f61c5fcf95d2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:02.179099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:02.245033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:02.271795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f56131-80ee-4c1a-af73-5cd7f0a44a38 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:02.281097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:02.319327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e1d42-e735-4506-996b-cd3f0ea62f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:02.320970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e1d42-e735-4506-996b-cd3f0ea62f82 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:02.321479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e1d42-e735-4506-996b-cd3f0ea62f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:02.321969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e1d42-e735-4506-996b-cd3f0ea62f82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:02.337934 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e1d42-e735-4506-996b-cd3f0ea62f82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:02.339436 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e1d42-e735-4506-996b-cd3f0ea62f82 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:02.359314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-bb5e1d42-e735-4506-996b-cd3f0ea62f82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:02.359314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:02.359314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:02.359314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:02.359314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:02.359314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:02.359314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:02.359314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:02.359314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:02.359314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:02.359314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:02.359314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:02.359314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:02.359314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:02.359314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:02.360252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:02.361893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:02.361893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:02.361893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:02.361893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:02.361893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 381/760] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:02.362367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20320d7-a0a6-467d-ab96-021eecda08ba None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:02.362580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20320d7-a0a6-467d-ab96-021eecda08ba None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:02.362892 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20320d7-a0a6-467d-ab96-021eecda08ba None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:02.368265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 382/761] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:02.369285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20320d7-a0a6-467d-ab96-021eecda08ba None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:02.382512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedbdde-d271-44a9-b58b-f61c5fcf95d2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:02.421619 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f25d2-1488-4ae0-957d-5a34af241353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:02.422719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f25d2-1488-4ae0-957d-5a34af241353 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:02.423219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f25d2-1488-4ae0-957d-5a34af241353 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:02.423828 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f25d2-1488-4ae0-957d-5a34af241353 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:02.425061 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f25d2-1488-4ae0-957d-5a34af241353 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:02.425594 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f25d2-1488-4ae0-957d-5a34af241353 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:02.427460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f25d2-1488-4ae0-957d-5a34af241353 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:02.442198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 380/762] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:02.443925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb6531-5558-4d65-a4e9-b4f59505b47d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:02.444429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb6531-5558-4d65-a4e9-b4f59505b47d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:02.444927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb6531-5558-4d65-a4e9-b4f59505b47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:02.469708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b6eb6531-5558-4d65-a4e9-b4f59505b47d None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:02.471366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b6eb6531-5558-4d65-a4e9-b4f59505b47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:02.478894 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20320d7-a0a6-467d-ab96-021eecda08ba None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:02.517614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753ea0c-6ed1-4e37-ab00-a117881c75e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:02.518546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753ea0c-6ed1-4e37-ab00-a117881c75e8 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:02.518835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753ea0c-6ed1-4e37-ab00-a117881c75e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:02.519118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753ea0c-6ed1-4e37-ab00-a117881c75e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:02.521944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753ea0c-6ed1-4e37-ab00-a117881c75e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:02.522277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753ea0c-6ed1-4e37-ab00-a117881c75e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:02.523671 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753ea0c-6ed1-4e37-ab00-a117881c75e8 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:02.540085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 383/763] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:02.540851 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753ea0c-6ed1-4e37-ab00-a117881c75e8 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:02.565087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 381/764] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:02.566530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb6531-5558-4d65-a4e9-b4f59505b47d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:02.567617 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:02.583145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:02.684640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753ea0c-6ed1-4e37-ab00-a117881c75e8 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:02.706193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb6531-5558-4d65-a4e9-b4f59505b47d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:02.722871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041a053-bf03-4fe3-8909-e2311859d28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:02.724115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041a053-bf03-4fe3-8909-e2311859d28f None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:02.724598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041a053-bf03-4fe3-8909-e2311859d28f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:02.725147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041a053-bf03-4fe3-8909-e2311859d28f None admin] PATH_INFO: `/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/5d5a5ba6aecd46e79dc7199589384a4f/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:02.727680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041a053-bf03-4fe3-8909-e2311859d28f None admin] RBAC: Authorizing `identity:create_grant(project_id=68bf9a1e88a64a02ba53d0bedb76072a, user_id=5d5a5ba6aecd46e79dc7199589384a4f, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:02.729403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041a053-bf03-4fe3-8909-e2311859d28f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:02.750761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422aa00e-75a9-4a19-aa45-eacf1bc635e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:02.751655 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422aa00e-75a9-4a19-aa45-eacf1bc635e6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:02.751948 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422aa00e-75a9-4a19-aa45-eacf1bc635e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:02.752229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422aa00e-75a9-4a19-aa45-eacf1bc635e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:02.759611 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422aa00e-75a9-4a19-aa45-eacf1bc635e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:02.761095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422aa00e-75a9-4a19-aa45-eacf1bc635e6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:02.776228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-422aa00e-75a9-4a19-aa45-eacf1bc635e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:02.776228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:02.776228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:02.776228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:02.776228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:02.776228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:02.776228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:02.776228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:02.776228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:02.776228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:02.776228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:02.776228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:02.776228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:26:02.776228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:26:02.776228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:02.777591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:02.779031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:26:02.779031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:26:02.779031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:26:02.779031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:26:02.779031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:26:02.779031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:26:02.779031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:02.779031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:02.779031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 382/765] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:02.779031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422aa00e-75a9-4a19-aa45-eacf1bc635e6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:02.821296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 384/766] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:26:02 2022] PUT /identity/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/5d5a5ba6aecd46e79dc7199589384a4f/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:26:02.822250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041a053-bf03-4fe3-8909-e2311859d28f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:02.873695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:02.925689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422aa00e-75a9-4a19-aa45-eacf1bc635e6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:02.975142 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2e4d0-4e8a-4a83-ab4d-2a962a4a1a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:02.975985 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2e4d0-4e8a-4a83-ab4d-2a962a4a1a55 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:02.976272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2e4d0-4e8a-4a83-ab4d-2a962a4a1a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:02.976809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2e4d0-4e8a-4a83-ab4d-2a962a4a1a55 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:02.977518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2e4d0-4e8a-4a83-ab4d-2a962a4a1a55 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:02.985171 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2e4d0-4e8a-4a83-ab4d-2a962a4a1a55 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-46b2e4d0-4e8a-4a83-ab4d-2a962a4a1a55 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:03.016571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:03.017663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:03.018513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:03.018513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:03.018513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:03.018513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:03.018513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:03.018513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:03.018513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:03.018513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:03.018513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:03.018513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:03.018513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:03.018513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:03.018513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:03.018513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 17:26:03.018513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:03.021024 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 383/767] 10.222.0.33 () {56 vars in 1129 bytes} [Wed Jun 1 17:26:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:03.022891 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:03.029050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2e4d0-4e8a-4a83-ab4d-2a962a4a1a55 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:03.098315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041a053-bf03-4fe3-8909-e2311859d28f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:03.145335 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39012b5-2478-41d2-b741-842681116938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:03.146783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39012b5-2478-41d2-b741-842681116938 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:03.147459 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39012b5-2478-41d2-b741-842681116938 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:03.147842 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39012b5-2478-41d2-b741-842681116938 None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:03.149527 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39012b5-2478-41d2-b741-842681116938 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:03.150378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39012b5-2478-41d2-b741-842681116938 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:03.152244 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39012b5-2478-41d2-b741-842681116938 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:03.167550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 385/768] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:03.173776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39012b5-2478-41d2-b741-842681116938 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:03.176641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2e4d0-4e8a-4a83-ab4d-2a962a4a1a55 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:03.225627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:03.229705 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0c51b-9509-4748-8adf-7a432074bafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:03.230500 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0c51b-9509-4748-8adf-7a432074bafd None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:03.230786 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0c51b-9509-4748-8adf-7a432074bafd None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:03.231062 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0c51b-9509-4748-8adf-7a432074bafd None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:03.231775 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0c51b-9509-4748-8adf-7a432074bafd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:03.232082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0c51b-9509-4748-8adf-7a432074bafd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:03.233972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0c51b-9509-4748-8adf-7a432074bafd None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:03.239397 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 384/769] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Jun 1 17:26:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:03.240787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b825-5a68-44ed-b0ed-7bf7dff65a91 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:03.244863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b825-5a68-44ed-b0ed-7bf7dff65a91 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:03.244863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24b825-5a68-44ed-b0ed-7bf7dff65a91 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:03.244863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 385/770] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:03.247817 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24b825-5a68-44ed-b0ed-7bf7dff65a91 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:03.301663 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39012b5-2478-41d2-b741-842681116938 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:03.337945 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcabd5-d101-49b2-8630-505c19100d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:03.338711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcabd5-d101-49b2-8630-505c19100d72 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:03.338901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcabd5-d101-49b2-8630-505c19100d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:03.340731 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcabd5-d101-49b2-8630-505c19100d72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:03.340731 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcabd5-d101-49b2-8630-505c19100d72 None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=3f43a4bb5a18445b8836f4613cd5e14b) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:03.340731 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcabd5-d101-49b2-8630-505c19100d72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:03.341977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcabd5-d101-49b2-8630-505c19100d72 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:03.349522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 386/771] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:26:03 2022] GET /identity/v3/role_assignments?user.id=3f43a4bb5a18445b8836f4613cd5e14b&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:03.357905 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af754405-5d6f-4861-b670-43a9678272a5 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:03.358268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af754405-5d6f-4861-b670-43a9678272a5 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:03.358542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af754405-5d6f-4861-b670-43a9678272a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:03.368260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:03.373205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24b825-5a68-44ed-b0ed-7bf7dff65a91 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:03.389250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-af754405-5d6f-4861-b670-43a9678272a5 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:03.390575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-af754405-5d6f-4861-b670-43a9678272a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:03.429843 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c1e7e-29b4-4e80-a7db-58b194bdc8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:03.430599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c1e7e-29b4-4e80-a7db-58b194bdc8ca None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:03.430939 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c1e7e-29b4-4e80-a7db-58b194bdc8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:03.431229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c1e7e-29b4-4e80-a7db-58b194bdc8ca None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:03.431964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c1e7e-29b4-4e80-a7db-58b194bdc8ca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:03.432280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c1e7e-29b4-4e80-a7db-58b194bdc8ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:03.433807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c1e7e-29b4-4e80-a7db-58b194bdc8ca None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:03.444117 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 386/772] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Jun 1 17:26:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:03.450083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c1e7e-29b4-4e80-a7db-58b194bdc8ca None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:03.549161 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:03.582764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 387/773] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:03.606018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c1e7e-29b4-4e80-a7db-58b194bdc8ca None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:03.612568 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af754405-5d6f-4861-b670-43a9678272a5 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:03.689684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741cc06-4c1a-486e-9788-d401c3b90970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:03.690367 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741cc06-4c1a-486e-9788-d401c3b90970 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:03.690653 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741cc06-4c1a-486e-9788-d401c3b90970 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:03.690931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741cc06-4c1a-486e-9788-d401c3b90970 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:03.691733 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741cc06-4c1a-486e-9788-d401c3b90970 None admin] RBAC: Adding query filter params (interface=public, service_id=d44d90c08b4b4b009f1f75c0e6461131, region_id=RegionOne) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:03.692043 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741cc06-4c1a-486e-9788-d401c3b90970 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:03.693455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741cc06-4c1a-486e-9788-d401c3b90970 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:03.711274 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 387/774] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jun 1 17:26:03 2022] GET /identity/v3/endpoints?service_id=d44d90c08b4b4b009f1f75c0e6461131&interface=public®ion_id=RegionOne => generated 194 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:03.716291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741cc06-4c1a-486e-9788-d401c3b90970 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:03.728658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af754405-5d6f-4861-b670-43a9678272a5 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:03.763872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:03.775185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31f8f1-b0cd-496f-84b2-9b0949542a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:03.776981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31f8f1-b0cd-496f-84b2-9b0949542a1f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:03.777293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31f8f1-b0cd-496f-84b2-9b0949542a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:03.777575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31f8f1-b0cd-496f-84b2-9b0949542a1f None admin] PATH_INFO: `/v3/services/network` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:03.780054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31f8f1-b0cd-496f-84b2-9b0949542a1f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:03.781957 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31f8f1-b0cd-496f-84b2-9b0949542a1f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-2d31f8f1-b0cd-496f-84b2-9b0949542a1f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:03.814823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:03.817225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:03.819255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:03.819255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:03.819255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:03.819255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:03.819255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:03.819255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:03.819255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:03.819255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:03.819255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:03.819255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:03.819255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:03.819255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:03.819255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 17:26:03.819255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:03.819255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 388/775] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:03 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:03.825048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31f8f1-b0cd-496f-84b2-9b0949542a1f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:03.898170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741cc06-4c1a-486e-9788-d401c3b90970 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:03.924841 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:03.938935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322db3c-1c09-4f52-b738-305d272372ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:03.940586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322db3c-1c09-4f52-b738-305d272372ab None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:03.940892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322db3c-1c09-4f52-b738-305d272372ab None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:03.941202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322db3c-1c09-4f52-b738-305d272372ab None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:03.941906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322db3c-1c09-4f52-b738-305d272372ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:03.943363 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322db3c-1c09-4f52-b738-305d272372ab None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:03.949764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 388/776] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jun 1 17:26:03 2022] GET /identity/v3/services => generated 772 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:04.043645 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31f8f1-b0cd-496f-84b2-9b0949542a1f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:04.095516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751bc79-313d-4909-9b64-9c1cf9297faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:04.096232 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751bc79-313d-4909-9b64-9c1cf9297faa None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:04.096519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751bc79-313d-4909-9b64-9c1cf9297faa None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:04.096843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751bc79-313d-4909-9b64-9c1cf9297faa None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:04.097615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751bc79-313d-4909-9b64-9c1cf9297faa None admin] RBAC: Adding query filter params (name=network) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:04.097975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751bc79-313d-4909-9b64-9c1cf9297faa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:04.099422 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751bc79-313d-4909-9b64-9c1cf9297faa None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:04.105370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 389/777] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jun 1 17:26:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:04.111730 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322db3c-1c09-4f52-b738-305d272372ab None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:04.247612 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322db3c-1c09-4f52-b738-305d272372ab None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:04.289664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49850a-9dcb-4c1d-b191-65318f81b232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:04.290430 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49850a-9dcb-4c1d-b191-65318f81b232 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:04.290761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49850a-9dcb-4c1d-b191-65318f81b232 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:04.291083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49850a-9dcb-4c1d-b191-65318f81b232 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:04.291863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49850a-9dcb-4c1d-b191-65318f81b232 None admin] RBAC: Adding query filter params (type=network) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:04.292181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49850a-9dcb-4c1d-b191-65318f81b232 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:04.293750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49850a-9dcb-4c1d-b191-65318f81b232 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:04.300808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 389/778] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jun 1 17:26:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:04.307302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751bc79-313d-4909-9b64-9c1cf9297faa None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:04.375641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:04.386489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf7093-6606-4ec6-9503-51be11aad6f0 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:04.393974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf7093-6606-4ec6-9503-51be11aad6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:04.393974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf7093-6606-4ec6-9503-51be11aad6f0 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:04.393974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 390/779] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:04.393974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95a13b-7e60-4e05-af22-7fb66f109baa None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:04.394294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95a13b-7e60-4e05-af22-7fb66f109baa None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:04.394510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95a13b-7e60-4e05-af22-7fb66f109baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:04.420356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6c95a13b-7e60-4e05-af22-7fb66f109baa None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:04.422114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6c95a13b-7e60-4e05-af22-7fb66f109baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:04.456655 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751bc79-313d-4909-9b64-9c1cf9297faa None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:04.526150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:04.527404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59641f1e-e34f-41bd-a63f-b648d6313067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:04.528080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59641f1e-e34f-41bd-a63f-b648d6313067 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:04.528368 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59641f1e-e34f-41bd-a63f-b648d6313067 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:04.528644 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59641f1e-e34f-41bd-a63f-b648d6313067 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:04.529473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59641f1e-e34f-41bd-a63f-b648d6313067 None admin] RBAC: Adding query filter params (interface=public, service_id=29d5bf0310f04dfabe8d1ce5156af685, region_id=RegionOne) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:04.529788 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59641f1e-e34f-41bd-a63f-b648d6313067 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:04.531413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59641f1e-e34f-41bd-a63f-b648d6313067 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:04.553870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 390/780] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jun 1 17:26:04 2022] GET /identity/v3/endpoints?service_id=29d5bf0310f04dfabe8d1ce5156af685&interface=public®ion_id=RegionOne => generated 194 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:04.559803 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59641f1e-e34f-41bd-a63f-b648d6313067 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:04.575740 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 391/781] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:04.619153 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95a13b-7e60-4e05-af22-7fb66f109baa None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:04.679635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59641f1e-e34f-41bd-a63f-b648d6313067 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:04.714274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:04.738862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de66be3-6cfe-44bd-8326-9b0891504100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:04.739814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de66be3-6cfe-44bd-8326-9b0891504100 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:04.740199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de66be3-6cfe-44bd-8326-9b0891504100 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:04.740575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de66be3-6cfe-44bd-8326-9b0891504100 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:04.741384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de66be3-6cfe-44bd-8326-9b0891504100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:04.750179 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de66be3-6cfe-44bd-8326-9b0891504100 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:04.764149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 391/782] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jun 1 17:26:04 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:04.796502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95a13b-7e60-4e05-af22-7fb66f109baa None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:04.852661 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d40cce-f8b3-4be2-ad83-87afd3dff8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:04.853837 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d40cce-f8b3-4be2-ad83-87afd3dff8ae None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:04.854275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d40cce-f8b3-4be2-ad83-87afd3dff8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:04.854704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d40cce-f8b3-4be2-ad83-87afd3dff8ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:04.879305 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d40cce-f8b3-4be2-ad83-87afd3dff8ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-a2d40cce-f8b3-4be2-ad83-87afd3dff8ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:26:04.892659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:04.893895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:04.894952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:04.894952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:04.894952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:04.894952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:04.894952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:26:04.894952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:26:04.894952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:26:04.894952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:26:04.894952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:26:04.894952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:26:04.894952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:26:04.894952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:04.897499 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 392/783] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:26:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:04.903333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de66be3-6cfe-44bd-8326-9b0891504100 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:05.054780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de66be3-6cfe-44bd-8326-9b0891504100 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:05.100230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d6b91-cbf9-4750-a292-48ed7d4a5802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:05.101594 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d6b91-cbf9-4750-a292-48ed7d4a5802 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:05.102098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d6b91-cbf9-4750-a292-48ed7d4a5802 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:05.102585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d6b91-cbf9-4750-a292-48ed7d4a5802 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:05.103566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d6b91-cbf9-4750-a292-48ed7d4a5802 None admin] RBAC: Adding query filter params (name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:05.104085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d6b91-cbf9-4750-a292-48ed7d4a5802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:05.105704 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d6b91-cbf9-4750-a292-48ed7d4a5802 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:05.115854 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 392/784] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:26:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:05.121118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d40cce-f8b3-4be2-ad83-87afd3dff8ae None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:05.168448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:05.231388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d40cce-f8b3-4be2-ad83-87afd3dff8ae None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:05.276365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1933e-8b3a-4300-bf83-4ed6e11a644f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:05.277215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1933e-8b3a-4300-bf83-4ed6e11a644f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:05.277506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1933e-8b3a-4300-bf83-4ed6e11a644f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:05.277791 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1933e-8b3a-4300-bf83-4ed6e11a644f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:05.290891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1933e-8b3a-4300-bf83-4ed6e11a644f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:05.292385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1933e-8b3a-4300-bf83-4ed6e11a644f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:05.319179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-0cf1933e-8b3a-4300-bf83-4ed6e11a644f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:05.319179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:05.319179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:05.319179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:05.319179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:05.319179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:05.319179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:05.319179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:05.319179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:05.319179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:05.319179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:05.319179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:05.319179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:05.319179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:05.319179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:05.320112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:05.321029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:05.321029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:05.321029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:05.321029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:05.321029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 393/785] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:05.325970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d6b91-cbf9-4750-a292-48ed7d4a5802 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:05.380789 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:05.434349 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d6b91-cbf9-4750-a292-48ed7d4a5802 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:05.488838 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09430200-998a-4a45-94cf-da6294d78c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:05.489556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09430200-998a-4a45-94cf-da6294d78c82 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:05.489847 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09430200-998a-4a45-94cf-da6294d78c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:05.490128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09430200-998a-4a45-94cf-da6294d78c82 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:05.490870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09430200-998a-4a45-94cf-da6294d78c82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:05.491201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09430200-998a-4a45-94cf-da6294d78c82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:05.492598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09430200-998a-4a45-94cf-da6294d78c82 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:05.511782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 393/786] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:05.522033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1933e-8b3a-4300-bf83-4ed6e11a644f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:05.616869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c0770-7921-4d5c-b58e-7fe908a3053e None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:05.617089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c0770-7921-4d5c-b58e-7fe908a3053e None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:05.617369 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c0770-7921-4d5c-b58e-7fe908a3053e None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:05.619019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 394/787] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:05.624237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b184996-30c7-4bc9-893d-82b3006e05fb None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:05.624555 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b184996-30c7-4bc9-893d-82b3006e05fb None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:05.624901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b184996-30c7-4bc9-893d-82b3006e05fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:05.645383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:05.648233 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1933e-8b3a-4300-bf83-4ed6e11a644f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:05.661249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-6b184996-30c7-4bc9-893d-82b3006e05fb None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:05.662678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6b184996-30c7-4bc9-893d-82b3006e05fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:05.700225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c0f49-ce8d-4588-938e-aa79e4881410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:05.701128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c0f49-ce8d-4588-938e-aa79e4881410 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:05.701420 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c0f49-ce8d-4588-938e-aa79e4881410 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:05.701701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c0f49-ce8d-4588-938e-aa79e4881410 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:05.715509 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c0f49-ce8d-4588-938e-aa79e4881410 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:05.717139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c0f49-ce8d-4588-938e-aa79e4881410 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-518c0f49-ce8d-4588-938e-aa79e4881410 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:26:05.737193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:05.738186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:05.739143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:05.739143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:05.739143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:26:05.739143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:26:05.739143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:26:05.739143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:26:05.739143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:26:05.739143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:26:05.739143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 17:26:05.739143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:05.739143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 394/788] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jun 1 17:26:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:05.747020 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c0f49-ce8d-4588-938e-aa79e4881410 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:05.813886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 395/789] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:05.855808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b184996-30c7-4bc9-893d-82b3006e05fb None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:05.871009 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c0f49-ce8d-4588-938e-aa79e4881410 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:05.922338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0821b3-338a-44e5-a244-99bd096fd1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:05.923234 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0821b3-338a-44e5-a244-99bd096fd1ef None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:05.923517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0821b3-338a-44e5-a244-99bd096fd1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:05.923790 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0821b3-338a-44e5-a244-99bd096fd1ef None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:05.924633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0821b3-338a-44e5-a244-99bd096fd1ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:05.924960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0821b3-338a-44e5-a244-99bd096fd1ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:05.926393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0821b3-338a-44e5-a244-99bd096fd1ef None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:05.940043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:05.965482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 395/790] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Jun 1 17:26:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:05.971352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0821b3-338a-44e5-a244-99bd096fd1ef None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:05.986663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:06.056128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b184996-30c7-4bc9-893d-82b3006e05fb None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:06.103523 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0821b3-338a-44e5-a244-99bd096fd1ef None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:06.104082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59531a6-e2cb-42ab-a92c-387c4f55261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:06.105183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59531a6-e2cb-42ab-a92c-387c4f55261b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:06.105476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59531a6-e2cb-42ab-a92c-387c4f55261b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:06.106646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59531a6-e2cb-42ab-a92c-387c4f55261b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:06.121570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59531a6-e2cb-42ab-a92c-387c4f55261b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-f59531a6-e2cb-42ab-a92c-387c4f55261b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:26:06.133022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:06.134932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:06.135978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:06.135978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:06.135978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:06.135978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:06.135978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:26:06.135978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:26:06.135978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:26:06.135978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:26:06.135978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:26:06.135978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:26:06.135978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:26:06.135978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:06.135978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 396/791] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:26:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:06.136823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88417319-000f-4766-a6e8-80b607406099 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:06.136823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88417319-000f-4766-a6e8-80b607406099 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:06.136823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88417319-000f-4766-a6e8-80b607406099 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:06.140235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 397/792] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:06.143602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88417319-000f-4766-a6e8-80b607406099 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:06.147960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e4c46-2dcc-4b86-bed6-af583d767d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:06.148915 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e4c46-2dcc-4b86-bed6-af583d767d5f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:06.149332 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e4c46-2dcc-4b86-bed6-af583d767d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:06.149712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e4c46-2dcc-4b86-bed6-af583d767d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:06.161621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e4c46-2dcc-4b86-bed6-af583d767d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:06.163929 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e4c46-2dcc-4b86-bed6-af583d767d5f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:06.187452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-9a6e4c46-2dcc-4b86-bed6-af583d767d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:06.187452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:06.187452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:06.187452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:06.187452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:06.187452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:06.187452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:06.187452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:06.187452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:06.187452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:06.187452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:06.187452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:06.187452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:06.187452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:06.187452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:06.188583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:06.189745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:06.189745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:06.189745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:06.189745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:06.191752 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 396/793] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:06.193471 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbd32f-9aa7-4890-9aa0-b32d8307ee62 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:06.193860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbd32f-9aa7-4890-9aa0-b32d8307ee62 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:06.194550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbd32f-9aa7-4890-9aa0-b32d8307ee62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:06.215170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b7dbd32f-9aa7-4890-9aa0-b32d8307ee62 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:06.216491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b7dbd32f-9aa7-4890-9aa0-b32d8307ee62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:06.259239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:06.261780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88417319-000f-4766-a6e8-80b607406099 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:06.297107 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:06.300050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9cb83-9183-49c8-807d-d530d8d5a68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:06.301113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9cb83-9183-49c8-807d-d530d8d5a68b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:06.301757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9cb83-9183-49c8-807d-d530d8d5a68b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:06.302506 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9cb83-9183-49c8-807d-d530d8d5a68b None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:06.303687 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9cb83-9183-49c8-807d-d530d8d5a68b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:06.304157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9cb83-9183-49c8-807d-d530d8d5a68b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:06.306462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9cb83-9183-49c8-807d-d530d8d5a68b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:06.311702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 397/794] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:06.312699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbd32f-9aa7-4890-9aa0-b32d8307ee62 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:06.321031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 398/795] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:26:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:06.323822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9cb83-9183-49c8-807d-d530d8d5a68b None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:06.438336 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbd32f-9aa7-4890-9aa0-b32d8307ee62 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:06.468102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9cb83-9183-49c8-807d-d530d8d5a68b None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:06.491381 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad1b90-3088-4082-8fc1-a965dcf465ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:06.492481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad1b90-3088-4082-8fc1-a965dcf465ca None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:06.493033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad1b90-3088-4082-8fc1-a965dcf465ca None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:06.493567 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad1b90-3088-4082-8fc1-a965dcf465ca None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:06.495202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad1b90-3088-4082-8fc1-a965dcf465ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:06.496074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad1b90-3088-4082-8fc1-a965dcf465ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:06.497991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad1b90-3088-4082-8fc1-a965dcf465ca None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:06.511956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ddcb9-3cbd-4b51-b234-dc51c8709565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:06.512784 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ddcb9-3cbd-4b51-b234-dc51c8709565 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:06.513112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ddcb9-3cbd-4b51-b234-dc51c8709565 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:06.513392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ddcb9-3cbd-4b51-b234-dc51c8709565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:06.520836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 398/796] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:06.522739 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad1b90-3088-4082-8fc1-a965dcf465ca None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:06.525971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ddcb9-3cbd-4b51-b234-dc51c8709565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:06.527443 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ddcb9-3cbd-4b51-b234-dc51c8709565 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:06.549021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-af4ddcb9-3cbd-4b51-b234-dc51c8709565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:06.549021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:06.549021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:06.549021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:06.549021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:06.549021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:06.549021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:06.549021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:06.549021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:06.549021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:06.549021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:06.549021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:06.549021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:06.549021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:06.549021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:06.549974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:06.550886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:06.550886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:06.550886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:06.550886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:06.550886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 399/797] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:06.551165 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ddcb9-3cbd-4b51-b234-dc51c8709565 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:06.573528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:06.604262 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:06.664972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad1b90-3088-4082-8fc1-a965dcf465ca None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:06.680929 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ddcb9-3cbd-4b51-b234-dc51c8709565 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:06.703155 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ddf6b-0731-45f0-9171-0d1f6a1a9610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:06.704154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ddf6b-0731-45f0-9171-0d1f6a1a9610 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:06.704522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ddf6b-0731-45f0-9171-0d1f6a1a9610 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:06.704908 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ddf6b-0731-45f0-9171-0d1f6a1a9610 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:06.717023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ddf6b-0731-45f0-9171-0d1f6a1a9610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:26:06.724348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c368aa-2085-436b-b4ff-295a6bc91131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:06.725357 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c368aa-2085-436b-b4ff-295a6bc91131 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:06.725819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c368aa-2085-436b-b4ff-295a6bc91131 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:06.726250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c368aa-2085-436b-b4ff-295a6bc91131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-ae5ddf6b-0731-45f0-9171-0d1f6a1a9610 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:26:06.726606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:06.727678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:06.728729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:06.728729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:06.728729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:06.728729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:06.728729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:26:06.728729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:26:06.728729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:26:06.728729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:26:06.728729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:26:06.728729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:26:06.728729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:26:06.728729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:06.731169 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 399/798] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:26:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:06.732290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ddf6b-0731-45f0-9171-0d1f6a1a9610 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:06.739680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c368aa-2085-436b-b4ff-295a6bc91131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:06.743580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c368aa-2085-436b-b4ff-295a6bc91131 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:06.761755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-56c368aa-2085-436b-b4ff-295a6bc91131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:06.761755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:06.761755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:06.761755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:06.761755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:06.761755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:06.761755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:06.761755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:06.761755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:06.761755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:06.761755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:06.761755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:06.761755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:26:06.761755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:26:06.761755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:06.762940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:06.764027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:26:06.764027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:26:06.764027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:26:06.764027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:26:06.764027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:26:06.764027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:26:06.764027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:06.764027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:06.767909 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 400/799] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:06.769265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c368aa-2085-436b-b4ff-295a6bc91131 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:06.854841 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:06.865070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ddf6b-0731-45f0-9171-0d1f6a1a9610 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:06.878241 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:06.886389 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c368aa-2085-436b-b4ff-295a6bc91131 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:06.902241 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8ed0d-d787-4ce0-9fe0-2f74dfccadfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:06.902959 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8ed0d-d787-4ce0-9fe0-2f74dfccadfe None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:06.903210 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8ed0d-d787-4ce0-9fe0-2f74dfccadfe None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:06.903602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8ed0d-d787-4ce0-9fe0-2f74dfccadfe None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:06.904335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8ed0d-d787-4ce0-9fe0-2f74dfccadfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:06.904650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8ed0d-d787-4ce0-9fe0-2f74dfccadfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:06.906958 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8ed0d-d787-4ce0-9fe0-2f74dfccadfe None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:06.920094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 400/800] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:06.920990 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8ed0d-d787-4ce0-9fe0-2f74dfccadfe None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:06.928366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95c94f-a97f-42a9-ac54-74c79b177b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:06.929367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95c94f-a97f-42a9-ac54-74c79b177b9a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:06.929658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95c94f-a97f-42a9-ac54-74c79b177b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:06.929942 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95c94f-a97f-42a9-ac54-74c79b177b9a None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:06.930698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95c94f-a97f-42a9-ac54-74c79b177b9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:06.931017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95c94f-a97f-42a9-ac54-74c79b177b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:06.932426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95c94f-a97f-42a9-ac54-74c79b177b9a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:06.942666 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 401/801] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:26:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:06.944270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79ce80-39e5-409e-8557-a32820c25f0a None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:06.944802 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79ce80-39e5-409e-8557-a32820c25f0a None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:06.945327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79ce80-39e5-409e-8557-a32820c25f0a None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:06.946796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 402/802] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:06.947707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79ce80-39e5-409e-8557-a32820c25f0a None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:07.046405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8ed0d-d787-4ce0-9fe0-2f74dfccadfe None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:07.056572 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79ce80-39e5-409e-8557-a32820c25f0a None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:07.084599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b50684-d03e-43ff-b9f5-17b158c30636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:07.085788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b50684-d03e-43ff-b9f5-17b158c30636 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:07.086080 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b50684-d03e-43ff-b9f5-17b158c30636 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:07.086362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b50684-d03e-43ff-b9f5-17b158c30636 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:07.087151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b50684-d03e-43ff-b9f5-17b158c30636 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:07.087468 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b50684-d03e-43ff-b9f5-17b158c30636 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:07.088902 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b50684-d03e-43ff-b9f5-17b158c30636 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:07.090639 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4abaf-0dfb-4175-801b-2afe3a433072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:07.091436 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4abaf-0dfb-4175-801b-2afe3a433072 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:07.091720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4abaf-0dfb-4175-801b-2afe3a433072 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:07.091995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4abaf-0dfb-4175-801b-2afe3a433072 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:07.094919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:07.100090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4abaf-0dfb-4175-801b-2afe3a433072 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:07.101839 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4abaf-0dfb-4175-801b-2afe3a433072 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:07.103084 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 401/803] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:26:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:07.104174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b50684-d03e-43ff-b9f5-17b158c30636 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-30d4abaf-0dfb-4175-801b-2afe3a433072 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:26:07.120763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:07.121950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:07.123080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:07.123080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:07.123080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:26:07.123080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:26:07.123080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:26:07.123080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:26:07.123080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:26:07.123080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:26:07.123080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:26:07.123080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:07.127107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 403/804] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jun 1 17:26:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:07.128430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01465901-9cf9-4140-bdae-559d6ad05fc7 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:07.128724 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01465901-9cf9-4140-bdae-559d6ad05fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:07.129034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01465901-9cf9-4140-bdae-559d6ad05fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:07.145152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:07.147239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-01465901-9cf9-4140-bdae-559d6ad05fc7 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:07.148443 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-01465901-9cf9-4140-bdae-559d6ad05fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:07.219644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b50684-d03e-43ff-b9f5-17b158c30636 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:07.232988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 404/805] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:07.232988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01465901-9cf9-4140-bdae-559d6ad05fc7 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:07.255751 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d10de-b128-45c9-a942-67d0ac16f1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:07.256579 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d10de-b128-45c9-a942-67d0ac16f1dc None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:07.256860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d10de-b128-45c9-a942-67d0ac16f1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:07.257161 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d10de-b128-45c9-a942-67d0ac16f1dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:07.268729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d10de-b128-45c9-a942-67d0ac16f1dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:07.270286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d10de-b128-45c9-a942-67d0ac16f1dc None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:07.288365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-553d10de-b128-45c9-a942-67d0ac16f1dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:07.288365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:07.288365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:07.288365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:07.288365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:07.288365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:07.288365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:07.288365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:07.288365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:07.288365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:07.288365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:07.288365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:07.288365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:07.288365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:07.288365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:07.289429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:07.290335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:07.290335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:07.290335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:07.290335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:07.290335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 402/806] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:07.290615 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d10de-b128-45c9-a942-67d0ac16f1dc None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:07.359987 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01465901-9cf9-4140-bdae-559d6ad05fc7 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:07.385668 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:07.388035 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:07.397336 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d2c59-f20c-44a3-80a4-64f97b283c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:07.398246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d2c59-f20c-44a3-80a4-64f97b283c0f None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:07.398529 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d2c59-f20c-44a3-80a4-64f97b283c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:07.398903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d2c59-f20c-44a3-80a4-64f97b283c0f None admin] PATH_INFO: `/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/253f9ffb48dd4eaab87aae5316fb5394/roles/97f88c6182044737a47af038d94a74b8` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:07.402934 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d10de-b128-45c9-a942-67d0ac16f1dc None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:07.413249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d2c59-f20c-44a3-80a4-64f97b283c0f None admin] RBAC: Authorizing `identity:create_grant(project_id=68bf9a1e88a64a02ba53d0bedb76072a, user_id=253f9ffb48dd4eaab87aae5316fb5394, role_id=97f88c6182044737a47af038d94a74b8)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:07.414849 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d2c59-f20c-44a3-80a4-64f97b283c0f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:07.437986 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b6121-114f-4aac-a19f-be20c8afc5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:07.438668 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b6121-114f-4aac-a19f-be20c8afc5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:07.438955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b6121-114f-4aac-a19f-be20c8afc5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:07.439340 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b6121-114f-4aac-a19f-be20c8afc5a3 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:07.440246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b6121-114f-4aac-a19f-be20c8afc5a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:07.440561 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b6121-114f-4aac-a19f-be20c8afc5a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:07.442053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b6121-114f-4aac-a19f-be20c8afc5a3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:07.464282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 403/807] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jun 1 17:26:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:07.465149 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b6121-114f-4aac-a19f-be20c8afc5a3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:07.487804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 405/808] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:26:07 2022] PUT /identity/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/253f9ffb48dd4eaab87aae5316fb5394/roles/97f88c6182044737a47af038d94a74b8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:26:07.498015 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d2c59-f20c-44a3-80a4-64f97b283c0f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:07.612547 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b6121-114f-4aac-a19f-be20c8afc5a3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:07.617133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d2c59-f20c-44a3-80a4-64f97b283c0f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:07.656183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28e623-9e59-4e65-812a-02fc8cb58ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:07.657211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28e623-9e59-4e65-812a-02fc8cb58ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:07.657609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28e623-9e59-4e65-812a-02fc8cb58ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:07.657994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28e623-9e59-4e65-812a-02fc8cb58ec7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:07.658776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28e623-9e59-4e65-812a-02fc8cb58ec7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:07.660309 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28e623-9e59-4e65-812a-02fc8cb58ec7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:07.660460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf55cc-5c05-43f7-9f67-f3d07bf5e58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:07.661168 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf55cc-5c05-43f7-9f67-f3d07bf5e58b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:07.661454 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf55cc-5c05-43f7-9f67-f3d07bf5e58b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:07.661729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf55cc-5c05-43f7-9f67-f3d07bf5e58b None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:07.662469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf55cc-5c05-43f7-9f67-f3d07bf5e58b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:07.662779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf55cc-5c05-43f7-9f67-f3d07bf5e58b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:07.664168 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf55cc-5c05-43f7-9f67-f3d07bf5e58b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-6a28e623-9e59-4e65-812a-02fc8cb58ec7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:07.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:07.681983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:07.682823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 404/809] 10.222.0.33 () {56 vars in 1129 bytes} [Wed Jun 1 17:26:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:07.683667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28e623-9e59-4e65-812a-02fc8cb58ec7 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:07.683735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 406/810] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:07.683735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4acbd5-2fb0-46e0-8cb4-daba8a68fa50 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:07.683735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4acbd5-2fb0-46e0-8cb4-daba8a68fa50 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:07.683735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4acbd5-2fb0-46e0-8cb4-daba8a68fa50 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:07.685023 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 407/811] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:07.685653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4acbd5-2fb0-46e0-8cb4-daba8a68fa50 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:07.692673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:07.730908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:07.793666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28e623-9e59-4e65-812a-02fc8cb58ec7 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:07.805635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4acbd5-2fb0-46e0-8cb4-daba8a68fa50 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:07.831840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf11b41-71c2-4080-90fe-80d7d6b9d407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:07.832522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf11b41-71c2-4080-90fe-80d7d6b9d407 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:07.832797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf11b41-71c2-4080-90fe-80d7d6b9d407 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:07.833102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf11b41-71c2-4080-90fe-80d7d6b9d407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:07.842257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31630bd4-e32b-4c58-b85e-dcd96145acbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:07.843109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31630bd4-e32b-4c58-b85e-dcd96145acbb None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:07.843458 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31630bd4-e32b-4c58-b85e-dcd96145acbb None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:07.843803 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31630bd4-e32b-4c58-b85e-dcd96145acbb None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:07.844572 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31630bd4-e32b-4c58-b85e-dcd96145acbb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:07.844959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31630bd4-e32b-4c58-b85e-dcd96145acbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:07.846413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31630bd4-e32b-4c58-b85e-dcd96145acbb None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:07.856057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 408/812] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Jun 1 17:26:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:07.856057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31630bd4-e32b-4c58-b85e-dcd96145acbb None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:07.909478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf11b41-71c2-4080-90fe-80d7d6b9d407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:07.910963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf11b41-71c2-4080-90fe-80d7d6b9d407 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:07.918779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:07.971781 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:07.975113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31630bd4-e32b-4c58-b85e-dcd96145acbb None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:08.013299 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05405430-a245-472d-8e51-23858388c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:08.014327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05405430-a245-472d-8e51-23858388c1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:08.015206 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05405430-a245-472d-8e51-23858388c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:08.015592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05405430-a245-472d-8e51-23858388c1d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:08.028647 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05405430-a245-472d-8e51-23858388c1d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:08.028813 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 405/813] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:26:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:26:08.028813 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db4898-eb4c-408b-ab6b-6b71c17798b0 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:08.029045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05405430-a245-472d-8e51-23858388c1d3 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:08.029135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db4898-eb4c-408b-ab6b-6b71c17798b0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:08.029135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db4898-eb4c-408b-ab6b-6b71c17798b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-05405430-a245-472d-8e51-23858388c1d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:26:08.043884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:08.045097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:08.047028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:08.047028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:08.047028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:26:08.047028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:26:08.047028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:26:08.047028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:26:08.047028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:26:08.047028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:26:08.047028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 01 17:26:08.047028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:08.047685 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-71db4898-eb4c-408b-ab6b-6b71c17798b0 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:08.048554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-71db4898-eb4c-408b-ab6b-6b71c17798b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:08.052362 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 409/814] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:26:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:08.053089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05405430-a245-472d-8e51-23858388c1d3 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:08.122317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 406/815] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:08.123571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db4898-eb4c-408b-ab6b-6b71c17798b0 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:08.160632 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:08.181237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05405430-a245-472d-8e51-23858388c1d3 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:08.218845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a21b4-4948-44b9-bcac-f6c110384168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:08.219676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a21b4-4948-44b9-bcac-f6c110384168 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:08.220279 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a21b4-4948-44b9-bcac-f6c110384168 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:08.220569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a21b4-4948-44b9-bcac-f6c110384168 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:08.221463 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a21b4-4948-44b9-bcac-f6c110384168 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:08.221771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a21b4-4948-44b9-bcac-f6c110384168 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:08.223155 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a21b4-4948-44b9-bcac-f6c110384168 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:08.227287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db4898-eb4c-408b-ab6b-6b71c17798b0 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:08.228219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 410/816] 10.222.0.33 () {56 vars in 1124 bytes} [Wed Jun 1 17:26:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:08.229039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a21b4-4948-44b9-bcac-f6c110384168 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:08.255568 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:08.284193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56d90d-b635-43df-9406-6fc5cb682d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:08.285025 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56d90d-b635-43df-9406-6fc5cb682d23 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:08.285311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56d90d-b635-43df-9406-6fc5cb682d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:08.285586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56d90d-b635-43df-9406-6fc5cb682d23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:08.299868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56d90d-b635-43df-9406-6fc5cb682d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:08.301397 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56d90d-b635-43df-9406-6fc5cb682d23 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:08.326159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-cb56d90d-b635-43df-9406-6fc5cb682d23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:08.326159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:08.326159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:08.326159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:08.326159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:08.326159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:08.326159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:08.326159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:08.326159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:08.326159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:08.326159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:08.326159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:08.326159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:08.326159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:08.326159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:08.327590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:08.328671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:08.328671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:08.328671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:08.328671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:08.328671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 407/817] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:08.332967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56d90d-b635-43df-9406-6fc5cb682d23 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:08.348362 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a21b4-4948-44b9-bcac-f6c110384168 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:08.386614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fda283-f635-4789-a311-4925dc6ac8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:08.387281 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fda283-f635-4789-a311-4925dc6ac8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:08.387561 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fda283-f635-4789-a311-4925dc6ac8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:08.387834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fda283-f635-4789-a311-4925dc6ac8d5 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:08.388666 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fda283-f635-4789-a311-4925dc6ac8d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:08.388992 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fda283-f635-4789-a311-4925dc6ac8d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:08.390611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fda283-f635-4789-a311-4925dc6ac8d5 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:08.408774 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 411/818] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Jun 1 17:26:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:08.409391 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fda283-f635-4789-a311-4925dc6ac8d5 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:08.430985 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:08.443247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56d90d-b635-43df-9406-6fc5cb682d23 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:08.488032 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe33df-a915-4637-85fd-57bdfd5ee1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:08.488827 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe33df-a915-4637-85fd-57bdfd5ee1ac None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:08.489153 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe33df-a915-4637-85fd-57bdfd5ee1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:08.489431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe33df-a915-4637-85fd-57bdfd5ee1ac None admin] PATH_INFO: `/v3/services/network` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:08.490082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe33df-a915-4637-85fd-57bdfd5ee1ac None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:08.491450 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe33df-a915-4637-85fd-57bdfd5ee1ac None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:08.494198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-66fe33df-a915-4637-85fd-57bdfd5ee1ac None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:08.503850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:08.510846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:08.511762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:08.511762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:08.511762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:08.511762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:08.511762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:08.511762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:08.511762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:08.511762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:08.511762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:08.511762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:08.511762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:08.511762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:08.511762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 01 17:26:08.511762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:08.511762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 408/819] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:08 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:08.512562 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe33df-a915-4637-85fd-57bdfd5ee1ac None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:08.519398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fda283-f635-4789-a311-4925dc6ac8d5 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:08.554324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ccd0f-833c-4180-8617-0c93299a1d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:08.555271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ccd0f-833c-4180-8617-0c93299a1d93 None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:08.555556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ccd0f-833c-4180-8617-0c93299a1d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:08.555839 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ccd0f-833c-4180-8617-0c93299a1d93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:08.556575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ccd0f-833c-4180-8617-0c93299a1d93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:08.557975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ccd0f-833c-4180-8617-0c93299a1d93 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:08.612783 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe33df-a915-4637-85fd-57bdfd5ee1ac None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:08.646180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2191fc-2a6b-4805-8e4b-8477bdb337fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:08.646855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2191fc-2a6b-4805-8e4b-8477bdb337fc None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:08.647254 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2191fc-2a6b-4805-8e4b-8477bdb337fc None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:08.647527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2191fc-2a6b-4805-8e4b-8477bdb337fc None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:08.648263 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2191fc-2a6b-4805-8e4b-8477bdb337fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:08.648563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2191fc-2a6b-4805-8e4b-8477bdb337fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:08.649968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2191fc-2a6b-4805-8e4b-8477bdb337fc None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:08.663311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 409/820] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:08.664157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2191fc-2a6b-4805-8e4b-8477bdb337fc None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:08.681964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:08.720461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 412/821] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jun 1 17:26:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:26:08.721648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ccd0f-833c-4180-8617-0c93299a1d93 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:08.793298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2191fc-2a6b-4805-8e4b-8477bdb337fc None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:08.842983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186427bb-a88c-4bc3-8f3d-4a27cb201c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:08.844098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186427bb-a88c-4bc3-8f3d-4a27cb201c49 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:08.844479 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186427bb-a88c-4bc3-8f3d-4a27cb201c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:08.845009 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186427bb-a88c-4bc3-8f3d-4a27cb201c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:08.859743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186427bb-a88c-4bc3-8f3d-4a27cb201c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:08.869088 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186427bb-a88c-4bc3-8f3d-4a27cb201c49 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:08.872066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ccd0f-833c-4180-8617-0c93299a1d93 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:08.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-186427bb-a88c-4bc3-8f3d-4a27cb201c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:08.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:08.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:08.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:08.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:08.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:08.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:08.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:08.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:08.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:08.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:08.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:08.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:08.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:08.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:08.882371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:08.883257 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:08.883257 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:08.883257 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:08.883257 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:08.885816 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 410/822] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:08.886967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186427bb-a88c-4bc3-8f3d-4a27cb201c49 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:08.919253 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9051c2e-7248-491c-809c-751952b372b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:08.919999 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9051c2e-7248-491c-809c-751952b372b1 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:08.920288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9051c2e-7248-491c-809c-751952b372b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:08.921210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9051c2e-7248-491c-809c-751952b372b1 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:08.922236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9051c2e-7248-491c-809c-751952b372b1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:08.922547 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9051c2e-7248-491c-809c-751952b372b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:08.924696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9051c2e-7248-491c-809c-751952b372b1 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:08.941403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 413/823] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jun 1 17:26:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:08.942513 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9051c2e-7248-491c-809c-751952b372b1 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:08.946337 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:08.967217 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:09.044963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186427bb-a88c-4bc3-8f3d-4a27cb201c49 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:09.078912 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9051c2e-7248-491c-809c-751952b372b1 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:09.091903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c65dea-85b2-472a-aa48-87c355776dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:09.093158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c65dea-85b2-472a-aa48-87c355776dcf None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:09.093445 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c65dea-85b2-472a-aa48-87c355776dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:09.094214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c65dea-85b2-472a-aa48-87c355776dcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:09.103716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c65dea-85b2-472a-aa48-87c355776dcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:09.105851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c65dea-85b2-472a-aa48-87c355776dcf None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:09.115560 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02ccf3-52ea-45b8-8ade-d4f612a8c883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:09.116354 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02ccf3-52ea-45b8-8ade-d4f612a8c883 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:09.116733 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02ccf3-52ea-45b8-8ade-d4f612a8c883 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:09.117137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02ccf3-52ea-45b8-8ade-d4f612a8c883 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:09.117968 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02ccf3-52ea-45b8-8ade-d4f612a8c883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:09.118370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02ccf3-52ea-45b8-8ade-d4f612a8c883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:09.119861 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02ccf3-52ea-45b8-8ade-d4f612a8c883 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:09.123488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-47c65dea-85b2-472a-aa48-87c355776dcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:09.123488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:09.123488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:09.123488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:09.123488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:09.123488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:09.123488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:09.123488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:09.123488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:09.123488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:09.123488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:09.123488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:09.123488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:26:09.123488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:26:09.123488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:09.125510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:09.127181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:26:09.127181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:26:09.127181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:26:09.127181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:26:09.127181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:26:09.127181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:26:09.127181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:09.127181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:09.127181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 411/824] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:09.127181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c65dea-85b2-472a-aa48-87c355776dcf None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:09.144766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 414/825] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:09.145749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02ccf3-52ea-45b8-8ade-d4f612a8c883 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:09.219915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:09.252549 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c65dea-85b2-472a-aa48-87c355776dcf None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:09.274003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:09.277652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02ccf3-52ea-45b8-8ade-d4f612a8c883 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:09.289560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6e665-3995-45ea-be9c-ba5774d74cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:09.290237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6e665-3995-45ea-be9c-ba5774d74cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:09.290519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6e665-3995-45ea-be9c-ba5774d74cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:09.291073 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6e665-3995-45ea-be9c-ba5774d74cd8 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:09.291520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6e665-3995-45ea-be9c-ba5774d74cd8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:09.291825 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6e665-3995-45ea-be9c-ba5774d74cd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:09.293233 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6e665-3995-45ea-be9c-ba5774d74cd8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:09.304112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 412/826] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jun 1 17:26:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:09.304112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6e665-3995-45ea-be9c-ba5774d74cd8 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:09.332706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e14da-1840-4fb1-87fe-3bee98fdbc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:09.333969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e14da-1840-4fb1-87fe-3bee98fdbc92 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:09.334429 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e14da-1840-4fb1-87fe-3bee98fdbc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:09.335125 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e14da-1840-4fb1-87fe-3bee98fdbc92 None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:09.336116 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e14da-1840-4fb1-87fe-3bee98fdbc92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:09.337136 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e14da-1840-4fb1-87fe-3bee98fdbc92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:09.339482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e14da-1840-4fb1-87fe-3bee98fdbc92 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:09.354348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 415/827] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:09.355256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e14da-1840-4fb1-87fe-3bee98fdbc92 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:09.423388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6e665-3995-45ea-be9c-ba5774d74cd8 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:09.467961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9beab-fd4a-4691-a122-8f03ad372606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:09.470042 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9beab-fd4a-4691-a122-8f03ad372606 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:09.470838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9beab-fd4a-4691-a122-8f03ad372606 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:09.471824 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9beab-fd4a-4691-a122-8f03ad372606 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:09.485881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9beab-fd4a-4691-a122-8f03ad372606 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:09.486057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e14da-1840-4fb1-87fe-3bee98fdbc92 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:09.488091 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9beab-fd4a-4691-a122-8f03ad372606 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:09.508789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-82d9beab-fd4a-4691-a122-8f03ad372606 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:09.508789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:09.508789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:09.508789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:09.508789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:09.508789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:09.508789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:09.508789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:09.508789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:09.508789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:09.508789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:09.508789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:09.508789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:26:09.508789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:26:09.508789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:09.509807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:09.510715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:26:09.510715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:26:09.510715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:26:09.510715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:26:09.510715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:26:09.510715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:26:09.510715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:09.510715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:09.513741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 413/828] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:09.515320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9beab-fd4a-4691-a122-8f03ad372606 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:09.515851 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:09.534635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe344832-54fc-478d-a048-637a27967d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:09.539480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe344832-54fc-478d-a048-637a27967d5a None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:09.539480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe344832-54fc-478d-a048-637a27967d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:09.539480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe344832-54fc-478d-a048-637a27967d5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:09.539480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe344832-54fc-478d-a048-637a27967d5a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:09.539480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe344832-54fc-478d-a048-637a27967d5a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:09.566768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:09.621791 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9beab-fd4a-4691-a122-8f03ad372606 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:09.670757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 416/829] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jun 1 17:26:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:26:09.673060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe344832-54fc-478d-a048-637a27967d5a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:09.685703 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53370672-6771-4c6e-8fb5-6a8d5fe486e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:09.686873 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53370672-6771-4c6e-8fb5-6a8d5fe486e3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:09.687415 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53370672-6771-4c6e-8fb5-6a8d5fe486e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:09.687933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53370672-6771-4c6e-8fb5-6a8d5fe486e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:09.689784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53370672-6771-4c6e-8fb5-6a8d5fe486e3 None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=5d5a5ba6aecd46e79dc7199589384a4f) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:09.690359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53370672-6771-4c6e-8fb5-6a8d5fe486e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:09.692302 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53370672-6771-4c6e-8fb5-6a8d5fe486e3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:09.702121 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 414/830] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:26:09 2022] GET /identity/v3/role_assignments?user.id=5d5a5ba6aecd46e79dc7199589384a4f&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:09.828884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f192ae-3e3a-462f-a19a-f08af6844770 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:09.829255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f192ae-3e3a-462f-a19a-f08af6844770 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:09.829497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f192ae-3e3a-462f-a19a-f08af6844770 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:09.831242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 415/831] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:26:09.837191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8265-83da-491f-bfec-37d0e9e17bcc None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:09.837511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8265-83da-491f-bfec-37d0e9e17bcc None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:09.837770 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8265-83da-491f-bfec-37d0e9e17bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:09.854461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe344832-54fc-478d-a048-637a27967d5a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:09.882150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-eb8a8265-83da-491f-bfec-37d0e9e17bcc None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:09.883415 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-eb8a8265-83da-491f-bfec-37d0e9e17bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:09.900186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980c8e5-086b-4b5f-b8e1-de412932b10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:09.900891 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980c8e5-086b-4b5f-b8e1-de412932b10b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:09.901205 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980c8e5-086b-4b5f-b8e1-de412932b10b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:09.901487 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980c8e5-086b-4b5f-b8e1-de412932b10b None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:09.902319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980c8e5-086b-4b5f-b8e1-de412932b10b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:09.902634 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980c8e5-086b-4b5f-b8e1-de412932b10b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:09.904158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980c8e5-086b-4b5f-b8e1-de412932b10b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:09.934842 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 417/832] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:09.943223 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980c8e5-086b-4b5f-b8e1-de412932b10b None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:10.002992 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 416/833] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:10.010658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:10.029678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a8265-83da-491f-bfec-37d0e9e17bcc None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:10.075703 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:10.103780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980c8e5-086b-4b5f-b8e1-de412932b10b None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:10.149913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd24d4-4578-4728-b992-52b2c7c2a81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:10.151092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd24d4-4578-4728-b992-52b2c7c2a81f None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:10.151378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd24d4-4578-4728-b992-52b2c7c2a81f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:10.151657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd24d4-4578-4728-b992-52b2c7c2a81f None admin] PATH_INFO: `/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/3f43a4bb5a18445b8836f4613cd5e14b/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:10.154463 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd24d4-4578-4728-b992-52b2c7c2a81f None admin] RBAC: Authorizing `identity:create_grant(project_id=68bf9a1e88a64a02ba53d0bedb76072a, user_id=3f43a4bb5a18445b8836f4613cd5e14b, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:10.156731 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd24d4-4578-4728-b992-52b2c7c2a81f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:10.163870 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a8265-83da-491f-bfec-37d0e9e17bcc None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:10.209190 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57fd46-762f-4cda-bacb-2d88654472d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:10.210001 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57fd46-762f-4cda-bacb-2d88654472d9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:10.210287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57fd46-762f-4cda-bacb-2d88654472d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:10.210623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57fd46-762f-4cda-bacb-2d88654472d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:10.222728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57fd46-762f-4cda-bacb-2d88654472d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-cb57fd46-762f-4cda-bacb-2d88654472d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:26:10.231359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:10.232392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:10.236405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:10.236405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:10.236405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:10.236405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:10.236405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:26:10.236405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:26:10.236405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:26:10.236405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:26:10.236405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:26:10.236405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:26:10.236405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:26:10.236405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:10.236405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 417/834] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:26:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:10.238206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57fd46-762f-4cda-bacb-2d88654472d9 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:10.240061 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 418/835] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:26:09 2022] PUT /identity/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/3f43a4bb5a18445b8836f4613cd5e14b/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:26:10.364004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:10.372184 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57fd46-762f-4cda-bacb-2d88654472d9 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:10.414989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e8a1e-7a52-4a4d-9d4a-47c4ee1dc188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:10.416017 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e8a1e-7a52-4a4d-9d4a-47c4ee1dc188 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:10.416448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e8a1e-7a52-4a4d-9d4a-47c4ee1dc188 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:10.416870 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e8a1e-7a52-4a4d-9d4a-47c4ee1dc188 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:10.417916 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e8a1e-7a52-4a4d-9d4a-47c4ee1dc188 None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:10.418375 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e8a1e-7a52-4a4d-9d4a-47c4ee1dc188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:10.419947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e8a1e-7a52-4a4d-9d4a-47c4ee1dc188 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:10.430328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 418/836] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:26:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:10.436753 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd24d4-4578-4728-b992-52b2c7c2a81f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:10.546078 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:10.549699 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd24d4-4578-4728-b992-52b2c7c2a81f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:10.586354 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873828a-4825-4452-8f98-2131b859cfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:10.587158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873828a-4825-4452-8f98-2131b859cfb0 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:10.587443 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873828a-4825-4452-8f98-2131b859cfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:10.587720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873828a-4825-4452-8f98-2131b859cfb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:10.599071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873828a-4825-4452-8f98-2131b859cfb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:10.600550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873828a-4825-4452-8f98-2131b859cfb0 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:10.619246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-0873828a-4825-4452-8f98-2131b859cfb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:10.619246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:10.619246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:10.619246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:10.619246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:10.619246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:10.619246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:10.619246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:10.619246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:10.619246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:10.619246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:10.619246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:10.619246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:10.619246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:10.619246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:10.620183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:10.621171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:10.621171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:10.621171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:10.621171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:10.621171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 419/837] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:10.627986 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e8a1e-7a52-4a4d-9d4a-47c4ee1dc188 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:10.746908 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e8a1e-7a52-4a4d-9d4a-47c4ee1dc188 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:10.784587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d90d9f-69f7-42e9-b86c-da7cafe291ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:10.785300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d90d9f-69f7-42e9-b86c-da7cafe291ec None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:10.785588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d90d9f-69f7-42e9-b86c-da7cafe291ec None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:10.785872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d90d9f-69f7-42e9-b86c-da7cafe291ec None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:10.786606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d90d9f-69f7-42e9-b86c-da7cafe291ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:10.786917 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d90d9f-69f7-42e9-b86c-da7cafe291ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:10.788292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d90d9f-69f7-42e9-b86c-da7cafe291ec None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:10.801215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 419/838] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:10.806726 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873828a-4825-4452-8f98-2131b859cfb0 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:10.913208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873828a-4825-4452-8f98-2131b859cfb0 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:10.949590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f52212-c977-4fee-84f0-df2859ac176a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:10.950780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f52212-c977-4fee-84f0-df2859ac176a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:10.951315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f52212-c977-4fee-84f0-df2859ac176a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:10.951989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f52212-c977-4fee-84f0-df2859ac176a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:10.961098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f52212-c977-4fee-84f0-df2859ac176a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:10.963005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f52212-c977-4fee-84f0-df2859ac176a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-99f52212-c977-4fee-84f0-df2859ac176a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:26:10.981489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:10.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:10.984457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:10.984457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:10.984457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:26:10.984457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:26:10.984457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:26:10.984457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:26:10.984457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:26:10.984457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:26:10.984457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 17:26:10.984457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:10.987377 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 420/839] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jun 1 17:26:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:10.993287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d90d9f-69f7-42e9-b86c-da7cafe291ec None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:11.012448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:11.112229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d90d9f-69f7-42e9-b86c-da7cafe291ec None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:11.148746 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f231f-bf9e-4ef2-b8c0-b29ff8b485da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:11.149464 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f231f-bf9e-4ef2-b8c0-b29ff8b485da None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:11.149750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f231f-bf9e-4ef2-b8c0-b29ff8b485da None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:11.150030 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f231f-bf9e-4ef2-b8c0-b29ff8b485da None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:11.150888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f231f-bf9e-4ef2-b8c0-b29ff8b485da None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:11.151203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f231f-bf9e-4ef2-b8c0-b29ff8b485da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:11.152649 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f231f-bf9e-4ef2-b8c0-b29ff8b485da None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:11.173300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 420/840] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Jun 1 17:26:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:11.178492 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f52212-c977-4fee-84f0-df2859ac176a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:11.192452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:11.284879 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f52212-c977-4fee-84f0-df2859ac176a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:11.318893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fd29b-63c1-42e7-80e5-02fe6b3debd6 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:11.319229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fd29b-63c1-42e7-80e5-02fe6b3debd6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:11.319643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fd29b-63c1-42e7-80e5-02fe6b3debd6 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:11.320931 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f922f85-baa4-402c-a2ef-19faaf7fc8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:11.321527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 421/841] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:11.321821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f922f85-baa4-402c-a2ef-19faaf7fc8ae None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:11.322205 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f922f85-baa4-402c-a2ef-19faaf7fc8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:11.322631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f922f85-baa4-402c-a2ef-19faaf7fc8ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:11.328611 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a416805-d0c2-444c-b9c0-b08352b9bab8 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:11.328900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a416805-d0c2-444c-b9c0-b08352b9bab8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:11.329213 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a416805-d0c2-444c-b9c0-b08352b9bab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:11.347292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8a416805-d0c2-444c-b9c0-b08352b9bab8 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:11.348612 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8a416805-d0c2-444c-b9c0-b08352b9bab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:11.397749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f922f85-baa4-402c-a2ef-19faaf7fc8ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:11.399216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f922f85-baa4-402c-a2ef-19faaf7fc8ae None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:11.417703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:11.434352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 422/842] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:11.457507 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a416805-d0c2-444c-b9c0-b08352b9bab8 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:11.467855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:11.549741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 421/843] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:26:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:26:11.555105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f922f85-baa4-402c-a2ef-19faaf7fc8ae None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:11.589332 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a416805-d0c2-444c-b9c0-b08352b9bab8 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:11.635701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a453f-8ec9-4394-8cfc-f58399cdb662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:11.637485 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a453f-8ec9-4394-8cfc-f58399cdb662 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:11.638009 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a453f-8ec9-4394-8cfc-f58399cdb662 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:11.638491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a453f-8ec9-4394-8cfc-f58399cdb662 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:11.639936 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a453f-8ec9-4394-8cfc-f58399cdb662 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:11.641711 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a453f-8ec9-4394-8cfc-f58399cdb662 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-053a453f-8ec9-4394-8cfc-f58399cdb662 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:11.655152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:11.656200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:11.657078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:11.657078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:11.657078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:11.657078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:11.657078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:11.657078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:11.657078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:11.657078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:11.657078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:11.657078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:11.657078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:11.657078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:11.657078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 17:26:11.657078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:11.660176 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 423/844] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:26:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:11.666047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a453f-8ec9-4394-8cfc-f58399cdb662 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:11.687393 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f922f85-baa4-402c-a2ef-19faaf7fc8ae None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:11.703262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:11.735974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f35879-38c4-430b-ba5a-cdf2d85a3649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:11.737859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f35879-38c4-430b-ba5a-cdf2d85a3649 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:11.738487 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f35879-38c4-430b-ba5a-cdf2d85a3649 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:11.739071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f35879-38c4-430b-ba5a-cdf2d85a3649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:11.749956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:11.755124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f35879-38c4-430b-ba5a-cdf2d85a3649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:11.756837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f35879-38c4-430b-ba5a-cdf2d85a3649 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:11.782824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-b0f35879-38c4-430b-ba5a-cdf2d85a3649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:11.782824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:11.782824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:11.782824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:11.782824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:11.782824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:11.782824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:11.782824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:11.782824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:11.782824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:11.782824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:11.782824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:11.782824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:11.782824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:11.782824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:11.783808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:11.784751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:11.784751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:11.784751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:11.784751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:11.790790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 422/845] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:11.792697 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f35879-38c4-430b-ba5a-cdf2d85a3649 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:11.797724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a453f-8ec9-4394-8cfc-f58399cdb662 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:11.841320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5793f4d-ed9a-4846-aaaf-07791ab5ada6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:11.841994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5793f4d-ed9a-4846-aaaf-07791ab5ada6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:11.842811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5793f4d-ed9a-4846-aaaf-07791ab5ada6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:11.843101 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5793f4d-ed9a-4846-aaaf-07791ab5ada6 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:11.843814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5793f4d-ed9a-4846-aaaf-07791ab5ada6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:11.844122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5793f4d-ed9a-4846-aaaf-07791ab5ada6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:11.845548 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5793f4d-ed9a-4846-aaaf-07791ab5ada6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:11.857050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 424/846] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:26:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:11.858037 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5793f4d-ed9a-4846-aaaf-07791ab5ada6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:11.934855 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f35879-38c4-430b-ba5a-cdf2d85a3649 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:11.971709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5793f4d-ed9a-4846-aaaf-07791ab5ada6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:11.982273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ef6ef-7d3f-4a8f-bf4a-b70fbfd93fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:11.984137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ef6ef-7d3f-4a8f-bf4a-b70fbfd93fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:11.984959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ef6ef-7d3f-4a8f-bf4a-b70fbfd93fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:11.985463 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ef6ef-7d3f-4a8f-bf4a-b70fbfd93fb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:11.986545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ef6ef-7d3f-4a8f-bf4a-b70fbfd93fb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:11.987416 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ef6ef-7d3f-4a8f-bf4a-b70fbfd93fb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:11.989325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ef6ef-7d3f-4a8f-bf4a-b70fbfd93fb6 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:12.003546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:12.010898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 423/847] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:12.012103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ef6ef-7d3f-4a8f-bf4a-b70fbfd93fb6 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:12.012368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4feb-607b-499c-8c2a-5b28fd14c6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:12.030493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4feb-607b-499c-8c2a-5b28fd14c6eb None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:12.030493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4feb-607b-499c-8c2a-5b28fd14c6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:12.030493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4feb-607b-499c-8c2a-5b28fd14c6eb None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:12.030493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b4feb-607b-499c-8c2a-5b28fd14c6eb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:12.030493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b4feb-607b-499c-8c2a-5b28fd14c6eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:12.030493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b4feb-607b-499c-8c2a-5b28fd14c6eb None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:12.031089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 425/848] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:26:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:12.042489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:12.131166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ef6ef-7d3f-4a8f-bf4a-b70fbfd93fb6 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:12.170198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fe03c-2050-4414-8f1b-21f7045e6207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:12.171799 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fe03c-2050-4414-8f1b-21f7045e6207 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:12.172300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fe03c-2050-4414-8f1b-21f7045e6207 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:12.172812 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fe03c-2050-4414-8f1b-21f7045e6207 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:12.181016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fe03c-2050-4414-8f1b-21f7045e6207 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:12.182855 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fe03c-2050-4414-8f1b-21f7045e6207 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:12.199598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-8b0fe03c-2050-4414-8f1b-21f7045e6207 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:12.199598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:12.199598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:12.199598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:12.199598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:12.199598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:12.199598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:12.199598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:12.199598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:12.199598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:12.199598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:12.199598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:12.199598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:26:12.199598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:26:12.199598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:12.200606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:12.201605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:26:12.201605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:26:12.201605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:26:12.201605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:26:12.201605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:26:12.201605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:26:12.201605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:12.201605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:12.209338 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 424/849] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:12.211357 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4feb-607b-499c-8c2a-5b28fd14c6eb None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:12.268873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79ed26-9fa8-41e5-97e6-2ac8307df84d None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:12.269343 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79ed26-9fa8-41e5-97e6-2ac8307df84d None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:12.269725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79ed26-9fa8-41e5-97e6-2ac8307df84d None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:12.271194 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 425/850] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:12.276508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070c65f-cba1-45b8-b9d5-649a64600269 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:12.276960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070c65f-cba1-45b8-b9d5-649a64600269 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:12.277364 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070c65f-cba1-45b8-b9d5-649a64600269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:12.301808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-0070c65f-cba1-45b8-b9d5-649a64600269 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:12.303908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0070c65f-cba1-45b8-b9d5-649a64600269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:12.341433 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4feb-607b-499c-8c2a-5b28fd14c6eb None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:12.382928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 426/851] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:12.385447 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35ee9f-7b7c-4003-bc4a-3f73c8eaeff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:12.386280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35ee9f-7b7c-4003-bc4a-3f73c8eaeff6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:12.386714 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35ee9f-7b7c-4003-bc4a-3f73c8eaeff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:12.387136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35ee9f-7b7c-4003-bc4a-3f73c8eaeff6 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:12.388096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35ee9f-7b7c-4003-bc4a-3f73c8eaeff6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:12.388561 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35ee9f-7b7c-4003-bc4a-3f73c8eaeff6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:12.390449 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35ee9f-7b7c-4003-bc4a-3f73c8eaeff6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:12.403520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 426/852] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:12.412420 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070c65f-cba1-45b8-b9d5-649a64600269 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:12.412597 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35ee9f-7b7c-4003-bc4a-3f73c8eaeff6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:12.426012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:12.485328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:12.528659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35ee9f-7b7c-4003-bc4a-3f73c8eaeff6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:12.532859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070c65f-cba1-45b8-b9d5-649a64600269 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:12.568648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62a61e-55e2-4309-933d-5a82c9857e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:12.569600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62a61e-55e2-4309-933d-5a82c9857e19 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:12.569890 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62a61e-55e2-4309-933d-5a82c9857e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:12.570582 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62a61e-55e2-4309-933d-5a82c9857e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:12.571725 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62a61e-55e2-4309-933d-5a82c9857e19 None admin] RBAC: Adding query filter params (role.id=97f88c6182044737a47af038d94a74b8, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=253f9ffb48dd4eaab87aae5316fb5394) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:12.572050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62a61e-55e2-4309-933d-5a82c9857e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:12.573545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62a61e-55e2-4309-933d-5a82c9857e19 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:12.575727 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd2fbb-5bb4-40d9-ac62-035acac5e7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:12.577504 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd2fbb-5bb4-40d9-ac62-035acac5e7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:12.578010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd2fbb-5bb4-40d9-ac62-035acac5e7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:12.578397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd2fbb-5bb4-40d9-ac62-035acac5e7f5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:12.579170 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd2fbb-5bb4-40d9-ac62-035acac5e7f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:12.580654 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd2fbb-5bb4-40d9-ac62-035acac5e7f5 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:12.580913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 427/853] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:26:12 2022] GET /identity/v3/role_assignments?user.id=253f9ffb48dd4eaab87aae5316fb5394&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=97f88c6182044737a47af038d94a74b8 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-f7dd2fbb-5bb4-40d9-ac62-035acac5e7f5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:12.605193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:12.606417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:12.607427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 427/854] 10.222.0.33 () {56 vars in 1132 bytes} [Wed Jun 1 17:26:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:12.613085 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62a61e-55e2-4309-933d-5a82c9857e19 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:12.664384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d989c4e-be3e-4e16-b749-f921ad615934 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:12.665080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d989c4e-be3e-4e16-b749-f921ad615934 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:12.665569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d989c4e-be3e-4e16-b749-f921ad615934 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:12.668704 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 428/855] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:12.674166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b4c9f-67db-4e54-9243-013d73db78a1 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:12.674771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b4c9f-67db-4e54-9243-013d73db78a1 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:12.675277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b4c9f-67db-4e54-9243-013d73db78a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:12.693717 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-8f7b4c9f-67db-4e54-9243-013d73db78a1 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:12.695510 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8f7b4c9f-67db-4e54-9243-013d73db78a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:12.734643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62a61e-55e2-4309-933d-5a82c9857e19 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:12.766335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:12.784655 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 429/856] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:12.790615 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82320b8-7f91-43d8-9523-6794ffee7b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:12.791421 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82320b8-7f91-43d8-9523-6794ffee7b99 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:12.791782 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82320b8-7f91-43d8-9523-6794ffee7b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:12.792130 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82320b8-7f91-43d8-9523-6794ffee7b99 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:12.792962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82320b8-7f91-43d8-9523-6794ffee7b99 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:12.793290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82320b8-7f91-43d8-9523-6794ffee7b99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:12.794681 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82320b8-7f91-43d8-9523-6794ffee7b99 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:12.801339 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 428/857] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jun 1 17:26:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:12.807181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b4c9f-67db-4e54-9243-013d73db78a1 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:12.809097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82320b8-7f91-43d8-9523-6794ffee7b99 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:12.824586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:12.951716 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b4c9f-67db-4e54-9243-013d73db78a1 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:12.952220 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82320b8-7f91-43d8-9523-6794ffee7b99 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:12.998993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf702a-1205-4680-8845-2f1868354365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:13.000402 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf702a-1205-4680-8845-2f1868354365 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:13.001417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf702a-1205-4680-8845-2f1868354365 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:13.001704 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf702a-1205-4680-8845-2f1868354365 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:13.002264 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dc552-8408-4d5e-8a59-8574a8a042ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:13.002507 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf702a-1205-4680-8845-2f1868354365 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:13.002741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf702a-1205-4680-8845-2f1868354365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:13.003762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dc552-8408-4d5e-8a59-8574a8a042ef None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:13.004132 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf702a-1205-4680-8845-2f1868354365 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:13.004494 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dc552-8408-4d5e-8a59-8574a8a042ef None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:13.005031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dc552-8408-4d5e-8a59-8574a8a042ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:13.009440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 430/858] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jun 1 17:26:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:13.019042 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dc552-8408-4d5e-8a59-8574a8a042ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-7f0dc552-8408-4d5e-8a59-8574a8a042ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:26:13.031747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:13.032767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:13.033641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:13.033641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:13.033641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:13.033641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:13.033641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:26:13.033641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:26:13.033641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:26:13.033641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:26:13.033641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:26:13.033641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:26:13.033641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:26:13.033641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:13.033641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 429/859] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:26:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:13.039274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf702a-1205-4680-8845-2f1868354365 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:13.121887 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:13.155764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf702a-1205-4680-8845-2f1868354365 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:13.194059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad62865-fe72-4e36-bfd9-45c27faa1bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:13.194813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad62865-fe72-4e36-bfd9-45c27faa1bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:13.195104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad62865-fe72-4e36-bfd9-45c27faa1bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:13.195380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad62865-fe72-4e36-bfd9-45c27faa1bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:13.196135 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad62865-fe72-4e36-bfd9-45c27faa1bf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:13.196442 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad62865-fe72-4e36-bfd9-45c27faa1bf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:13.197858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad62865-fe72-4e36-bfd9-45c27faa1bf2 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:13.212313 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 431/860] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:26:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:13.213791 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dc552-8408-4d5e-8a59-8574a8a042ef None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:13.272606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:13.330403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dc552-8408-4d5e-8a59-8574a8a042ef None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:13.365870 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377897ef-8944-4e97-bd35-dcf5b0490ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:13.366673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377897ef-8944-4e97-bd35-dcf5b0490ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:13.366961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377897ef-8944-4e97-bd35-dcf5b0490ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:13.367249 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377897ef-8944-4e97-bd35-dcf5b0490ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:13.379329 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377897ef-8944-4e97-bd35-dcf5b0490ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:13.380546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377897ef-8944-4e97-bd35-dcf5b0490ce4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:13.398784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-377897ef-8944-4e97-bd35-dcf5b0490ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:13.398784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:13.398784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:13.398784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:13.398784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:13.398784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:13.398784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:13.398784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:13.398784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:13.398784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:13.398784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:13.398784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:13.398784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:13.398784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:13.398784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:13.399724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:13.400824 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:13.400824 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:13.400824 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:13.400824 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:13.400824 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 430/861] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:13.407374 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad62865-fe72-4e36-bfd9-45c27faa1bf2 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:13.511564 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad62865-fe72-4e36-bfd9-45c27faa1bf2 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:13.541645 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:13.546570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab0e1e-ccba-40b5-9be1-0db57d399bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:13.547243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab0e1e-ccba-40b5-9be1-0db57d399bdc None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:13.547797 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab0e1e-ccba-40b5-9be1-0db57d399bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:13.548069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab0e1e-ccba-40b5-9be1-0db57d399bdc None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:13.548783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab0e1e-ccba-40b5-9be1-0db57d399bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:13.549148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab0e1e-ccba-40b5-9be1-0db57d399bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:13.550573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab0e1e-ccba-40b5-9be1-0db57d399bdc None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:13.562973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 432/862] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:13.568552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377897ef-8944-4e97-bd35-dcf5b0490ce4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:13.671701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:13.677336 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377897ef-8944-4e97-bd35-dcf5b0490ce4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:13.713121 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b7b5c-9a73-4b22-aa7c-b9ed9de07234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:13.713928 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b7b5c-9a73-4b22-aa7c-b9ed9de07234 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:13.714216 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b7b5c-9a73-4b22-aa7c-b9ed9de07234 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:13.714499 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b7b5c-9a73-4b22-aa7c-b9ed9de07234 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:13.722662 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b7b5c-9a73-4b22-aa7c-b9ed9de07234 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:13.724122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b7b5c-9a73-4b22-aa7c-b9ed9de07234 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-fd9b7b5c-9a73-4b22-aa7c-b9ed9de07234 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:26:13.739227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:13.740644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:13.741910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:13.741910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:13.741910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:26:13.741910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:26:13.741910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:26:13.741910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:26:13.741910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:26:13.741910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:26:13.741910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 01 17:26:13.741910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:13.741910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 431/863] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:26:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:13.749002 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab0e1e-ccba-40b5-9be1-0db57d399bdc None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:13.855242 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab0e1e-ccba-40b5-9be1-0db57d399bdc None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:13.894426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695f50a-a583-4f4b-9016-89c4b93cfba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:13.895117 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695f50a-a583-4f4b-9016-89c4b93cfba5 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:13.895403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695f50a-a583-4f4b-9016-89c4b93cfba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:13.895681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695f50a-a583-4f4b-9016-89c4b93cfba5 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:13.896525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695f50a-a583-4f4b-9016-89c4b93cfba5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:13.896838 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695f50a-a583-4f4b-9016-89c4b93cfba5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:13.898313 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695f50a-a583-4f4b-9016-89c4b93cfba5 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:13.917247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 433/864] 10.222.0.33 () {56 vars in 1135 bytes} [Wed Jun 1 17:26:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:13.926132 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b7b5c-9a73-4b22-aa7c-b9ed9de07234 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:14.037542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b7b5c-9a73-4b22-aa7c-b9ed9de07234 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:14.074304 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6788523-4cf1-44c0-b713-7dcecc2acaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:14.074963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788523-4cf1-44c0-b713-7dcecc2acaae None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:14.075251 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788523-4cf1-44c0-b713-7dcecc2acaae None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:14.075532 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788523-4cf1-44c0-b713-7dcecc2acaae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:14.105380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:14.153787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6788523-4cf1-44c0-b713-7dcecc2acaae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:14.155306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6788523-4cf1-44c0-b713-7dcecc2acaae None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:14.258639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 432/865] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:26:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:26:14.266049 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695f50a-a583-4f4b-9016-89c4b93cfba5 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:14.324922 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:14.384886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695f50a-a583-4f4b-9016-89c4b93cfba5 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:14.423845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b923ec-a365-4ad6-9437-67477c405f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:14.425053 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b923ec-a365-4ad6-9437-67477c405f27 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:14.425657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b923ec-a365-4ad6-9437-67477c405f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:14.426209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b923ec-a365-4ad6-9437-67477c405f27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:14.439755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c3e75-a68b-46ff-8e50-dc38328fe02f None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:14.440134 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c3e75-a68b-46ff-8e50-dc38328fe02f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:14.440401 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c3e75-a68b-46ff-8e50-dc38328fe02f None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:14.441993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 433/866] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:14.442840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b923ec-a365-4ad6-9437-67477c405f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:14.444308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b923ec-a365-4ad6-9437-67477c405f27 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:14.446978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e428f3-68c2-4de6-8dfe-eec48ee842e2 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:14.447271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e428f3-68c2-4de6-8dfe-eec48ee842e2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:14.447550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e428f3-68c2-4de6-8dfe-eec48ee842e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:14.470090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-e4b923ec-a365-4ad6-9437-67477c405f27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:14.470090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:14.470090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:14.470090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:14.470090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:14.470090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:14.470090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:14.470090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:14.470090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:14.470090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:14.470090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:14.470090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:14.470090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:14.470090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:14.470090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:14.471156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:14.472754 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:14.472754 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:14.472754 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:14.472754 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:14.472754 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 434/867] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:14.478670 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d1e428f3-68c2-4de6-8dfe-eec48ee842e2 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:14.478823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d1e428f3-68c2-4de6-8dfe-eec48ee842e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:14.483300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b923ec-a365-4ad6-9437-67477c405f27 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:14.537385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:14.561271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 434/868] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:14.575294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e428f3-68c2-4de6-8dfe-eec48ee842e2 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:14.605439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b923ec-a365-4ad6-9437-67477c405f27 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:14.607215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:14.643594 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dab2c1-8ab7-4971-bc5d-022facc82970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:14.644182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab2c1-8ab7-4971-bc5d-022facc82970 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:14.644467 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab2c1-8ab7-4971-bc5d-022facc82970 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:14.644789 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab2c1-8ab7-4971-bc5d-022facc82970 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:14.645556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dab2c1-8ab7-4971-bc5d-022facc82970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:14.645913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dab2c1-8ab7-4971-bc5d-022facc82970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:14.647239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dab2c1-8ab7-4971-bc5d-022facc82970 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:14.664275 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 435/869] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:14.665190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dab2c1-8ab7-4971-bc5d-022facc82970 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:14.711029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e428f3-68c2-4de6-8dfe-eec48ee842e2 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:14.760374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215576b7-bf84-4e60-ba5e-155a49ddd96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:14.762172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215576b7-bf84-4e60-ba5e-155a49ddd96e None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:14.763145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215576b7-bf84-4e60-ba5e-155a49ddd96e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:14.763645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215576b7-bf84-4e60-ba5e-155a49ddd96e None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:14.765409 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215576b7-bf84-4e60-ba5e-155a49ddd96e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:14.767610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215576b7-bf84-4e60-ba5e-155a49ddd96e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:14.782270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dab2c1-8ab7-4971-bc5d-022facc82970 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:14.818115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affebb2-4d48-4993-9d26-72626e73d72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:14.818830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affebb2-4d48-4993-9d26-72626e73d72d None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:14.819113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affebb2-4d48-4993-9d26-72626e73d72d None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:14.819387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affebb2-4d48-4993-9d26-72626e73d72d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:14.826274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affebb2-4d48-4993-9d26-72626e73d72d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:14.827750 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affebb2-4d48-4993-9d26-72626e73d72d None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:14.842182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-0affebb2-4d48-4993-9d26-72626e73d72d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:14.842182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:14.842182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:14.842182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:14.842182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:14.842182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:14.842182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:14.842182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:14.842182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:14.842182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:14.842182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:14.842182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:14.842182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:26:14.842182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:26:14.842182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:14.843189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:14.844163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:26:14.844163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:26:14.844163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:26:14.844163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:26:14.844163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:26:14.844163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:26:14.844163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:14.844163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:14.848365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 436/870] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:14.849003 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affebb2-4d48-4993-9d26-72626e73d72d None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:14.856048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 435/871] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jun 1 17:26:14 2022] POST /identity/v3/services => generated 251 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:26:14.881539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:14.973786 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affebb2-4d48-4993-9d26-72626e73d72d None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:15.023147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8848cc-3bb1-469d-a472-911d23cebf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:15.024263 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8848cc-3bb1-469d-a472-911d23cebf49 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:15.024757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8848cc-3bb1-469d-a472-911d23cebf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:15.025261 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8848cc-3bb1-469d-a472-911d23cebf49 None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:15.026280 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8848cc-3bb1-469d-a472-911d23cebf49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:15.026848 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8848cc-3bb1-469d-a472-911d23cebf49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:15.028593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8848cc-3bb1-469d-a472-911d23cebf49 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:15.045650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676e029-7f69-4634-9ed0-70b8c214032d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:15.045650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676e029-7f69-4634-9ed0-70b8c214032d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:15.045650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676e029-7f69-4634-9ed0-70b8c214032d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:15.046166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 437/872] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:26:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:15.046292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 436/873] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:26:15.051332 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676e029-7f69-4634-9ed0-70b8c214032d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:15.051524 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cff526-5f28-4cf8-8fd9-a2db76a71b71 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:15.051800 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cff526-5f28-4cf8-8fd9-a2db76a71b71 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:15.052054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cff526-5f28-4cf8-8fd9-a2db76a71b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:15.073972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-c4cff526-5f28-4cf8-8fd9-a2db76a71b71 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:15.075677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-c4cff526-5f28-4cf8-8fd9-a2db76a71b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:15.115057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:15.164714 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 438/874] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:15.180310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676e029-7f69-4634-9ed0-70b8c214032d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:15.189911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cff526-5f28-4cf8-8fd9-a2db76a71b71 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:15.201595 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:15.226910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627c3d8-3d6f-4e19-b4e4-a9734734073e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:15.227779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c3d8-3d6f-4e19-b4e4-a9734734073e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:15.228068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c3d8-3d6f-4e19-b4e4-a9734734073e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:15.228750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c3d8-3d6f-4e19-b4e4-a9734734073e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:15.229990 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627c3d8-3d6f-4e19-b4e4-a9734734073e None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=3f43a4bb5a18445b8836f4613cd5e14b) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:15.230320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627c3d8-3d6f-4e19-b4e4-a9734734073e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:15.232039 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627c3d8-3d6f-4e19-b4e4-a9734734073e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:15.241182 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 437/875] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:26:15 2022] GET /identity/v3/role_assignments?user.id=3f43a4bb5a18445b8836f4613cd5e14b&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:15.315487 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cff526-5f28-4cf8-8fd9-a2db76a71b71 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:15.356371 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec565b-1c83-4e3a-be2f-7bef79557325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:15.357160 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec565b-1c83-4e3a-be2f-7bef79557325 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:15.357445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec565b-1c83-4e3a-be2f-7bef79557325 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:15.357802 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec565b-1c83-4e3a-be2f-7bef79557325 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:15.370610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec565b-1c83-4e3a-be2f-7bef79557325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-ebec565b-1c83-4e3a-be2f-7bef79557325 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:26:15.379756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:15.380751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:15.382037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:15.382037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:15.382037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:15.382037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:15.382037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:26:15.382037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:26:15.382037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:26:15.382037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:26:15.382037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:26:15.382037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:26:15.382037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 17:26:15.382037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:15.382037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 439/876] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Jun 1 17:26:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:15.387047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627c3d8-3d6f-4e19-b4e4-a9734734073e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:15.502739 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627c3d8-3d6f-4e19-b4e4-a9734734073e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:15.515597 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:15.543902 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d895cc5-00e0-47b1-94b0-7ac69ebe7379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:15.544591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d895cc5-00e0-47b1-94b0-7ac69ebe7379 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:15.544879 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d895cc5-00e0-47b1-94b0-7ac69ebe7379 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:15.545727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d895cc5-00e0-47b1-94b0-7ac69ebe7379 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:15.546583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d895cc5-00e0-47b1-94b0-7ac69ebe7379 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:15.546898 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d895cc5-00e0-47b1-94b0-7ac69ebe7379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:15.548287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d895cc5-00e0-47b1-94b0-7ac69ebe7379 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:15.558581 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 438/877] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Jun 1 17:26:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:15.564499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec565b-1c83-4e3a-be2f-7bef79557325 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:15.583241 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39966e6f-7040-46af-ace7-d29b95273d41 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:15.583582 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39966e6f-7040-46af-ace7-d29b95273d41 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:15.583807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39966e6f-7040-46af-ace7-d29b95273d41 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:15.585625 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 439/878] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:15.593961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59ae3f-c09b-4c9a-9e47-54d2e5d236b8 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:15.594247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59ae3f-c09b-4c9a-9e47-54d2e5d236b8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:15.594535 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59ae3f-c09b-4c9a-9e47-54d2e5d236b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:15.611924 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ec59ae3f-c09b-4c9a-9e47-54d2e5d236b8 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:15.613159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ec59ae3f-c09b-4c9a-9e47-54d2e5d236b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:15.644410 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:15.681514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec565b-1c83-4e3a-be2f-7bef79557325 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:15.697023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 440/879] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:15.719969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59ae3f-c09b-4c9a-9e47-54d2e5d236b8 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:15.727661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a18906-4f38-4ee0-a723-00cfe19731e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:15.729734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a18906-4f38-4ee0-a723-00cfe19731e9 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:15.729734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a18906-4f38-4ee0-a723-00cfe19731e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:15.730167 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a18906-4f38-4ee0-a723-00cfe19731e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:15.745828 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a18906-4f38-4ee0-a723-00cfe19731e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:15.748354 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a18906-4f38-4ee0-a723-00cfe19731e9 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:15.773554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-75a18906-4f38-4ee0-a723-00cfe19731e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:15.773554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:15.773554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:15.773554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:15.773554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:15.773554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:15.773554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:15.773554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:15.773554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:15.773554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:15.773554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:15.773554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:15.773554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:15.773554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:15.773554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:15.774511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:15.775469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:15.775469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:15.775469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:15.775469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:15.782320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 440/880] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:15.783077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a18906-4f38-4ee0-a723-00cfe19731e9 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:15.843217 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59ae3f-c09b-4c9a-9e47-54d2e5d236b8 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:15.845673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:15.885003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51000937-969b-4170-ad13-c5e711c84ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:15.886111 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51000937-969b-4170-ad13-c5e711c84ae9 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:15.886600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51000937-969b-4170-ad13-c5e711c84ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:15.887100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51000937-969b-4170-ad13-c5e711c84ae9 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:15.888133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51000937-969b-4170-ad13-c5e711c84ae9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:15.890777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51000937-969b-4170-ad13-c5e711c84ae9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:15.891486 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a18906-4f38-4ee0-a723-00cfe19731e9 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:15.913610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:15.928913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c52ad-fd5c-4a43-8856-6dbb7c21c8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:15.929616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c52ad-fd5c-4a43-8856-6dbb7c21c8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:15.929902 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c52ad-fd5c-4a43-8856-6dbb7c21c8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:15.930180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c52ad-fd5c-4a43-8856-6dbb7c21c8c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:15.930963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c52ad-fd5c-4a43-8856-6dbb7c21c8c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:15.931277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c52ad-fd5c-4a43-8856-6dbb7c21c8c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:15.932647 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c52ad-fd5c-4a43-8856-6dbb7c21c8c2 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:15.944908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 441/881] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:15.950354 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c52ad-fd5c-4a43-8856-6dbb7c21c8c2 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:15.989136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 441/882] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jun 1 17:26:15 2022] POST /identity/v3/services => generated 269 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:26:16.069880 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c52ad-fd5c-4a43-8856-6dbb7c21c8c2 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:16.116675 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0abbf-8934-4788-858a-7d99c1aa5923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:16.117906 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0abbf-8934-4788-858a-7d99c1aa5923 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:16.118395 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0abbf-8934-4788-858a-7d99c1aa5923 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:16.118871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0abbf-8934-4788-858a-7d99c1aa5923 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:16.127560 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0abbf-8934-4788-858a-7d99c1aa5923 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:16.129537 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0abbf-8934-4788-858a-7d99c1aa5923 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-a0c0abbf-8934-4788-858a-7d99c1aa5923 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:26:16.146829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:16.147837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:16.148809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:16.148809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:16.148809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:26:16.148809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:26:16.148809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:26:16.148809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:26:16.148809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:26:16.148809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:26:16.148809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 17:26:16.148809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:16.151805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 442/883] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jun 1 17:26:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:16.158662 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51000937-969b-4170-ad13-c5e711c84ae9 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:16.270214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51000937-969b-4170-ad13-c5e711c84ae9 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:16.305727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b956392-e14f-403f-a425-bf262399e5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:16.306421 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956392-e14f-403f-a425-bf262399e5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:16.306709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956392-e14f-403f-a425-bf262399e5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:16.306993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b956392-e14f-403f-a425-bf262399e5b6 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:16.307849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b956392-e14f-403f-a425-bf262399e5b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:16.308164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b956392-e14f-403f-a425-bf262399e5b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:16.309640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b956392-e14f-403f-a425-bf262399e5b6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:16.328586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 442/884] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Jun 1 17:26:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:16.334122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0abbf-8934-4788-858a-7d99c1aa5923 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:16.370021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:16.438509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0abbf-8934-4788-858a-7d99c1aa5923 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:16.473817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35987e72-a1e0-4e79-8986-f4a257e098c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:16.474813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35987e72-a1e0-4e79-8986-f4a257e098c2 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:16.475293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35987e72-a1e0-4e79-8986-f4a257e098c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:16.476112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35987e72-a1e0-4e79-8986-f4a257e098c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:16.552650 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35987e72-a1e0-4e79-8986-f4a257e098c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:16.554296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35987e72-a1e0-4e79-8986-f4a257e098c2 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:16.590943 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:16.662176 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 443/885] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:26:16 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:26:16.667546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b956392-e14f-403f-a425-bf262399e5b6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:16.694117 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:16.775813 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b956392-e14f-403f-a425-bf262399e5b6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:16.811631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd1ab6-434f-41a8-829e-78d634b63548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:16.812433 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd1ab6-434f-41a8-829e-78d634b63548 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:16.812719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd1ab6-434f-41a8-829e-78d634b63548 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:16.813019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd1ab6-434f-41a8-829e-78d634b63548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:16.823322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd1ab6-434f-41a8-829e-78d634b63548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:16.824788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd1ab6-434f-41a8-829e-78d634b63548 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:16.843867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-41cd1ab6-434f-41a8-829e-78d634b63548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:16.843867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:16.843867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:16.843867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:16.843867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:16.843867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:16.843867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:16.843867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:16.843867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:16.843867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:16.843867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:16.843867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:16.843867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:16.843867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:16.843867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:16.845261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:16.846967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:16.846967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:16.846967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:16.846967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:16.846967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 443/886] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:16.851285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35987e72-a1e0-4e79-8986-f4a257e098c2 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:16.960843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35987e72-a1e0-4e79-8986-f4a257e098c2 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:17.001781 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99698fdc-33a2-49b2-a0a4-08cf16c53e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:17.002459 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99698fdc-33a2-49b2-a0a4-08cf16c53e2f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:17.002747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99698fdc-33a2-49b2-a0a4-08cf16c53e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:17.003026 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99698fdc-33a2-49b2-a0a4-08cf16c53e2f None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:17.003751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99698fdc-33a2-49b2-a0a4-08cf16c53e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:17.004059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99698fdc-33a2-49b2-a0a4-08cf16c53e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:17.005471 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99698fdc-33a2-49b2-a0a4-08cf16c53e2f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:17.007982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:17.019434 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 444/887] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:17.025178 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd1ab6-434f-41a8-829e-78d634b63548 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:17.099559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:17.141239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd1ab6-434f-41a8-829e-78d634b63548 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:17.178022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf48179-4680-4248-809f-5af38c9f0b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:17.178821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf48179-4680-4248-809f-5af38c9f0b8c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:17.179100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf48179-4680-4248-809f-5af38c9f0b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:17.179382 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf48179-4680-4248-809f-5af38c9f0b8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:17.187141 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf48179-4680-4248-809f-5af38c9f0b8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:17.188590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf48179-4680-4248-809f-5af38c9f0b8c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:17.202587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-abf48179-4680-4248-809f-5af38c9f0b8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:17.202587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:17.202587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:17.202587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:17.202587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:17.202587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:17.202587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:17.202587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:17.202587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:17.202587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:17.202587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:17.202587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:17.202587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:26:17.202587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:26:17.202587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:17.204676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:17.206893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:26:17.206893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:26:17.206893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:26:17.206893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:26:17.206893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:26:17.206893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:26:17.206893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:17.206893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:17.206893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 444/888] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:17.213019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99698fdc-33a2-49b2-a0a4-08cf16c53e2f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:17.304486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f842ce2-f0b4-4e4a-8ccb-f72f3932b4e4 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:17.304877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f842ce2-f0b4-4e4a-8ccb-f72f3932b4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:17.305201 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f842ce2-f0b4-4e4a-8ccb-f72f3932b4e4 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:17.306815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 445/889] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:26:17.312714 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2e018-df46-45eb-8925-d908bbf6bb79 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:17.313036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2e018-df46-45eb-8925-d908bbf6bb79 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:17.313315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2e018-df46-45eb-8925-d908bbf6bb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:17.320554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99698fdc-33a2-49b2-a0a4-08cf16c53e2f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:17.331770 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6ba2e018-df46-45eb-8925-d908bbf6bb79 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:17.333178 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6ba2e018-df46-45eb-8925-d908bbf6bb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:17.367520 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb021-017a-49cc-a457-72a6dcb31c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:17.368523 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb021-017a-49cc-a457-72a6dcb31c75 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:17.368805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb021-017a-49cc-a457-72a6dcb31c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:17.369556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb021-017a-49cc-a457-72a6dcb31c75 None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:17.370671 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeb021-017a-49cc-a457-72a6dcb31c75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:17.370986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeb021-017a-49cc-a457-72a6dcb31c75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:17.374079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeb021-017a-49cc-a457-72a6dcb31c75 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:17.388265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 445/890] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:17.394739 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb021-017a-49cc-a457-72a6dcb31c75 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:17.419068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 446/891] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:17.447311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2e018-df46-45eb-8925-d908bbf6bb79 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:17.465029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:17.516748 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb021-017a-49cc-a457-72a6dcb31c75 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:17.523855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:17.563377 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccd90c-c7ed-4504-8316-6112f2fe2e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:17.564044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccd90c-c7ed-4504-8316-6112f2fe2e24 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:17.564339 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccd90c-c7ed-4504-8316-6112f2fe2e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:17.564859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccd90c-c7ed-4504-8316-6112f2fe2e24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:17.565739 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ccd90c-c7ed-4504-8316-6112f2fe2e24 None admin] RBAC: Adding query filter params (role.id=1d49fbf041c949b2a9b2d7f173d4228c, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=253f9ffb48dd4eaab87aae5316fb5394) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:17.566053 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ccd90c-c7ed-4504-8316-6112f2fe2e24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:17.568435 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ccd90c-c7ed-4504-8316-6112f2fe2e24 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:17.570432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2e018-df46-45eb-8925-d908bbf6bb79 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:17.576974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 446/892] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:26:17 2022] GET /identity/v3/role_assignments?user.id=253f9ffb48dd4eaab87aae5316fb5394&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=1d49fbf041c949b2a9b2d7f173d4228c => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:17.626675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88b9ae-76a7-48b9-bb44-6a5ddec2b2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:17.627510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88b9ae-76a7-48b9-bb44-6a5ddec2b2db None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:17.627798 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88b9ae-76a7-48b9-bb44-6a5ddec2b2db None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:17.628079 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88b9ae-76a7-48b9-bb44-6a5ddec2b2db None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:17.628750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88b9ae-76a7-48b9-bb44-6a5ddec2b2db None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:17.630301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88b9ae-76a7-48b9-bb44-6a5ddec2b2db None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-0a88b9ae-76a7-48b9-bb44-6a5ddec2b2db None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:17.643624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:17.644672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:17.645528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:17.645528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:17.645528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:17.645528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:17.645528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:17.645528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:17.645528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:17.645528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:17.645528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:17.645528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:17.645528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:17.645528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:17.645528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 17:26:17.645528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:17.645528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 447/893] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:26:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:17.652839 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccd90c-c7ed-4504-8316-6112f2fe2e24 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:17.706259 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfec217-66eb-48e0-bef3-2037dbf839fd None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:17.706598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfec217-66eb-48e0-bef3-2037dbf839fd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:17.706830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfec217-66eb-48e0-bef3-2037dbf839fd None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:17.708537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 448/894] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:17.714003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3dd00-b175-4cb1-a1ef-1c9d3acbf70c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:17.714292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3dd00-b175-4cb1-a1ef-1c9d3acbf70c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:17.714577 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3dd00-b175-4cb1-a1ef-1c9d3acbf70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:17.734149 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-14f3dd00-b175-4cb1-a1ef-1c9d3acbf70c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:17.735526 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-14f3dd00-b175-4cb1-a1ef-1c9d3acbf70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:17.768837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccd90c-c7ed-4504-8316-6112f2fe2e24 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:17.796548 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:17.806519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccc0e2-c378-4378-b728-bd5652226574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:17.807298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccc0e2-c378-4378-b728-bd5652226574 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:17.807585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccc0e2-c378-4378-b728-bd5652226574 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:17.807894 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccc0e2-c378-4378-b728-bd5652226574 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:17.808569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccc0e2-c378-4378-b728-bd5652226574 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:17.808875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccc0e2-c378-4378-b728-bd5652226574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:17.810363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccc0e2-c378-4378-b728-bd5652226574 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:17.815682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 447/895] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:26:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:17.820400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 449/896] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:17.821397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccc0e2-c378-4378-b728-bd5652226574 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:17.838197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3dd00-b175-4cb1-a1ef-1c9d3acbf70c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:17.906513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:17.945143 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccc0e2-c378-4378-b728-bd5652226574 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:17.962892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3dd00-b175-4cb1-a1ef-1c9d3acbf70c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:17.984145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3b833-7266-46e0-a2c4-af74f4061daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:17.984996 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3b833-7266-46e0-a2c4-af74f4061daf None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:17.985363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3b833-7266-46e0-a2c4-af74f4061daf None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:17.985740 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3b833-7266-46e0-a2c4-af74f4061daf None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:17.986677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3b833-7266-46e0-a2c4-af74f4061daf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:17.986992 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3b833-7266-46e0-a2c4-af74f4061daf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:17.988367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3b833-7266-46e0-a2c4-af74f4061daf None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:17.999536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 448/897] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:26:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:18.000911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3b833-7266-46e0-a2c4-af74f4061daf None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:18.001952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab8f7f-de70-42dc-928f-a1a74321e53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:18.002784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab8f7f-de70-42dc-928f-a1a74321e53e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:18.003070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab8f7f-de70-42dc-928f-a1a74321e53e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:18.003345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab8f7f-de70-42dc-928f-a1a74321e53e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:18.004124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab8f7f-de70-42dc-928f-a1a74321e53e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:18.005678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab8f7f-de70-42dc-928f-a1a74321e53e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-91ab8f7f-de70-42dc-928f-a1a74321e53e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:18.019157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:18.020224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:18.021110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:18.021110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:18.021110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:18.021110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:18.021110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:18.021110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:18.021110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:18.021110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:18.021110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:18.021110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:18.021110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:18.021110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:18.021110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 17:26:18.021110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:18.025143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 450/898] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jun 1 17:26:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:18.027198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab8f7f-de70-42dc-928f-a1a74321e53e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:18.053794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:18.109947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3b833-7266-46e0-a2c4-af74f4061daf None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:18.141954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab8f7f-de70-42dc-928f-a1a74321e53e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:18.147485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576e6ab-4e05-45be-8a51-a3a8ae021a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:18.148162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576e6ab-4e05-45be-8a51-a3a8ae021a55 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:18.148445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576e6ab-4e05-45be-8a51-a3a8ae021a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:18.148722 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576e6ab-4e05-45be-8a51-a3a8ae021a55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:18.149569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576e6ab-4e05-45be-8a51-a3a8ae021a55 None admin] RBAC: Adding query filter params (interface=public, service_id=d4c816e9b155423c82a94cb5ed6cb488, region_id=RegionOne) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:18.149881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576e6ab-4e05-45be-8a51-a3a8ae021a55 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:18.151256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576e6ab-4e05-45be-8a51-a3a8ae021a55 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:18.162592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 449/899] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jun 1 17:26:17 2022] GET /identity/v3/endpoints?service_id=d4c816e9b155423c82a94cb5ed6cb488&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:18.164084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576e6ab-4e05-45be-8a51-a3a8ae021a55 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:18.171178 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:18.193240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f447e-c285-4937-9f7c-f143d7f0d28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:18.194223 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f447e-c285-4937-9f7c-f143d7f0d28f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:18.194902 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f447e-c285-4937-9f7c-f143d7f0d28f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:18.195881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f447e-c285-4937-9f7c-f143d7f0d28f None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:18.197148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f447e-c285-4937-9f7c-f143d7f0d28f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:18.197682 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f447e-c285-4937-9f7c-f143d7f0d28f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:18.200258 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f447e-c285-4937-9f7c-f143d7f0d28f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:18.212924 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 451/900] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jun 1 17:26:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:18.214686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f447e-c285-4937-9f7c-f143d7f0d28f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:18.285238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576e6ab-4e05-45be-8a51-a3a8ae021a55 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:18.299769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:18.324051 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f471a-7f0a-4f8c-a6f9-1b889ac4a90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:18.324676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f471a-7f0a-4f8c-a6f9-1b889ac4a90e None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:18.325037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f471a-7f0a-4f8c-a6f9-1b889ac4a90e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:18.325317 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f471a-7f0a-4f8c-a6f9-1b889ac4a90e None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:18.325999 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f471a-7f0a-4f8c-a6f9-1b889ac4a90e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:18.328268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f471a-7f0a-4f8c-a6f9-1b889ac4a90e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:18.340980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 450/901] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jun 1 17:26:18 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:26:18.364814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f447e-c285-4937-9f7c-f143d7f0d28f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:18.406111 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1785e52-ac18-409b-ac12-804e94992975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:18.407229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1785e52-ac18-409b-ac12-804e94992975 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:18.407733 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1785e52-ac18-409b-ac12-804e94992975 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:18.408219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1785e52-ac18-409b-ac12-804e94992975 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:18.409219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1785e52-ac18-409b-ac12-804e94992975 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:18.409779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1785e52-ac18-409b-ac12-804e94992975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:18.411431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1785e52-ac18-409b-ac12-804e94992975 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:18.417548 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 452/902] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jun 1 17:26:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:18.515939 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ff139-b0ae-402e-b23d-a7301818fd52 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:18.516298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ff139-b0ae-402e-b23d-a7301818fd52 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:18.516499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ff139-b0ae-402e-b23d-a7301818fd52 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:18.518269 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 451/903] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:18.524189 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9590d1d-9047-41c8-92fc-b95b5b087caf None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:18.524518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9590d1d-9047-41c8-92fc-b95b5b087caf None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:18.524755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9590d1d-9047-41c8-92fc-b95b5b087caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:18.544098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c9590d1d-9047-41c8-92fc-b95b5b087caf None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:18.545888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c9590d1d-9047-41c8-92fc-b95b5b087caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:18.598746 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:18.626222 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 453/904] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:18.648902 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ff139-b0ae-402e-b23d-a7301818fd52 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:18.761430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ff139-b0ae-402e-b23d-a7301818fd52 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:18.800994 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdba3f-825d-49dc-9c97-4696be42a69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:18.801748 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdba3f-825d-49dc-9c97-4696be42a69f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:18.802090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdba3f-825d-49dc-9c97-4696be42a69f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:18.802372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdba3f-825d-49dc-9c97-4696be42a69f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:18.803074 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdba3f-825d-49dc-9c97-4696be42a69f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:18.804461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdba3f-825d-49dc-9c97-4696be42a69f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-01bdba3f-825d-49dc-9c97-4696be42a69f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:18.817821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:18.818764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:18.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 452/905] 10.222.0.33 () {56 vars in 1132 bytes} [Wed Jun 1 17:26:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:18.826978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9590d1d-9047-41c8-92fc-b95b5b087caf None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:18.931599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9590d1d-9047-41c8-92fc-b95b5b087caf None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:18.967679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ac5d8-b1ed-4076-81ab-e970e5d64dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:18.968379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ac5d8-b1ed-4076-81ab-e970e5d64dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:18.968685 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ac5d8-b1ed-4076-81ab-e970e5d64dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:18.968980 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ac5d8-b1ed-4076-81ab-e970e5d64dd6 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:18.969684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ac5d8-b1ed-4076-81ab-e970e5d64dd6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:18.969999 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ac5d8-b1ed-4076-81ab-e970e5d64dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:18.971397 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ac5d8-b1ed-4076-81ab-e970e5d64dd6 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:18.977040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 454/906] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jun 1 17:26:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:18.982737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdba3f-825d-49dc-9c97-4696be42a69f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:19.028302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:19.090409 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdba3f-825d-49dc-9c97-4696be42a69f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:19.126973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01931a8-4092-4a08-8bb6-56242e251cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:19.127657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01931a8-4092-4a08-8bb6-56242e251cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:19.127946 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01931a8-4092-4a08-8bb6-56242e251cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:19.128230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01931a8-4092-4a08-8bb6-56242e251cf9 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:19.128960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01931a8-4092-4a08-8bb6-56242e251cf9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:19.129283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01931a8-4092-4a08-8bb6-56242e251cf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:19.130665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01931a8-4092-4a08-8bb6-56242e251cf9 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:19.136348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 453/907] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jun 1 17:26:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:19.145195 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ac5d8-b1ed-4076-81ab-e970e5d64dd6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:19.192688 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:19.253096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ac5d8-b1ed-4076-81ab-e970e5d64dd6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:19.288872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc2289-ec8f-4f01-b273-275289e650c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:19.289564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc2289-ec8f-4f01-b273-275289e650c9 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:19.289857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc2289-ec8f-4f01-b273-275289e650c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:19.290144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc2289-ec8f-4f01-b273-275289e650c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:19.290940 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc2289-ec8f-4f01-b273-275289e650c9 None admin] RBAC: Adding query filter params (interface=public, service_id=dbf981d29174430a9fba473400552721, region_id=RegionOne) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:19.291255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc2289-ec8f-4f01-b273-275289e650c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:19.292634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc2289-ec8f-4f01-b273-275289e650c9 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:19.298400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 455/908] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jun 1 17:26:19 2022] GET /identity/v3/endpoints?service_id=dbf981d29174430a9fba473400552721&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:19.303827 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01931a8-4092-4a08-8bb6-56242e251cf9 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:19.412204 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01931a8-4092-4a08-8bb6-56242e251cf9 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:19.414563 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:19.447359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176a859-1d5b-4ecd-ad5c-c42e534e4903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:19.448319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176a859-1d5b-4ecd-ad5c-c42e534e4903 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:19.448809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176a859-1d5b-4ecd-ad5c-c42e534e4903 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:19.449396 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176a859-1d5b-4ecd-ad5c-c42e534e4903 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:19.450087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176a859-1d5b-4ecd-ad5c-c42e534e4903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:19.452092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176a859-1d5b-4ecd-ad5c-c42e534e4903 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:19.458587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 454/909] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jun 1 17:26:19 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:26:19.938637 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68759393-ecc7-4ef5-b654-ee1286c603f9 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:19.939156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68759393-ecc7-4ef5-b654-ee1286c603f9 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:19.939156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68759393-ecc7-4ef5-b654-ee1286c603f9 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:19.940670 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 456/910] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:19.945694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f91d7-9acd-4cd9-af62-1b970a90e152 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:19.945984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f91d7-9acd-4cd9-af62-1b970a90e152 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:19.946265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f91d7-9acd-4cd9-af62-1b970a90e152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:19.963863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-bb7f91d7-9acd-4cd9-af62-1b970a90e152 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:19.965089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-bb7f91d7-9acd-4cd9-af62-1b970a90e152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:20.036137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 455/911] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:20.058993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68759393-ecc7-4ef5-b654-ee1286c603f9 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:20.166424 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68759393-ecc7-4ef5-b654-ee1286c603f9 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:20.174699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:20.202433 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5564443-42b3-4b5b-8577-21dd81c8d887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:20.203174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5564443-42b3-4b5b-8577-21dd81c8d887 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:20.203458 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5564443-42b3-4b5b-8577-21dd81c8d887 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:20.203734 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5564443-42b3-4b5b-8577-21dd81c8d887 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:20.214341 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5564443-42b3-4b5b-8577-21dd81c8d887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-c5564443-42b3-4b5b-8577-21dd81c8d887 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:26:20.222921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:20.223877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:20.224728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:20.224728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:20.224728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:20.224728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:20.224728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:26:20.224728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:26:20.224728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:26:20.224728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:26:20.224728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:26:20.224728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:26:20.224728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 17:26:20.224728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:20.224728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 457/912] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Jun 1 17:26:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:20.230796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f91d7-9acd-4cd9-af62-1b970a90e152 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:20.335023 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:20.339040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f91d7-9acd-4cd9-af62-1b970a90e152 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:20.379539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb6e41-a5b5-4b0a-9aed-5dbe1ae3b947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:20.380249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb6e41-a5b5-4b0a-9aed-5dbe1ae3b947 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:20.380537 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb6e41-a5b5-4b0a-9aed-5dbe1ae3b947 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:20.380819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb6e41-a5b5-4b0a-9aed-5dbe1ae3b947 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:20.381623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb6e41-a5b5-4b0a-9aed-5dbe1ae3b947 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:20.381937 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb6e41-a5b5-4b0a-9aed-5dbe1ae3b947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:20.383370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb6e41-a5b5-4b0a-9aed-5dbe1ae3b947 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:20.394035 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 456/913] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Jun 1 17:26:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:20.399378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5564443-42b3-4b5b-8577-21dd81c8d887 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:20.508338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5564443-42b3-4b5b-8577-21dd81c8d887 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:20.544845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37628349-3602-49c6-8127-f3c39be9f131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:20.546311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37628349-3602-49c6-8127-f3c39be9f131 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:20.546602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37628349-3602-49c6-8127-f3c39be9f131 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:20.546884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37628349-3602-49c6-8127-f3c39be9f131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:20.559627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37628349-3602-49c6-8127-f3c39be9f131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:20.561206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37628349-3602-49c6-8127-f3c39be9f131 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:20.580455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-37628349-3602-49c6-8127-f3c39be9f131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:20.580455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:20.580455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:20.580455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:20.580455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:20.580455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:20.580455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:20.580455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:20.580455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:20.580455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:20.580455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:20.580455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:20.580455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:20.580455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:20.580455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:20.581419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:20.582311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:20.582311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:20.582311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:20.582311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:20.582311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 458/914] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:20.588376 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb6e41-a5b5-4b0a-9aed-5dbe1ae3b947 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:20.700996 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb6e41-a5b5-4b0a-9aed-5dbe1ae3b947 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:20.709145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef00ad-92a3-4fca-bbb2-2d96a08fc5f5 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:20.709437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef00ad-92a3-4fca-bbb2-2d96a08fc5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:20.709717 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef00ad-92a3-4fca-bbb2-2d96a08fc5f5 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:20.711852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 459/915] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:20.717591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a5c2b-e8cc-46ce-ad1e-eceda0406938 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:20.717886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a5c2b-e8cc-46ce-ad1e-eceda0406938 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:20.718203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a5c2b-e8cc-46ce-ad1e-eceda0406938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:20.739957 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-aa4a5c2b-e8cc-46ce-ad1e-eceda0406938 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:20.740843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72960fbf-9daa-47d8-b7ed-9b3cf7ac4546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:20.741221 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-aa4a5c2b-e8cc-46ce-ad1e-eceda0406938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:20.741549 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72960fbf-9daa-47d8-b7ed-9b3cf7ac4546 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:20.741831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72960fbf-9daa-47d8-b7ed-9b3cf7ac4546 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:20.742105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72960fbf-9daa-47d8-b7ed-9b3cf7ac4546 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:20.742829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72960fbf-9daa-47d8-b7ed-9b3cf7ac4546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:20.743137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72960fbf-9daa-47d8-b7ed-9b3cf7ac4546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:20.744502 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72960fbf-9daa-47d8-b7ed-9b3cf7ac4546 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:20.757810 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 457/916] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:20.766563 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72960fbf-9daa-47d8-b7ed-9b3cf7ac4546 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:20.777321 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:20.793302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:20.832960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 460/917] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:20.849894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a5c2b-e8cc-46ce-ad1e-eceda0406938 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:20.901017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72960fbf-9daa-47d8-b7ed-9b3cf7ac4546 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:20.937664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fd001-e9ad-42d5-83bc-8e83f0ee2871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:20.938797 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fd001-e9ad-42d5-83bc-8e83f0ee2871 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:20.939077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fd001-e9ad-42d5-83bc-8e83f0ee2871 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:20.939355 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fd001-e9ad-42d5-83bc-8e83f0ee2871 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:20.946612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fd001-e9ad-42d5-83bc-8e83f0ee2871 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:20.948042 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fd001-e9ad-42d5-83bc-8e83f0ee2871 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-e16fd001-e9ad-42d5-83bc-8e83f0ee2871 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:26:20.962869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:20.963973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:20.969674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:20.969674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:20.969674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:26:20.969674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:26:20.969674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:26:20.969674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:26:20.969674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:26:20.969674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:26:20.969674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 17:26:20.969674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:20.969674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 458/918] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jun 1 17:26:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:20.969674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c290f-5f3d-463d-9b2d-3e1a36d18667 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:20.969674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c290f-5f3d-463d-9b2d-3e1a36d18667 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:20.970532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c290f-5f3d-463d-9b2d-3e1a36d18667 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:20.970532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 459/919] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:20.972376 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c290f-5f3d-463d-9b2d-3e1a36d18667 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:20.977092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a5c2b-e8cc-46ce-ad1e-eceda0406938 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:21.014148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189815b-b5ff-4e72-addb-8526b90cdfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:21.014950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189815b-b5ff-4e72-addb-8526b90cdfb0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:21.015231 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189815b-b5ff-4e72-addb-8526b90cdfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:21.015503 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189815b-b5ff-4e72-addb-8526b90cdfb0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:21.016151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189815b-b5ff-4e72-addb-8526b90cdfb0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:21.017598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189815b-b5ff-4e72-addb-8526b90cdfb0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-0189815b-b5ff-4e72-addb-8526b90cdfb0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:21.030477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:21.031453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:21.032380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:21.032380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:21.032380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:21.032380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:21.032380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:21.032380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:21.032380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:21.032380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:21.032380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:21.032380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:21.032380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:21.032380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:21.032380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 01 17:26:21.032380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:21.032380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 461/920] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:26:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:21.033849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ae658-1427-4b16-8eb0-a76eaef20dca None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:21.033849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ae658-1427-4b16-8eb0-a76eaef20dca None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:21.033849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ae658-1427-4b16-8eb0-a76eaef20dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:21.050851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-536ae658-1427-4b16-8eb0-a76eaef20dca None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:21.052034 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-536ae658-1427-4b16-8eb0-a76eaef20dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:21.060120 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:21.064282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:21.084618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c290f-5f3d-463d-9b2d-3e1a36d18667 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:21.121669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67cd7b-354d-4b82-a9e5-aab097323aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:21.122351 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67cd7b-354d-4b82-a9e5-aab097323aaf None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:21.122637 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67cd7b-354d-4b82-a9e5-aab097323aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:21.122928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67cd7b-354d-4b82-a9e5-aab097323aaf None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:21.124296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67cd7b-354d-4b82-a9e5-aab097323aaf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:21.124612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67cd7b-354d-4b82-a9e5-aab097323aaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:21.126096 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67cd7b-354d-4b82-a9e5-aab097323aaf None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:21.129287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 462/921] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:21.130126 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ae658-1427-4b16-8eb0-a76eaef20dca None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:21.158035 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 460/922] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Jun 1 17:26:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:21.159832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67cd7b-354d-4b82-a9e5-aab097323aaf None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:21.248486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ae658-1427-4b16-8eb0-a76eaef20dca None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:21.270492 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67cd7b-354d-4b82-a9e5-aab097323aaf None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:21.284587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bd093-e132-4174-85ef-79452f3eb480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:21.285280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bd093-e132-4174-85ef-79452f3eb480 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:21.285564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bd093-e132-4174-85ef-79452f3eb480 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:21.285841 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bd093-e132-4174-85ef-79452f3eb480 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:21.286544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bd093-e132-4174-85ef-79452f3eb480 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:21.286847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bd093-e132-4174-85ef-79452f3eb480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:21.288223 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bd093-e132-4174-85ef-79452f3eb480 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:21.297135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 463/923] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:26:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:21.297135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bd093-e132-4174-85ef-79452f3eb480 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:21.305155 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:21.309482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffc41d-cdb0-43cc-85ac-d1fed1e46787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:21.310159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffc41d-cdb0-43cc-85ac-d1fed1e46787 None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:21.310987 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffc41d-cdb0-43cc-85ac-d1fed1e46787 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:21.311390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffc41d-cdb0-43cc-85ac-d1fed1e46787 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:21.312113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffc41d-cdb0-43cc-85ac-d1fed1e46787 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:21.313536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffc41d-cdb0-43cc-85ac-d1fed1e46787 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:21.395507 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:21.397992 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bd093-e132-4174-85ef-79452f3eb480 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:21.409430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 461/924] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jun 1 17:26:21 2022] POST /identity/v3/services => generated 241 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:26:21.409430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffc41d-cdb0-43cc-85ac-d1fed1e46787 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:21.449350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee931961-03c2-4870-a4e0-ceac7f400760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:21.450181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee931961-03c2-4870-a4e0-ceac7f400760 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:21.450538 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee931961-03c2-4870-a4e0-ceac7f400760 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:21.450737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee931961-03c2-4870-a4e0-ceac7f400760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:21.464520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee931961-03c2-4870-a4e0-ceac7f400760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:21.466065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee931961-03c2-4870-a4e0-ceac7f400760 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:21.491244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-ee931961-03c2-4870-a4e0-ceac7f400760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:21.491244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:21.491244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:21.491244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:21.491244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:21.491244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:21.491244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:21.491244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:21.491244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:21.491244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:21.491244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:21.491244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:21.491244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:21.491244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:21.491244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:21.492242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:21.493225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:21.493225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:21.493225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:21.493225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:21.493225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 464/925] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:21.500641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee931961-03c2-4870-a4e0-ceac7f400760 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:21.540037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffc41d-cdb0-43cc-85ac-d1fed1e46787 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:21.573980 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:21.582321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83414c-d01e-4513-9936-2bbe1d9f235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:21.583116 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83414c-d01e-4513-9936-2bbe1d9f235a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:21.583599 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83414c-d01e-4513-9936-2bbe1d9f235a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:21.588154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83414c-d01e-4513-9936-2bbe1d9f235a None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:21.588154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83414c-d01e-4513-9936-2bbe1d9f235a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:21.588154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83414c-d01e-4513-9936-2bbe1d9f235a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:21.588154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83414c-d01e-4513-9936-2bbe1d9f235a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:21.597833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 462/926] 10.222.0.33 () {56 vars in 1114 bytes} [Wed Jun 1 17:26:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:21.598972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83414c-d01e-4513-9936-2bbe1d9f235a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:21.631404 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee931961-03c2-4870-a4e0-ceac7f400760 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:21.676612 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194a36b-bd94-4db3-94d6-305d32b9dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:21.679779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194a36b-bd94-4db3-94d6-305d32b9dee2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:21.679779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194a36b-bd94-4db3-94d6-305d32b9dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:21.679779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194a36b-bd94-4db3-94d6-305d32b9dee2 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:21.680212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:21.680297 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194a36b-bd94-4db3-94d6-305d32b9dee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:21.680297 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194a36b-bd94-4db3-94d6-305d32b9dee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:21.680297 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194a36b-bd94-4db3-94d6-305d32b9dee2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:21.696062 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 465/927] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:21.702335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194a36b-bd94-4db3-94d6-305d32b9dee2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:21.730704 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83414c-d01e-4513-9936-2bbe1d9f235a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:21.778857 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7d829-694a-440b-ad3c-05f066317b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:21.779944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7d829-694a-440b-ad3c-05f066317b64 None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:21.780446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7d829-694a-440b-ad3c-05f066317b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:21.780995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7d829-694a-440b-ad3c-05f066317b64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:21.782244 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7d829-694a-440b-ad3c-05f066317b64 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:21.784658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7d829-694a-440b-ad3c-05f066317b64 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:21.820763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194a36b-bd94-4db3-94d6-305d32b9dee2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:21.834361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:21.854172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6cb8f-489c-43a7-8846-405d356b5b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:21.854962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6cb8f-489c-43a7-8846-405d356b5b9d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:21.855240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6cb8f-489c-43a7-8846-405d356b5b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:21.855512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6cb8f-489c-43a7-8846-405d356b5b9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:21.863146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6cb8f-489c-43a7-8846-405d356b5b9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:21.865907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6cb8f-489c-43a7-8846-405d356b5b9d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:21.873097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 463/928] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jun 1 17:26:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:26:21.873097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d507648-94df-4277-ac68-310642eb0804 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:21.873097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d507648-94df-4277-ac68-310642eb0804 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:21.873097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d507648-94df-4277-ac68-310642eb0804 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:21.873097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 464/929] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:21.880512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-def6cb8f-489c-43a7-8846-405d356b5b9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:21.880512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:21.880512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:21.880512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:21.880512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:21.880512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:21.880512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:21.880512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:21.880512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:21.880512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:21.880512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:21.880512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:21.880512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:26:21.880512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:26:21.880512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:21.881556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:21.882498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:26:21.882498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:26:21.882498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:26:21.882498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:26:21.882498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:26:21.882498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:26:21.882498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:21.882498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:21.891036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 466/930] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:21.891036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6cb8f-489c-43a7-8846-405d356b5b9d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:21.891428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d132f-3220-4ef9-9215-1a71c4c742ba None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:21.891428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d132f-3220-4ef9-9215-1a71c4c742ba None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:21.891428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d132f-3220-4ef9-9215-1a71c4c742ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:21.909804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b09d132f-3220-4ef9-9215-1a71c4c742ba None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:21.911127 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b09d132f-3220-4ef9-9215-1a71c4c742ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:21.998711 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6cb8f-489c-43a7-8846-405d356b5b9d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:22.009137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 465/931] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:22.022686 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d132f-3220-4ef9-9215-1a71c4c742ba None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:22.038041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b7ce5-4884-4e75-af75-e4c1e1d8e673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:22.038719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b7ce5-4884-4e75-af75-e4c1e1d8e673 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:22.038997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b7ce5-4884-4e75-af75-e4c1e1d8e673 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:22.039268 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b7ce5-4884-4e75-af75-e4c1e1d8e673 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:22.040071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b7ce5-4884-4e75-af75-e4c1e1d8e673 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:22.040388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b7ce5-4884-4e75-af75-e4c1e1d8e673 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:22.042037 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b7ce5-4884-4e75-af75-e4c1e1d8e673 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:22.055946 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 467/932] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:22.062062 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b7ce5-4884-4e75-af75-e4c1e1d8e673 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:22.074748 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:22.101403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:22.135107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d132f-3220-4ef9-9215-1a71c4c742ba None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:22.179219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1dfa-dca4-468e-bafe-736af9e97b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:22.180121 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1dfa-dca4-468e-bafe-736af9e97b05 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:22.180406 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1dfa-dca4-468e-bafe-736af9e97b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:22.180676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1dfa-dca4-468e-bafe-736af9e97b05 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:22.181429 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1dfa-dca4-468e-bafe-736af9e97b05 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:22.182807 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1dfa-dca4-468e-bafe-736af9e97b05 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:22.184516 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b7ce5-4884-4e75-af75-e4c1e1d8e673 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-955f1dfa-dca4-468e-bafe-736af9e97b05 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:22.200664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:22.202150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:22.203145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 466/933] 10.222.0.33 () {56 vars in 1132 bytes} [Wed Jun 1 17:26:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:22.208788 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1dfa-dca4-468e-bafe-736af9e97b05 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:22.229141 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbd6d0-c4a6-4b2d-b67d-2e95da7f756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:22.230543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbd6d0-c4a6-4b2d-b67d-2e95da7f756a None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:22.231453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbd6d0-c4a6-4b2d-b67d-2e95da7f756a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:22.231889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbd6d0-c4a6-4b2d-b67d-2e95da7f756a None admin] PATH_INFO: `/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/253f9ffb48dd4eaab87aae5316fb5394/roles/1d49fbf041c949b2a9b2d7f173d4228c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:22.235420 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbd6d0-c4a6-4b2d-b67d-2e95da7f756a None admin] RBAC: Authorizing `identity:create_grant(project_id=68bf9a1e88a64a02ba53d0bedb76072a, user_id=253f9ffb48dd4eaab87aae5316fb5394, role_id=1d49fbf041c949b2a9b2d7f173d4228c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:22.237476 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbd6d0-c4a6-4b2d-b67d-2e95da7f756a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:22.324504 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1dfa-dca4-468e-bafe-736af9e97b05 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:22.335455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:22.357568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 468/934] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:26:22 2022] PUT /identity/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/253f9ffb48dd4eaab87aae5316fb5394/roles/1d49fbf041c949b2a9b2d7f173d4228c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:26:22.372034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1cb5c-c7cf-47e9-932c-68f073a47664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:22.373136 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1cb5c-c7cf-47e9-932c-68f073a47664 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:22.373866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1cb5c-c7cf-47e9-932c-68f073a47664 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:22.374287 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1cb5c-c7cf-47e9-932c-68f073a47664 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:22.375296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1cb5c-c7cf-47e9-932c-68f073a47664 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:22.375938 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1cb5c-c7cf-47e9-932c-68f073a47664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:22.377698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1cb5c-c7cf-47e9-932c-68f073a47664 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:22.385993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 467/935] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jun 1 17:26:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:22.390660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbd6d0-c4a6-4b2d-b67d-2e95da7f756a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:22.506114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:22.512849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbd6d0-c4a6-4b2d-b67d-2e95da7f756a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:22.554607 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e266c4-939a-4bbb-be46-119c704e9fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:22.555300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e266c4-939a-4bbb-be46-119c704e9fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:22.555643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e266c4-939a-4bbb-be46-119c704e9fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:22.555974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e266c4-939a-4bbb-be46-119c704e9fa0 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:22.556716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e266c4-939a-4bbb-be46-119c704e9fa0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:22.557163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e266c4-939a-4bbb-be46-119c704e9fa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:22.558585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e266c4-939a-4bbb-be46-119c704e9fa0 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:22.565747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 469/936] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jun 1 17:26:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:22.574060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1cb5c-c7cf-47e9-932c-68f073a47664 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:22.691036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1cb5c-c7cf-47e9-932c-68f073a47664 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:22.727567 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a059d-898d-4b97-b46c-dc231e56b538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:22.728235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a059d-898d-4b97-b46c-dc231e56b538 None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:22.728519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a059d-898d-4b97-b46c-dc231e56b538 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:22.728794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a059d-898d-4b97-b46c-dc231e56b538 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:22.729568 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a059d-898d-4b97-b46c-dc231e56b538 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:22.730961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a059d-898d-4b97-b46c-dc231e56b538 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:22.854133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 468/937] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jun 1 17:26:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:26:23.869042 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cd312-352d-444b-ac85-2ec59077f952 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:23.869576 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cd312-352d-444b-ac85-2ec59077f952 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:23.869576 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cd312-352d-444b-ac85-2ec59077f952 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:23.871252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 470/938] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:23.877204 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74376efe-1fa8-4d53-a871-4473dc7d6adc None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:23.877632 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74376efe-1fa8-4d53-a871-4473dc7d6adc None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:23.877823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74376efe-1fa8-4d53-a871-4473dc7d6adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:23.895451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-74376efe-1fa8-4d53-a871-4473dc7d6adc None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:23.896658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-74376efe-1fa8-4d53-a871-4473dc7d6adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:23.921582 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:23.973941 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 469/939] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:23.996559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cd312-352d-444b-ac85-2ec59077f952 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:24.113710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cd312-352d-444b-ac85-2ec59077f952 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:24.149736 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e0974-899f-4b7e-b2c9-7c38d3987d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:24.150477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e0974-899f-4b7e-b2c9-7c38d3987d91 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:24.150763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e0974-899f-4b7e-b2c9-7c38d3987d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:24.151045 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e0974-899f-4b7e-b2c9-7c38d3987d91 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:24.151708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e0974-899f-4b7e-b2c9-7c38d3987d91 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:24.153121 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e0974-899f-4b7e-b2c9-7c38d3987d91 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-785e0974-899f-4b7e-b2c9-7c38d3987d91 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:24.166327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:24.167377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:24.168239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:24.168239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:24.168239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:24.168239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:24.168239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:24.168239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:24.168239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:24.168239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:24.168239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:24.168239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:24.168239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:24.168239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:24.168239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 17:26:24.168239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:24.168239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 471/940] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jun 1 17:26:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:24.173885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74376efe-1fa8-4d53-a871-4473dc7d6adc None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:24.281084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74376efe-1fa8-4d53-a871-4473dc7d6adc None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:24.316157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75145450-5792-4a8b-a543-b1ab62b5df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:24.316830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75145450-5792-4a8b-a543-b1ab62b5df7e None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:24.317138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75145450-5792-4a8b-a543-b1ab62b5df7e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:24.317409 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75145450-5792-4a8b-a543-b1ab62b5df7e None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:24.318192 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75145450-5792-4a8b-a543-b1ab62b5df7e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:24.318499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75145450-5792-4a8b-a543-b1ab62b5df7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:24.319863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75145450-5792-4a8b-a543-b1ab62b5df7e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:24.325106 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 470/941] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jun 1 17:26:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:24.331198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e0974-899f-4b7e-b2c9-7c38d3987d91 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:24.358554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:24.392060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bbbb5-a7dc-4937-ab67-06eaa991c746 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:24.392388 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bbbb5-a7dc-4937-ab67-06eaa991c746 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:24.392625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bbbb5-a7dc-4937-ab67-06eaa991c746 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:24.394288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 471/942] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:26:24.399158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfac1a-22c9-47c0-95d8-c56e67fd7f33 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:24.399443 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfac1a-22c9-47c0-95d8-c56e67fd7f33 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:24.399717 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfac1a-22c9-47c0-95d8-c56e67fd7f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:24.416832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-33dfac1a-22c9-47c0-95d8-c56e67fd7f33 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:24.418135 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-33dfac1a-22c9-47c0-95d8-c56e67fd7f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:24.435789 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:24.451930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e0974-899f-4b7e-b2c9-7c38d3987d91 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:24.494892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211476df-2d51-4b21-bfad-fc656c3126bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:24.495575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211476df-2d51-4b21-bfad-fc656c3126bc None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:24.495862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211476df-2d51-4b21-bfad-fc656c3126bc None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:24.496140 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211476df-2d51-4b21-bfad-fc656c3126bc None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:24.496868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211476df-2d51-4b21-bfad-fc656c3126bc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:24.497202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211476df-2d51-4b21-bfad-fc656c3126bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:24.498788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211476df-2d51-4b21-bfad-fc656c3126bc None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:24.508872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 472/943] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jun 1 17:26:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:24.509873 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211476df-2d51-4b21-bfad-fc656c3126bc None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:24.514228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 472/944] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:24.546668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfac1a-22c9-47c0-95d8-c56e67fd7f33 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:24.604126 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:24.619426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211476df-2d51-4b21-bfad-fc656c3126bc None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:24.657758 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b84ef-976d-4346-957b-321dfdc37485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:24.658701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b84ef-976d-4346-957b-321dfdc37485 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:24.659132 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b84ef-976d-4346-957b-321dfdc37485 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:24.659553 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b84ef-976d-4346-957b-321dfdc37485 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:24.660492 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b84ef-976d-4346-957b-321dfdc37485 None admin] RBAC: Adding query filter params (interface=public, service_id=12e9f234bd304cb3bb3910549e1a152d, region_id=RegionOne) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:24.660658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfac1a-22c9-47c0-95d8-c56e67fd7f33 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:24.661139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b84ef-976d-4346-957b-321dfdc37485 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:24.662669 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b84ef-976d-4346-957b-321dfdc37485 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:24.672892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 473/945] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jun 1 17:26:24 2022] GET /identity/v3/endpoints?service_id=12e9f234bd304cb3bb3910549e1a152d&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:24.674037 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b84ef-976d-4346-957b-321dfdc37485 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:24.695771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc59d1-dd7a-41c6-a4c2-7cb3a1ae7e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:24.696451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc59d1-dd7a-41c6-a4c2-7cb3a1ae7e14 None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:24.697146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc59d1-dd7a-41c6-a4c2-7cb3a1ae7e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:24.697146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc59d1-dd7a-41c6-a4c2-7cb3a1ae7e14 None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:24.697727 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc59d1-dd7a-41c6-a4c2-7cb3a1ae7e14 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:24.699172 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc59d1-dd7a-41c6-a4c2-7cb3a1ae7e14 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:24.700578 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: WARNING keystone.server.flask.common [None req-30bc59d1-dd7a-41c6-a4c2-7cb3a1ae7e14 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 01 17:26:24.738820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.sql.core [None req-30bc59d1-dd7a-41c6-a4c2-7cb3a1ae7e14 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 01 17:26:24.738820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 01 17:26:24.738820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [parameters: {'id': '5583a2485f224ecb9073b5658b1128df', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 01 17:26:24.738820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80426) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 01 17:26:24.750641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-30bc59d1-dd7a-41c6-a4c2-7cb3a1ae7e14 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5583a2485f224ecb9073b5658b1128df.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5583a2485f224ecb9073b5658b1128df. Jun 01 17:26:24.750641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:24.750641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 01 17:26:24.750641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 01 17:26:24.750641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 01 17:26:24.750641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 01 17:26:24.750641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 01 17:26:24.750641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application result = self._query(query) Jun 01 17:26:24.750641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 01 17:26:24.750641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application conn.query(q) Jun 01 17:26:24.750641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 01 17:26:24.750641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 01 17:26:24.750641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application result.read() Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 01 17:26:24.751495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application next(self.gen) Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application yield resource Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application next(self.gen) Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self.session.rollback() Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self.force_reraise() Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise self.value Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application session.commit() Jun 01 17:26:24.752479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._prepare_impl() Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self.session.flush() Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._flush(objects) Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application compat.raise_( Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application flush_context.execute() Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 01 17:26:24.753766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rec.execute(self) Jun 01 17:26:24.754678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 01 17:26:24.754678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 01 17:26:24.754678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 01 17:26:24.754678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 01 17:26:24.754678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 01 17:26:24.754678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 01 17:26:24.754678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 01 17:26:24.754678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 01 17:26:24.754678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 01 17:26:24.754678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 01 17:26:24.754678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 01 17:26:24.754678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 01 17:26:24.754678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 01 17:26:24.754678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 01 17:26:24.754678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application result = self._query(query) Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application conn.query(q) Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application result.read() Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 01 17:26:24.755475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 01 17:26:24.756965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 01 17:26:24.756965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 01 17:26:24.756965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 01 17:26:24.756965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 01 17:26:24.756965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 01 17:26:24.756965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 01 17:26:24.756965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 01 17:26:24.756965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 01 17:26:24.756965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [parameters: {'id': '5583a2485f224ecb9073b5658b1128df', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 01 17:26:24.756965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 01 17:26:24.756965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:24.756965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:24.756965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:24.756965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:24.756965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:24.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:24.760552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:24.760552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 01 17:26:24.760552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 01 17:26:24.760552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:24.760552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:24.760552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 01 17:26:24.760552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 01 17:26:24.760552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5583a2485f224ecb9073b5658b1128df. Jun 01 17:26:24.760552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:24.760552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 473/946] 10.222.0.33 () {60 vars in 1140 bytes} [Wed Jun 1 17:26:24 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:24.760552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc59d1-dd7a-41c6-a4c2-7cb3a1ae7e14 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:24.766333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:24.802824 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b84ef-976d-4346-957b-321dfdc37485 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:24.850065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798c3e5-3af5-4cbc-bfc1-0319bad30ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:24.851021 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798c3e5-3af5-4cbc-bfc1-0319bad30ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:24.851305 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798c3e5-3af5-4cbc-bfc1-0319bad30ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:24.851582 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798c3e5-3af5-4cbc-bfc1-0319bad30ec3 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:24.852272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798c3e5-3af5-4cbc-bfc1-0319bad30ec3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:24.853727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798c3e5-3af5-4cbc-bfc1-0319bad30ec3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:24.871823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 474/947] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jun 1 17:26:24 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:26:24.871823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d0c11-9f4f-4ee8-95e5-f413ccfcd71f None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:24.871823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d0c11-9f4f-4ee8-95e5-f413ccfcd71f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:24.871823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d0c11-9f4f-4ee8-95e5-f413ccfcd71f None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:24.871823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 475/948] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:24.871823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8da295-ba97-41c0-b9f1-1aa89dd85fe9 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:24.871823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8da295-ba97-41c0-b9f1-1aa89dd85fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:24.878236 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8da295-ba97-41c0-b9f1-1aa89dd85fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:24.892076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5e8da295-ba97-41c0-b9f1-1aa89dd85fe9 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:24.893335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5e8da295-ba97-41c0-b9f1-1aa89dd85fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:24.905904 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:24.914907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc59d1-dd7a-41c6-a4c2-7cb3a1ae7e14 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:24.958493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eabe1d-5463-4ef0-8c87-d2294a6273ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:24.959453 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eabe1d-5463-4ef0-8c87-d2294a6273ab None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:24.959750 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eabe1d-5463-4ef0-8c87-d2294a6273ab None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:24.960002 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eabe1d-5463-4ef0-8c87-d2294a6273ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:24.968428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eabe1d-5463-4ef0-8c87-d2294a6273ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:24.970169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eabe1d-5463-4ef0-8c87-d2294a6273ab None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:24.984976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 476/949] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:24.989525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-c9eabe1d-5463-4ef0-8c87-d2294a6273ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:24.989525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:24.989525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:24.989525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:24.989525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:24.989525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:24.989525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:24.989525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:24.989525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:24.989525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:24.989525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:24.989525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:24.989525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:26:24.989525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:26:24.989525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:24.990625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:24.991757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:26:24.991757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:26:24.991757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:26:24.991757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:26:24.991757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:26:24.991757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:26:24.991757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:24.991757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:24.994033 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 474/950] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:25.000990 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8da295-ba97-41c0-b9f1-1aa89dd85fe9 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:25.009064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eabe1d-5463-4ef0-8c87-d2294a6273ab None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:25.079269 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:25.116218 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8da295-ba97-41c0-b9f1-1aa89dd85fe9 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:25.122315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eabe1d-5463-4ef0-8c87-d2294a6273ab None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:25.155676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23272da-f5fa-496d-9669-710a8132dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:25.156353 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23272da-f5fa-496d-9669-710a8132dc9d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:25.156630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23272da-f5fa-496d-9669-710a8132dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:25.156903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23272da-f5fa-496d-9669-710a8132dc9d None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:25.158978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23272da-f5fa-496d-9669-710a8132dc9d None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:25.159309 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23272da-f5fa-496d-9669-710a8132dc9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:25.160742 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23272da-f5fa-496d-9669-710a8132dc9d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:25.167134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92ac9f-24c0-482a-9f2f-1bfa5b090a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:25.168333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92ac9f-24c0-482a-9f2f-1bfa5b090a7d None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:25.168846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92ac9f-24c0-482a-9f2f-1bfa5b090a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:25.169366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92ac9f-24c0-482a-9f2f-1bfa5b090a7d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:25.179133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 477/951] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jun 1 17:26:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:25.188968 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92ac9f-24c0-482a-9f2f-1bfa5b090a7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-df92ac9f-24c0-482a-9f2f-1bfa5b090a7d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:26:25.196440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:25.197661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:25.198763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:25.198763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:25.198763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:25.198763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:25.198763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:26:25.198763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:26:25.198763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:26:25.198763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:26:25.198763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:26:25.198763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:26:25.198763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 17:26:25.198763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:25.209120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 475/952] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Jun 1 17:26:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:25.211114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23272da-f5fa-496d-9669-710a8132dc9d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:25.217146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:25.218432 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39568ce3-2058-47cf-95f5-e5bcda3df024 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:25.218729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39568ce3-2058-47cf-95f5-e5bcda3df024 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:25.219016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39568ce3-2058-47cf-95f5-e5bcda3df024 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:25.228578 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 476/953] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:25 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:25.230164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30b187-cb98-4c03-b9aa-602b6d66704b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:25.230493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30b187-cb98-4c03-b9aa-602b6d66704b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:25.230780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30b187-cb98-4c03-b9aa-602b6d66704b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:25.250751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-2e30b187-cb98-4c03-b9aa-602b6d66704b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:25.252287 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-2e30b187-cb98-4c03-b9aa-602b6d66704b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:25.337565 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 477/954] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:25.345973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23272da-f5fa-496d-9669-710a8132dc9d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:25.357651 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30b187-cb98-4c03-b9aa-602b6d66704b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:25.402135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b4a93-9257-46f1-a9ce-8cbbd250a448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:25.402827 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b4a93-9257-46f1-a9ce-8cbbd250a448 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:25.403110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b4a93-9257-46f1-a9ce-8cbbd250a448 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:25.403390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b4a93-9257-46f1-a9ce-8cbbd250a448 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:25.404230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b4a93-9257-46f1-a9ce-8cbbd250a448 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:25.404704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b4a93-9257-46f1-a9ce-8cbbd250a448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:25.406170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b4a93-9257-46f1-a9ce-8cbbd250a448 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:25.416108 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 478/955] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Jun 1 17:26:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:25.423121 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:25.423691 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b4a93-9257-46f1-a9ce-8cbbd250a448 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:25.486686 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30b187-cb98-4c03-b9aa-602b6d66704b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:25.517998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:25.531837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821b510-7eaf-403e-b63f-053938874878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:25.536843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821b510-7eaf-403e-b63f-053938874878 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:25.536843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821b510-7eaf-403e-b63f-053938874878 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:25.536843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821b510-7eaf-403e-b63f-053938874878 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:25.536843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821b510-7eaf-403e-b63f-053938874878 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:25.536843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821b510-7eaf-403e-b63f-053938874878 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-c821b510-7eaf-403e-b63f-053938874878 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:25.553677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:25.554816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:25.555670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:25.555670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:25.555670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:25.555670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:25.555670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:25.555670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:25.555670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:25.555670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:25.555670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:25.555670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:25.555670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:25.555670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:25.555670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 17:26:25.555670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:25.555670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 478/956] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:25.561738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821b510-7eaf-403e-b63f-053938874878 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:25.570388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b4a93-9257-46f1-a9ce-8cbbd250a448 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:25.611271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19968c92-0ad9-4e30-a5ba-12f84bd4fa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:25.612180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19968c92-0ad9-4e30-a5ba-12f84bd4fa2c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:25.612534 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19968c92-0ad9-4e30-a5ba-12f84bd4fa2c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:25.612883 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19968c92-0ad9-4e30-a5ba-12f84bd4fa2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:25.624817 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19968c92-0ad9-4e30-a5ba-12f84bd4fa2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:25.626434 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19968c92-0ad9-4e30-a5ba-12f84bd4fa2c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:25.644518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-19968c92-0ad9-4e30-a5ba-12f84bd4fa2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:25.644518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:25.644518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:25.644518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:25.644518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:25.644518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:25.644518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:25.644518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:25.644518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:25.644518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:25.644518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:25.644518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:25.644518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:25.644518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:25.644518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:25.645520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:25.651282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:25.651282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:25.651282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:25.651282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:25.651282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 479/957] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:25.652857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19968c92-0ad9-4e30-a5ba-12f84bd4fa2c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:25.678386 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821b510-7eaf-403e-b63f-053938874878 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:25.698190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:25.718265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9af1f7-3530-4844-bc28-799ff84a9c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:25.719401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9af1f7-3530-4844-bc28-799ff84a9c64 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:25.719931 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9af1f7-3530-4844-bc28-799ff84a9c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:25.720405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9af1f7-3530-4844-bc28-799ff84a9c64 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:25.721361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9af1f7-3530-4844-bc28-799ff84a9c64 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:25.721866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9af1f7-3530-4844-bc28-799ff84a9c64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:25.723586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9af1f7-3530-4844-bc28-799ff84a9c64 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:25.730747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 479/958] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jun 1 17:26:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:25.736975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9af1f7-3530-4844-bc28-799ff84a9c64 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:25.769276 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19968c92-0ad9-4e30-a5ba-12f84bd4fa2c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:25.795563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:25.818977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e71147-5967-4feb-adc6-aa92118a226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:25.819894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e71147-5967-4feb-adc6-aa92118a226b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:25.820332 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e71147-5967-4feb-adc6-aa92118a226b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:25.820760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e71147-5967-4feb-adc6-aa92118a226b None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:25.821987 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e71147-5967-4feb-adc6-aa92118a226b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:25.822540 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e71147-5967-4feb-adc6-aa92118a226b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:25.824581 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e71147-5967-4feb-adc6-aa92118a226b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:25.840387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 480/959] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:25.846403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e71147-5967-4feb-adc6-aa92118a226b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:25.861574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9af1f7-3530-4844-bc28-799ff84a9c64 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:25.909186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe0fe-db4b-461f-8dcc-91d60b2688c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:25.910404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe0fe-db4b-461f-8dcc-91d60b2688c8 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:25.911666 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe0fe-db4b-461f-8dcc-91d60b2688c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:25.912742 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe0fe-db4b-461f-8dcc-91d60b2688c8 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:25.914941 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efe0fe-db4b-461f-8dcc-91d60b2688c8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:25.915915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efe0fe-db4b-461f-8dcc-91d60b2688c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:25.917718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efe0fe-db4b-461f-8dcc-91d60b2688c8 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:25.925786 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 480/960] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jun 1 17:26:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:25.980258 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e71147-5967-4feb-adc6-aa92118a226b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:26.020074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dc30a-1637-4677-ae41-40258dfdfd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:26.021195 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dc30a-1637-4677-ae41-40258dfdfd9d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:26.021621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dc30a-1637-4677-ae41-40258dfdfd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:26.022039 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dc30a-1637-4677-ae41-40258dfdfd9d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:26.031309 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dc30a-1637-4677-ae41-40258dfdfd9d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:26.033080 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dc30a-1637-4677-ae41-40258dfdfd9d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-011dc30a-1637-4677-ae41-40258dfdfd9d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:26:26.050802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:26.052019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:26.053197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:26.053197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:26.053197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:26:26.053197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:26:26.053197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:26:26.053197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:26:26.053197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:26:26.053197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:26:26.053197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 01 17:26:26.053197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:26.060123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 481/961] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jun 1 17:26:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:26.062551 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe0fe-db4b-461f-8dcc-91d60b2688c8 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:26.121979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:26.187355 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe0fe-db4b-461f-8dcc-91d60b2688c8 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:26.221952 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f56e3-848f-46c5-ae26-0f5f1e42f0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:26.222907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f56e3-848f-46c5-ae26-0f5f1e42f0be None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:26.223333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f56e3-848f-46c5-ae26-0f5f1e42f0be None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:26.223761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f56e3-848f-46c5-ae26-0f5f1e42f0be None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:26.224732 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f56e3-848f-46c5-ae26-0f5f1e42f0be None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:26.225213 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f56e3-848f-46c5-ae26-0f5f1e42f0be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:26.227044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f56e3-848f-46c5-ae26-0f5f1e42f0be None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:26.252321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 481/962] 10.222.0.33 () {56 vars in 1149 bytes} [Wed Jun 1 17:26:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:26.253977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dc30a-1637-4677-ae41-40258dfdfd9d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:26.300153 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:26.362923 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dc30a-1637-4677-ae41-40258dfdfd9d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:26.398002 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2595997-4e84-45fb-8168-2a94032a2c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:26.398646 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2595997-4e84-45fb-8168-2a94032a2c1e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:26.398932 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2595997-4e84-45fb-8168-2a94032a2c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:26.399209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2595997-4e84-45fb-8168-2a94032a2c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:26.475180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2595997-4e84-45fb-8168-2a94032a2c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:26.476959 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2595997-4e84-45fb-8168-2a94032a2c1e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:26.516635 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:26.586465 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 482/963] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:26:26 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:26:26.587832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f56e3-848f-46c5-ae26-0f5f1e42f0be None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:26.693620 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f56e3-848f-46c5-ae26-0f5f1e42f0be None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:26.696077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:26.729590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2241c-e4ea-4d44-b9b2-240cd1265384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:26.730400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2241c-e4ea-4d44-b9b2-240cd1265384 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:26.730681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2241c-e4ea-4d44-b9b2-240cd1265384 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:26.730951 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2241c-e4ea-4d44-b9b2-240cd1265384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:26.742205 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2241c-e4ea-4d44-b9b2-240cd1265384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:26.743866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2241c-e4ea-4d44-b9b2-240cd1265384 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:26.762103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-dbb2241c-e4ea-4d44-b9b2-240cd1265384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:26.762103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:26.762103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:26.762103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:26.762103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:26.762103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:26.762103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:26.762103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:26.762103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:26.762103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:26.762103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:26.762103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:26.762103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:26.762103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:26.762103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:26.763044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:26.764705 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:26.764705 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:26.764705 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:26.764705 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:26.767904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 482/964] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:26.769857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2595997-4e84-45fb-8168-2a94032a2c1e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:26.871775 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2595997-4e84-45fb-8168-2a94032a2c1e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:26.907183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98d2a9-89eb-47cc-a089-ff0be1468993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:26.907876 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98d2a9-89eb-47cc-a089-ff0be1468993 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:26.908157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98d2a9-89eb-47cc-a089-ff0be1468993 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:26.908430 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98d2a9-89eb-47cc-a089-ff0be1468993 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:26.909205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98d2a9-89eb-47cc-a089-ff0be1468993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:26.909511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98d2a9-89eb-47cc-a089-ff0be1468993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:26.910949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98d2a9-89eb-47cc-a089-ff0be1468993 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:26.918611 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:26.929095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 483/965] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:26.940268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2241c-e4ea-4d44-b9b2-240cd1265384 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:27.034447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2241c-e4ea-4d44-b9b2-240cd1265384 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:27.069461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd742e-e8f9-491b-bb0a-ca5521de5da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:27.070521 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd742e-e8f9-491b-bb0a-ca5521de5da2 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:27.070802 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd742e-e8f9-491b-bb0a-ca5521de5da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:27.071075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd742e-e8f9-491b-bb0a-ca5521de5da2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:27.078806 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd742e-e8f9-491b-bb0a-ca5521de5da2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:27.080257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd742e-e8f9-491b-bb0a-ca5521de5da2 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:27.094428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-17dd742e-e8f9-491b-bb0a-ca5521de5da2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:27.094428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:27.094428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:27.094428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:27.094428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:27.094428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:27.094428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:27.094428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:27.094428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:27.094428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:27.094428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:27.094428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:27.094428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:26:27.094428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:26:27.094428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:27.095398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:27.096300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:26:27.096300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:26:27.096300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:26:27.096300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:26:27.096300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:26:27.096300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:26:27.096300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:27.096300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:27.100814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 483/966] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:27.102190 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98d2a9-89eb-47cc-a089-ff0be1468993 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:27.220147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98d2a9-89eb-47cc-a089-ff0be1468993 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:27.259554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6eba0-fe8d-48aa-b74f-199e292320f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:27.260219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6eba0-fe8d-48aa-b74f-199e292320f8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:27.260500 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6eba0-fe8d-48aa-b74f-199e292320f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:27.260776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6eba0-fe8d-48aa-b74f-199e292320f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:27.261591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6eba0-fe8d-48aa-b74f-199e292320f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:27.261901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6eba0-fe8d-48aa-b74f-199e292320f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:27.264204 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6eba0-fe8d-48aa-b74f-199e292320f8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:27.265995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2b5b7-2329-4143-a6db-616f1844c756 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:27.266277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2b5b7-2329-4143-a6db-616f1844c756 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:27.266781 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2b5b7-2329-4143-a6db-616f1844c756 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:27.268986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 484/967] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:26:27.277754 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5ab90-8636-4776-8a2f-c941453ce7c6 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:27.278046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5ab90-8636-4776-8a2f-c941453ce7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:27.278328 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5ab90-8636-4776-8a2f-c941453ce7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:27.283434 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 484/968] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:26:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:27.286718 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6eba0-fe8d-48aa-b74f-199e292320f8 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:27.297601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-25e5ab90-8636-4776-8a2f-c941453ce7c6 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:27.299225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-25e5ab90-8636-4776-8a2f-c941453ce7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:27.313281 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:27.354881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:27.374884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 485/969] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:27.398991 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5ab90-8636-4776-8a2f-c941453ce7c6 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:27.407863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6eba0-fe8d-48aa-b74f-199e292320f8 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:27.453094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f2c40-1e38-46db-8638-519548d69369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:27.454227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f2c40-1e38-46db-8638-519548d69369 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:27.454819 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f2c40-1e38-46db-8638-519548d69369 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:27.455311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f2c40-1e38-46db-8638-519548d69369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:27.456356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f2c40-1e38-46db-8638-519548d69369 None admin] RBAC: Adding query filter params (role.id=1d49fbf041c949b2a9b2d7f173d4228c, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=253f9ffb48dd4eaab87aae5316fb5394) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:27.456892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f2c40-1e38-46db-8638-519548d69369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:27.458975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f2c40-1e38-46db-8638-519548d69369 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:27.468488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 485/970] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:26:27 2022] GET /identity/v3/role_assignments?user.id=253f9ffb48dd4eaab87aae5316fb5394&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=1d49fbf041c949b2a9b2d7f173d4228c => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:27.526001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5ab90-8636-4776-8a2f-c941453ce7c6 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:27.568732 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826baff5-338b-495a-afd2-565d07050a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:27.569650 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826baff5-338b-495a-afd2-565d07050a2a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:27.569937 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826baff5-338b-495a-afd2-565d07050a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:27.570209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826baff5-338b-495a-afd2-565d07050a2a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:27.570883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826baff5-338b-495a-afd2-565d07050a2a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:27.572301 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826baff5-338b-495a-afd2-565d07050a2a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-826baff5-338b-495a-afd2-565d07050a2a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:27.586171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:27.587384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:27.588325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:27.588325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:27.588325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:27.588325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:27.588325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:27.588325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:27.588325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:27.588325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:27.588325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:27.588325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:27.588325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:27.588325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:27.588325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 17:26:27.588325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:27.588325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 486/971] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jun 1 17:26:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:27.594861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f2c40-1e38-46db-8638-519548d69369 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:27.719477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f2c40-1e38-46db-8638-519548d69369 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:27.745604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:27.757800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d65ad9-ae53-4170-9364-f8439f6f2397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:27.758512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d65ad9-ae53-4170-9364-f8439f6f2397 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:27.758761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d65ad9-ae53-4170-9364-f8439f6f2397 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:27.759120 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d65ad9-ae53-4170-9364-f8439f6f2397 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:27.759952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d65ad9-ae53-4170-9364-f8439f6f2397 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:27.760269 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d65ad9-ae53-4170-9364-f8439f6f2397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:27.761692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d65ad9-ae53-4170-9364-f8439f6f2397 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:27.767171 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 486/972] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jun 1 17:26:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:27.769120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eabfbd-929d-4528-b3a9-a02ff83c6f70 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:27.769634 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eabfbd-929d-4528-b3a9-a02ff83c6f70 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:27.770190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eabfbd-929d-4528-b3a9-a02ff83c6f70 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:27.772050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 487/973] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:27.772658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d65ad9-ae53-4170-9364-f8439f6f2397 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:27.778183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0386a-c3cb-435f-a713-c75358151390 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:27.778183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0386a-c3cb-435f-a713-c75358151390 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:27.778183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0386a-c3cb-435f-a713-c75358151390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:27.795792 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b1e0386a-c3cb-435f-a713-c75358151390 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:27.797163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b1e0386a-c3cb-435f-a713-c75358151390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:27.801021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:27.889750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d65ad9-ae53-4170-9364-f8439f6f2397 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:27.892592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 488/974] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:27.917864 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0386a-c3cb-435f-a713-c75358151390 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:27.935572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a2b50-f035-4e6b-be24-3aca7ba057ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:27.936823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a2b50-f035-4e6b-be24-3aca7ba057ca None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:27.937647 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a2b50-f035-4e6b-be24-3aca7ba057ca None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:27.938191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a2b50-f035-4e6b-be24-3aca7ba057ca None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:27.939121 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a2b50-f035-4e6b-be24-3aca7ba057ca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:27.939630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a2b50-f035-4e6b-be24-3aca7ba057ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:27.942048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a2b50-f035-4e6b-be24-3aca7ba057ca None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:27.950190 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 487/975] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jun 1 17:26:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:27.956698 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a2b50-f035-4e6b-be24-3aca7ba057ca None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:28.028919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0386a-c3cb-435f-a713-c75358151390 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:28.033995 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:28.069327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edec1e5-5ceb-4200-a3f5-23220a796b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:28.070195 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edec1e5-5ceb-4200-a3f5-23220a796b3e None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:28.070572 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edec1e5-5ceb-4200-a3f5-23220a796b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:28.070945 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edec1e5-5ceb-4200-a3f5-23220a796b3e None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:28.071753 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edec1e5-5ceb-4200-a3f5-23220a796b3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:28.073320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edec1e5-5ceb-4200-a3f5-23220a796b3e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:28.103344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a2b50-f035-4e6b-be24-3aca7ba057ca None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:28.120659 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.sql.core [None req-9edec1e5-5ceb-4200-a3f5-23220a796b3e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 01 17:26:28.120659 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 01 17:26:28.120659 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [parameters: {'user_id': 'c2497df7630841fca444cab08d2e81e5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 01 17:26:28.120659 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80426) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 01 17:26:28.128932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-9edec1e5-5ceb-4200-a3f5-23220a796b3e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 01 17:26:28.128932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:28.128932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 01 17:26:28.128932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 01 17:26:28.128932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 01 17:26:28.128932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 01 17:26:28.128932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 01 17:26:28.128932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application result = self._query(query) Jun 01 17:26:28.128932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 01 17:26:28.128932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application conn.query(q) Jun 01 17:26:28.128932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 01 17:26:28.128932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 01 17:26:28.128932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 01 17:26:28.128932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application result.read() Jun 01 17:26:28.128932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 01 17:26:28.130025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application next(self.gen) Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application yield resource Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application next(self.gen) Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self.session.rollback() Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self.force_reraise() Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise self.value Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application session.commit() Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 01 17:26:28.131039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._prepare_impl() Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self.session.flush() Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._flush(objects) Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application compat.raise_( Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application flush_context.execute() Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rec.execute(self) Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 01 17:26:28.131978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 01 17:26:28.132961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application result = self._query(query) Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application conn.query(q) Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application result.read() Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 01 17:26:28.136140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 01 17:26:28.138895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 01 17:26:28.138895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 01 17:26:28.138895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 01 17:26:28.138895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 01 17:26:28.138895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 01 17:26:28.138895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 01 17:26:28.138895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c2497df7630841fca444cab08d2e81e5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 01 17:26:28.138895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 01 17:26:28.138895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:28.138895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:28.138895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:28.138895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:28.138895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:28.138895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:28.138895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 01 17:26:28.141330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 01 17:26:28.144709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 01 17:26:28.144709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 01 17:26:28.144709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 01 17:26:28.144709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 01 17:26:28.144709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 01 17:26:28.144709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:28.144709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 489/976] 10.222.0.33 () {60 vars in 1131 bytes} [Wed Jun 1 17:26:27 2022] POST /identity/v3/users => generated 160 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:28.144709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edec1e5-5ceb-4200-a3f5-23220a796b3e None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:28.144709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:28.169987 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743cb5e-6ab4-4fc0-ada8-6cc27548666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:28.171601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743cb5e-6ab4-4fc0-ada8-6cc27548666b None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:28.172439 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743cb5e-6ab4-4fc0-ada8-6cc27548666b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:28.172932 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743cb5e-6ab4-4fc0-ada8-6cc27548666b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:28.174473 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743cb5e-6ab4-4fc0-ada8-6cc27548666b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:28.176600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743cb5e-6ab4-4fc0-ada8-6cc27548666b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:28.253231 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edec1e5-5ceb-4200-a3f5-23220a796b3e None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:28.283147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 488/977] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jun 1 17:26:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:26:28.311127 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd496b15-e52a-4fda-b74e-61f7f26492a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:28.312015 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd496b15-e52a-4fda-b74e-61f7f26492a5 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:28.312333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd496b15-e52a-4fda-b74e-61f7f26492a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:28.312626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd496b15-e52a-4fda-b74e-61f7f26492a5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:28.316956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2b7cd-b22b-4693-9d44-ae245c67cb7c None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:28.317263 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2b7cd-b22b-4693-9d44-ae245c67cb7c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:28.317551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2b7cd-b22b-4693-9d44-ae245c67cb7c None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:28.319283 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 489/978] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:26:28.321762 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd496b15-e52a-4fda-b74e-61f7f26492a5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:28.323877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd496b15-e52a-4fda-b74e-61f7f26492a5 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:28.324958 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c9f49-1fe1-4d97-9b68-c3353e3f8ef5 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:28.325259 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c9f49-1fe1-4d97-9b68-c3353e3f8ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:28.325543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c9f49-1fe1-4d97-9b68-c3353e3f8ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:28.344525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-869c9f49-1fe1-4d97-9b68-c3353e3f8ef5 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:28.345788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-869c9f49-1fe1-4d97-9b68-c3353e3f8ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-bd496b15-e52a-4fda-b74e-61f7f26492a5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:26:28.347120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:28.348059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:28.349022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:28.349022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:28.349022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:26:28.349022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:26:28.349022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:26:28.349022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:26:28.349022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:26:28.349022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:26:28.349022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 01 17:26:28.349022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:28.350198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 490/979] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:26:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:28.354966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd496b15-e52a-4fda-b74e-61f7f26492a5 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:28.446536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 490/980] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:28.450844 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:28.468758 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c9f49-1fe1-4d97-9b68-c3353e3f8ef5 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:28.502425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd496b15-e52a-4fda-b74e-61f7f26492a5 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:28.520135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:28.547616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec5525-2f89-4aa8-86b7-d93da267f9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:28.548223 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec5525-2f89-4aa8-86b7-d93da267f9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:28.548508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec5525-2f89-4aa8-86b7-d93da267f9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:28.548787 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec5525-2f89-4aa8-86b7-d93da267f9d1 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:28.549643 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec5525-2f89-4aa8-86b7-d93da267f9d1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:28.549956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec5525-2f89-4aa8-86b7-d93da267f9d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:28.551424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec5525-2f89-4aa8-86b7-d93da267f9d1 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:28.592324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 491/981] 10.222.0.33 () {56 vars in 1101 bytes} [Wed Jun 1 17:26:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:28.606209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c9f49-1fe1-4d97-9b68-c3353e3f8ef5 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:28.648520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb65e81-3afc-45e9-bc82-733713f4e635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:28.649227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65e81-3afc-45e9-bc82-733713f4e635 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:28.649516 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65e81-3afc-45e9-bc82-733713f4e635 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:28.649799 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65e81-3afc-45e9-bc82-733713f4e635 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:28.650555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb65e81-3afc-45e9-bc82-733713f4e635 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:28.651977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb65e81-3afc-45e9-bc82-733713f4e635 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:28.719766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 491/982] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jun 1 17:26:28 2022] POST /identity/v3/services => generated 242 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:26:29.892429 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae9f7e-006a-4a09-9884-ccfa1ac0663b None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:29.893099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae9f7e-006a-4a09-9884-ccfa1ac0663b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:29.893099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae9f7e-006a-4a09-9884-ccfa1ac0663b None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:29.894424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 492/983] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:29.899530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065febdb-e747-4e4f-a127-94677c981a93 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:29.899912 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065febdb-e747-4e4f-a127-94677c981a93 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:29.900087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065febdb-e747-4e4f-a127-94677c981a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:29.917369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-065febdb-e747-4e4f-a127-94677c981a93 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:29.918563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-065febdb-e747-4e4f-a127-94677c981a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:29.996592 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 492/984] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:30.019432 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae9f7e-006a-4a09-9884-ccfa1ac0663b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:30.130348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae9f7e-006a-4a09-9884-ccfa1ac0663b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:30.148330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:30.166523 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c494ff9-7376-476f-a683-240de5d0430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:30.167345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c494ff9-7376-476f-a683-240de5d0430a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:30.167629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c494ff9-7376-476f-a683-240de5d0430a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:30.167909 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c494ff9-7376-476f-a683-240de5d0430a None admin] PATH_INFO: `/v3/services/image` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:30.168565 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c494ff9-7376-476f-a683-240de5d0430a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:30.170681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c494ff9-7376-476f-a683-240de5d0430a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-8c494ff9-7376-476f-a683-240de5d0430a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:30.182947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:30.184157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:30.185293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:30.185293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:30.185293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:30.185293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:30.185293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:30.185293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:30.185293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:30.185293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:30.185293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:30.185293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:30.185293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:30.185293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:30.185293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 17:26:30.185293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:30.188187 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 493/985] 10.222.0.33 () {56 vars in 1105 bytes} [Wed Jun 1 17:26:30 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:30.193955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065febdb-e747-4e4f-a127-94677c981a93 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:30.218961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:30.297551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065febdb-e747-4e4f-a127-94677c981a93 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:30.334703 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056098f-14da-4539-80e5-80c0188dc719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:30.335400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056098f-14da-4539-80e5-80c0188dc719 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:30.335689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056098f-14da-4539-80e5-80c0188dc719 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:30.335976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056098f-14da-4539-80e5-80c0188dc719 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:30.336701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056098f-14da-4539-80e5-80c0188dc719 None admin] RBAC: Adding query filter params (name=image) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:30.337047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056098f-14da-4539-80e5-80c0188dc719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:30.338509 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056098f-14da-4539-80e5-80c0188dc719 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:30.344806 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 493/986] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:30.350727 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c494ff9-7376-476f-a683-240de5d0430a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:30.453852 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c494ff9-7376-476f-a683-240de5d0430a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:30.494118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0deca-6789-4f55-8492-99033c6d035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:30.494796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0deca-6789-4f55-8492-99033c6d035a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:30.495083 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0deca-6789-4f55-8492-99033c6d035a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:30.495358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0deca-6789-4f55-8492-99033c6d035a None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:30.496060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0deca-6789-4f55-8492-99033c6d035a None admin] RBAC: Adding query filter params (type=image) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:30.496369 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0deca-6789-4f55-8492-99033c6d035a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:30.497809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0deca-6789-4f55-8492-99033c6d035a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:30.502700 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 494/987] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:30.671361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b01f32-dfad-4b9c-88ba-effb0dee3ab9 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:30.676727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b01f32-dfad-4b9c-88ba-effb0dee3ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:30.676727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b01f32-dfad-4b9c-88ba-effb0dee3ab9 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:30.676727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 494/988] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:30.679600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5e038-67bd-4c7b-8188-61b425e7ece8 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:30.679898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5e038-67bd-4c7b-8188-61b425e7ece8 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:30.680175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5e038-67bd-4c7b-8188-61b425e7ece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:30.699377 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-20b5e038-67bd-4c7b-8188-61b425e7ece8 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:30.701476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-20b5e038-67bd-4c7b-8188-61b425e7ece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:30.745510 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:30.772358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 495/989] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:30.795989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b01f32-dfad-4b9c-88ba-effb0dee3ab9 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:30.885416 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:30.901719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b01f32-dfad-4b9c-88ba-effb0dee3ab9 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:30.937340 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcbc59-d45a-47b9-9c8c-1ad2103a3225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:30.938153 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcbc59-d45a-47b9-9c8c-1ad2103a3225 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:30.938437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcbc59-d45a-47b9-9c8c-1ad2103a3225 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:30.938712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcbc59-d45a-47b9-9c8c-1ad2103a3225 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:30.939369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcbc59-d45a-47b9-9c8c-1ad2103a3225 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:30.940792 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcbc59-d45a-47b9-9c8c-1ad2103a3225 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-90fcbc59-d45a-47b9-9c8c-1ad2103a3225 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:30.952969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:30.953955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:30.954830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:30.954830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:30.954830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:30.954830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:30.954830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:30.954830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:30.954830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:30.954830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:30.954830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:30.954830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:30.954830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:30.954830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:30.954830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 17:26:30.954830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:30.954830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 495/990] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jun 1 17:26:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:30.960162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5e038-67bd-4c7b-8188-61b425e7ece8 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:31.007052 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62429f5a-ddb2-46b1-8eab-44e2fddeea22 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:31.007233 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62429f5a-ddb2-46b1-8eab-44e2fddeea22 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:31.007518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62429f5a-ddb2-46b1-8eab-44e2fddeea22 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:31.008874 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 496/991] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:26:31.014325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a5ac9-0259-4c63-aa7a-3f98d46e5ecc None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:31.014605 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a5ac9-0259-4c63-aa7a-3f98d46e5ecc None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:31.015029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a5ac9-0259-4c63-aa7a-3f98d46e5ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:31.032130 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-893a5ac9-0259-4c63-aa7a-3f98d46e5ecc None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:31.033330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-893a5ac9-0259-4c63-aa7a-3f98d46e5ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:31.070216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5e038-67bd-4c7b-8188-61b425e7ece8 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:31.102848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 497/992] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:31.108528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92411fb1-707a-4269-bcae-4fa0258787b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:31.109243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92411fb1-707a-4269-bcae-4fa0258787b9 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:31.109532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92411fb1-707a-4269-bcae-4fa0258787b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:31.109814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92411fb1-707a-4269-bcae-4fa0258787b9 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:31.110516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92411fb1-707a-4269-bcae-4fa0258787b9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:31.110830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92411fb1-707a-4269-bcae-4fa0258787b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:31.112209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92411fb1-707a-4269-bcae-4fa0258787b9 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:31.120980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 496/993] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jun 1 17:26:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:31.122761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a5ac9-0259-4c63-aa7a-3f98d46e5ecc None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:31.127528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92411fb1-707a-4269-bcae-4fa0258787b9 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:31.175020 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:31.209545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:31.228318 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a5ac9-0259-4c63-aa7a-3f98d46e5ecc None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:31.240210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92411fb1-707a-4269-bcae-4fa0258787b9 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:31.264809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb510c8-cd04-41a6-9f14-2c168263ab5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:31.265511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb510c8-cd04-41a6-9f14-2c168263ab5a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:31.265798 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb510c8-cd04-41a6-9f14-2c168263ab5a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:31.266073 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb510c8-cd04-41a6-9f14-2c168263ab5a None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:31.266861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb510c8-cd04-41a6-9f14-2c168263ab5a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:31.267171 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb510c8-cd04-41a6-9f14-2c168263ab5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:31.268543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb510c8-cd04-41a6-9f14-2c168263ab5a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:31.274727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 498/994] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jun 1 17:26:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:31.279927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00fcfe-8b29-4e48-ab32-8773b0b8a93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:31.281366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb510c8-cd04-41a6-9f14-2c168263ab5a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:31.281782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00fcfe-8b29-4e48-ab32-8773b0b8a93f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:31.282079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00fcfe-8b29-4e48-ab32-8773b0b8a93f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:31.282369 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00fcfe-8b29-4e48-ab32-8773b0b8a93f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:31.283043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00fcfe-8b29-4e48-ab32-8773b0b8a93f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:31.284427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00fcfe-8b29-4e48-ab32-8773b0b8a93f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-6d00fcfe-8b29-4e48-ab32-8773b0b8a93f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:31.297918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:31.298961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:31.300673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:31.300673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:31.300673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:31.300673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:31.300673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:31.300673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:31.300673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:31.300673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:31.300673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:31.300673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:31.300673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:31.300673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:31.300673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 17:26:31.300673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:31.300673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 497/995] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:31.304960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00fcfe-8b29-4e48-ab32-8773b0b8a93f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:31.392289 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb510c8-cd04-41a6-9f14-2c168263ab5a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:31.416553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00fcfe-8b29-4e48-ab32-8773b0b8a93f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:31.420715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:31.431516 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3594726-e17b-48f7-bb74-549453c1f289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:31.432176 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3594726-e17b-48f7-bb74-549453c1f289 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:31.435994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3594726-e17b-48f7-bb74-549453c1f289 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:31.435994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3594726-e17b-48f7-bb74-549453c1f289 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:31.435994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3594726-e17b-48f7-bb74-549453c1f289 None admin] RBAC: Adding query filter params (interface=admin, service_id=12e9f234bd304cb3bb3910549e1a152d, region_id=RegionOne) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:31.435994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3594726-e17b-48f7-bb74-549453c1f289 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:31.435994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3594726-e17b-48f7-bb74-549453c1f289 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:31.441229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 499/996] 10.222.0.33 () {56 vars in 1249 bytes} [Wed Jun 1 17:26:31 2022] GET /identity/v3/endpoints?service_id=12e9f234bd304cb3bb3910549e1a152d&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:31.446400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3594726-e17b-48f7-bb74-549453c1f289 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:31.460270 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:31.462617 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b230f0a-2729-45f5-91eb-9ec4f7cf8655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:31.463305 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b230f0a-2729-45f5-91eb-9ec4f7cf8655 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:31.463592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b230f0a-2729-45f5-91eb-9ec4f7cf8655 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:31.463867 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b230f0a-2729-45f5-91eb-9ec4f7cf8655 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:31.464573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b230f0a-2729-45f5-91eb-9ec4f7cf8655 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:31.465069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b230f0a-2729-45f5-91eb-9ec4f7cf8655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:31.470760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b230f0a-2729-45f5-91eb-9ec4f7cf8655 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:31.471721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 498/997] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jun 1 17:26:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:31.480119 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b230f0a-2729-45f5-91eb-9ec4f7cf8655 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:31.562508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3594726-e17b-48f7-bb74-549453c1f289 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:31.583240 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b230f0a-2729-45f5-91eb-9ec4f7cf8655 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:31.601757 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee84978-601c-4e85-b90a-2123944f8f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:31.602680 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee84978-601c-4e85-b90a-2123944f8f96 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:31.603141 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee84978-601c-4e85-b90a-2123944f8f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:31.603640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee84978-601c-4e85-b90a-2123944f8f96 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:31.604523 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee84978-601c-4e85-b90a-2123944f8f96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:31.606100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee84978-601c-4e85-b90a-2123944f8f96 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:31.612984 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 500/998] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jun 1 17:26:31 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:26:31.628138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01672e13-d505-4fbf-a63b-c48702c19bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:31.628837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01672e13-d505-4fbf-a63b-c48702c19bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:31.629149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01672e13-d505-4fbf-a63b-c48702c19bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:31.629425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01672e13-d505-4fbf-a63b-c48702c19bb2 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:31.630148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01672e13-d505-4fbf-a63b-c48702c19bb2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:31.630456 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01672e13-d505-4fbf-a63b-c48702c19bb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:31.631896 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01672e13-d505-4fbf-a63b-c48702c19bb2 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:31.637991 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 499/999] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jun 1 17:26:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:31.644768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee84978-601c-4e85-b90a-2123944f8f96 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:31.724857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:31.758831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee84978-601c-4e85-b90a-2123944f8f96 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:31.796666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dc3ad-b089-4b7d-8e54-ed80305ae62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:31.797374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dc3ad-b089-4b7d-8e54-ed80305ae62b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:31.797659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dc3ad-b089-4b7d-8e54-ed80305ae62b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:31.797935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dc3ad-b089-4b7d-8e54-ed80305ae62b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:31.798744 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dc3ad-b089-4b7d-8e54-ed80305ae62b None admin] RBAC: Adding query filter params (interface=public, service_id=1269a069a95d40e793a444917766e793, region_id=RegionOne) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:31.799057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dc3ad-b089-4b7d-8e54-ed80305ae62b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:31.800459 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97dc3ad-b089-4b7d-8e54-ed80305ae62b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:31.806704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 501/1000] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jun 1 17:26:31 2022] GET /identity/v3/endpoints?service_id=1269a069a95d40e793a444917766e793&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:31.812975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01672e13-d505-4fbf-a63b-c48702c19bb2 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:31.850752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:31.922117 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01672e13-d505-4fbf-a63b-c48702c19bb2 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:31.955509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca94132-3440-481d-a136-6f7a2078cbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:31.956180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca94132-3440-481d-a136-6f7a2078cbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:31.956467 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca94132-3440-481d-a136-6f7a2078cbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:31.956747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca94132-3440-481d-a136-6f7a2078cbe1 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:31.957471 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca94132-3440-481d-a136-6f7a2078cbe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:31.958845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca94132-3440-481d-a136-6f7a2078cbe1 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:31.965210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 500/1001] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jun 1 17:26:31 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:26:32.801494 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48a16d-2546-4382-bfbd-0cde9e5c948c None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:32.802020 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48a16d-2546-4382-bfbd-0cde9e5c948c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:32.802132 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48a16d-2546-4382-bfbd-0cde9e5c948c None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:32.803453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 502/1002] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:32.808610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc060b7-091a-4c41-af31-07081130975c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:32.808910 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc060b7-091a-4c41-af31-07081130975c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:32.809222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc060b7-091a-4c41-af31-07081130975c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:32.826753 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-bcc060b7-091a-4c41-af31-07081130975c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:32.827944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-bcc060b7-091a-4c41-af31-07081130975c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:32.898403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 501/1003] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:32.921655 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48a16d-2546-4382-bfbd-0cde9e5c948c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:33.026128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48a16d-2546-4382-bfbd-0cde9e5c948c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:33.060305 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4f686-d9dd-4978-b147-7392c68df4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:33.060907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4f686-d9dd-4978-b147-7392c68df4c4 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:33.061219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4f686-d9dd-4978-b147-7392c68df4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:33.061496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4f686-d9dd-4978-b147-7392c68df4c4 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:33.062311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4f686-d9dd-4978-b147-7392c68df4c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:33.063699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4f686-d9dd-4978-b147-7392c68df4c4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:33.066671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:33.221495 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 503/1004] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jun 1 17:26:32 2022] POST /identity/v3/services => generated 242 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:26:33.913651 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c03cb3-91eb-4ec6-a28e-62e6068e2cae None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:33.914228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c03cb3-91eb-4ec6-a28e-62e6068e2cae None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:33.914228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c03cb3-91eb-4ec6-a28e-62e6068e2cae None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:33.915876 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 502/1005] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:33.922098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559e25-dd70-40af-b40f-4c1de040c4a3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:33.922642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559e25-dd70-40af-b40f-4c1de040c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:33.922642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559e25-dd70-40af-b40f-4c1de040c4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:33.940474 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6e559e25-dd70-40af-b40f-4c1de040c4a3 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:33.941705 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6e559e25-dd70-40af-b40f-4c1de040c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:34.015554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 504/1006] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:33 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:34.038116 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c03cb3-91eb-4ec6-a28e-62e6068e2cae None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:34.064162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:34.141395 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c03cb3-91eb-4ec6-a28e-62e6068e2cae None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:34.175151 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811369f-27af-44ff-9915-3ede8614c992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:34.175878 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811369f-27af-44ff-9915-3ede8614c992 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:34.176165 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811369f-27af-44ff-9915-3ede8614c992 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:34.176446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811369f-27af-44ff-9915-3ede8614c992 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:34.177133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811369f-27af-44ff-9915-3ede8614c992 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:34.178498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811369f-27af-44ff-9915-3ede8614c992 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-7811369f-27af-44ff-9915-3ede8614c992 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:34.190826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:34.191907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:34.192782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:34.192782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:34.192782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:34.192782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:34.192782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:34.192782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:34.192782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:34.192782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:34.192782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:34.192782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:34.192782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:34.192782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:34.192782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 01 17:26:34.192782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:34.194211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 503/1007] 10.222.0.33 () {56 vars in 1126 bytes} [Wed Jun 1 17:26:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:34.198125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559e25-dd70-40af-b40f-4c1de040c4a3 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:34.244004 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91431d2b-fd47-4f5a-b69c-ce694b900ec1 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:34.244435 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91431d2b-fd47-4f5a-b69c-ce694b900ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:34.244715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91431d2b-fd47-4f5a-b69c-ce694b900ec1 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:34.246198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 504/1008] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:26:34.252687 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082c49c-f8e8-4ce2-a190-59e7e0978630 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:34.253014 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082c49c-f8e8-4ce2-a190-59e7e0978630 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:34.253306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082c49c-f8e8-4ce2-a190-59e7e0978630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:34.270444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-1082c49c-f8e8-4ce2-a190-59e7e0978630 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:34.271639 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-1082c49c-f8e8-4ce2-a190-59e7e0978630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:34.308195 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559e25-dd70-40af-b40f-4c1de040c4a3 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:34.332214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:34.342064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 505/1009] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:34 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:34.346983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dd8b4-8f12-4c5b-a211-68c613e49eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:34.347691 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dd8b4-8f12-4c5b-a211-68c613e49eea None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:34.351320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dd8b4-8f12-4c5b-a211-68c613e49eea None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:34.351320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dd8b4-8f12-4c5b-a211-68c613e49eea None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:34.351320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dd8b4-8f12-4c5b-a211-68c613e49eea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:34.351320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dd8b4-8f12-4c5b-a211-68c613e49eea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:34.351320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dd8b4-8f12-4c5b-a211-68c613e49eea None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:34.356302 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 505/1010] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jun 1 17:26:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:34.362594 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082c49c-f8e8-4ce2-a190-59e7e0978630 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:34.366176 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dd8b4-8f12-4c5b-a211-68c613e49eea None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:34.386550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:34.479811 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082c49c-f8e8-4ce2-a190-59e7e0978630 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:34.486656 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dd8b4-8f12-4c5b-a211-68c613e49eea None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:34.518487 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945c3e4-f067-40b5-872b-484b014a4a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:34.519155 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945c3e4-f067-40b5-872b-484b014a4a8e None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:34.519439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945c3e4-f067-40b5-872b-484b014a4a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:34.519715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945c3e4-f067-40b5-872b-484b014a4a8e None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:34.520615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945c3e4-f067-40b5-872b-484b014a4a8e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:34.520930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945c3e4-f067-40b5-872b-484b014a4a8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:34.522517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945c3e4-f067-40b5-872b-484b014a4a8e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:34.522998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c4287-39cd-48c6-8925-aaf577533f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:34.523802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c4287-39cd-48c6-8925-aaf577533f60 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:34.524088 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c4287-39cd-48c6-8925-aaf577533f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:34.524366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c4287-39cd-48c6-8925-aaf577533f60 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:34.525051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c4287-39cd-48c6-8925-aaf577533f60 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:34.526411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c4287-39cd-48c6-8925-aaf577533f60 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:34.532886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 506/1011] 10.222.0.33 () {56 vars in 1122 bytes} [Wed Jun 1 17:26:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:34.533748 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945c3e4-f067-40b5-872b-484b014a4a8e None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-464c4287-39cd-48c6-8925-aaf577533f60 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:34.543664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:34.545602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:34.546622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:34.546622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:34.546622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:34.546622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:34.546622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:34.546622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:34.546622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:34.546622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:34.546622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:34.546622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:34.546622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:34.546622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:34.546622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 01 17:26:34.546622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:34.546622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 506/1012] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:34.551387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c4287-39cd-48c6-8925-aaf577533f60 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:34.604354 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:34.629774 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:34.648706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945c3e4-f067-40b5-872b-484b014a4a8e None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:34.656692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c4287-39cd-48c6-8925-aaf577533f60 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:34.686534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e091f2d-31f2-486b-9968-8f6e7d5cb864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:34.687392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e091f2d-31f2-486b-9968-8f6e7d5cb864 None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:34.687682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e091f2d-31f2-486b-9968-8f6e7d5cb864 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:34.687963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e091f2d-31f2-486b-9968-8f6e7d5cb864 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:34.688713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e091f2d-31f2-486b-9968-8f6e7d5cb864 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:34.690128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e091f2d-31f2-486b-9968-8f6e7d5cb864 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:34.691943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08f8e7-de0e-45f8-9ae2-4868599f784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:34.692568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08f8e7-de0e-45f8-9ae2-4868599f784f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:34.693077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08f8e7-de0e-45f8-9ae2-4868599f784f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:34.693183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08f8e7-de0e-45f8-9ae2-4868599f784f None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:34.693848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08f8e7-de0e-45f8-9ae2-4868599f784f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:34.694153 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08f8e7-de0e-45f8-9ae2-4868599f784f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:34.695647 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08f8e7-de0e-45f8-9ae2-4868599f784f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:34.700659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 507/1013] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jun 1 17:26:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:34.706705 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08f8e7-de0e-45f8-9ae2-4868599f784f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:34.780970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 507/1014] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jun 1 17:26:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:26:34.814749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08f8e7-de0e-45f8-9ae2-4868599f784f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:34.830215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:34.861916 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f3283-b0a2-462c-b386-90d787785c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:34.862615 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f3283-b0a2-462c-b386-90d787785c10 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:34.862898 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f3283-b0a2-462c-b386-90d787785c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:34.863173 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f3283-b0a2-462c-b386-90d787785c10 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:34.863918 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f3283-b0a2-462c-b386-90d787785c10 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:34.864228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f3283-b0a2-462c-b386-90d787785c10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:34.865668 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f3283-b0a2-462c-b386-90d787785c10 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:34.876383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 508/1015] 10.222.0.33 () {56 vars in 1112 bytes} [Wed Jun 1 17:26:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:34.877938 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e091f2d-31f2-486b-9968-8f6e7d5cb864 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:34.991908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e091f2d-31f2-486b-9968-8f6e7d5cb864 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:35.029318 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759891f-73ee-4283-88cf-4b053eba79f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:35.029994 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759891f-73ee-4283-88cf-4b053eba79f3 None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:35.030278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759891f-73ee-4283-88cf-4b053eba79f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:35.030555 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759891f-73ee-4283-88cf-4b053eba79f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:35.031368 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759891f-73ee-4283-88cf-4b053eba79f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:35.032683 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759891f-73ee-4283-88cf-4b053eba79f3 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:35.100804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:35.108585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 508/1016] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jun 1 17:26:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:26:35.532648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b4500-1042-4fed-ac1a-1625a4498f5e None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:35.533212 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b4500-1042-4fed-ac1a-1625a4498f5e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:35.533212 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b4500-1042-4fed-ac1a-1625a4498f5e None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:35.534607 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 509/1017] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:35.539670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9612228-b2b1-41bb-a70c-853727d4228b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:35.539963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9612228-b2b1-41bb-a70c-853727d4228b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:35.540243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9612228-b2b1-41bb-a70c-853727d4228b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:35.557747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-d9612228-b2b1-41bb-a70c-853727d4228b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:35.558952 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d9612228-b2b1-41bb-a70c-853727d4228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:35.632789 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 509/1018] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:35.655886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b4500-1042-4fed-ac1a-1625a4498f5e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:35.762533 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b4500-1042-4fed-ac1a-1625a4498f5e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:35.797672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b64b17-95c6-458a-ac57-a69707e7e0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:35.798468 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b64b17-95c6-458a-ac57-a69707e7e0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:35.798750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b64b17-95c6-458a-ac57-a69707e7e0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:35.799026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b64b17-95c6-458a-ac57-a69707e7e0d2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:35.799677 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b64b17-95c6-458a-ac57-a69707e7e0d2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:35.801072 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b64b17-95c6-458a-ac57-a69707e7e0d2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-69b64b17-95c6-458a-ac57-a69707e7e0d2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:35.812585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:35.813781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:35.814720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:35.814720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:35.814720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:35.814720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:35.814720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:35.814720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:35.814720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:35.814720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:35.814720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:35.814720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:35.814720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:35.814720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:35.814720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 17:26:35.814720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:35.814720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 510/1019] 10.222.0.33 () {56 vars in 1105 bytes} [Wed Jun 1 17:26:35 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:35.820996 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9612228-b2b1-41bb-a70c-853727d4228b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:35.921578 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9612228-b2b1-41bb-a70c-853727d4228b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:35.946120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:35.959082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b94ee5-7d6c-4697-99b3-1f67b8953a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:35.961581 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b94ee5-7d6c-4697-99b3-1f67b8953a1c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:35.961581 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b94ee5-7d6c-4697-99b3-1f67b8953a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:35.961581 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b94ee5-7d6c-4697-99b3-1f67b8953a1c None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:35.961581 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b94ee5-7d6c-4697-99b3-1f67b8953a1c None admin] RBAC: Adding query filter params (name=image) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:35.961581 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b94ee5-7d6c-4697-99b3-1f67b8953a1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:35.962845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b94ee5-7d6c-4697-99b3-1f67b8953a1c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:35.968489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 510/1020] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:35.973872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b64b17-95c6-458a-ac57-a69707e7e0d2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:36.015854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:36.077226 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b64b17-95c6-458a-ac57-a69707e7e0d2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:36.111684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493503b4-b6c8-49c6-9939-29f4c1dbeb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:36.112353 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493503b4-b6c8-49c6-9939-29f4c1dbeb24 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:36.112638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493503b4-b6c8-49c6-9939-29f4c1dbeb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:36.112914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493503b4-b6c8-49c6-9939-29f4c1dbeb24 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:36.113644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493503b4-b6c8-49c6-9939-29f4c1dbeb24 None admin] RBAC: Adding query filter params (type=image) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:36.113955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493503b4-b6c8-49c6-9939-29f4c1dbeb24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:36.115330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493503b4-b6c8-49c6-9939-29f4c1dbeb24 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:36.120342 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 511/1021] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:36.126066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b94ee5-7d6c-4697-99b3-1f67b8953a1c None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:36.223827 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b94ee5-7d6c-4697-99b3-1f67b8953a1c None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:36.257425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c5395-8456-4398-bfa1-cd0b8d8b86aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:36.258087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c5395-8456-4398-bfa1-cd0b8d8b86aa None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:36.258370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c5395-8456-4398-bfa1-cd0b8d8b86aa None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:36.258645 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c5395-8456-4398-bfa1-cd0b8d8b86aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:36.259422 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c5395-8456-4398-bfa1-cd0b8d8b86aa None admin] RBAC: Adding query filter params (interface=public, service_id=a706af8cf996487a9958f9ff86cb4d33, region_id=RegionOne) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:36.259735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c5395-8456-4398-bfa1-cd0b8d8b86aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:36.261127 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c5395-8456-4398-bfa1-cd0b8d8b86aa None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:36.266958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 511/1022] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jun 1 17:26:36 2022] GET /identity/v3/endpoints?service_id=a706af8cf996487a9958f9ff86cb4d33&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:36.272146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493503b4-b6c8-49c6-9939-29f4c1dbeb24 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:36.374481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493503b4-b6c8-49c6-9939-29f4c1dbeb24 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:36.376034 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:36.410501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beca96-5297-41fa-b4e2-b2b492b502ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:36.411175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beca96-5297-41fa-b4e2-b2b492b502ad None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:36.411467 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beca96-5297-41fa-b4e2-b2b492b502ad None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:36.411750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beca96-5297-41fa-b4e2-b2b492b502ad None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:36.412437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95beca96-5297-41fa-b4e2-b2b492b502ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:36.413836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95beca96-5297-41fa-b4e2-b2b492b502ad None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:36.429023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 512/1023] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jun 1 17:26:36 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:26:37.108807 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd235a4-1a59-4971-a7f6-585d1f95692d None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:37.109191 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd235a4-1a59-4971-a7f6-585d1f95692d None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:37.109409 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd235a4-1a59-4971-a7f6-585d1f95692d None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:37.110854 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 512/1024] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:37.116123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e17685-aff1-4b07-8189-9e3bc70c309d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:37.116564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e17685-aff1-4b07-8189-9e3bc70c309d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:37.116657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e17685-aff1-4b07-8189-9e3bc70c309d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:37.133713 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-75e17685-aff1-4b07-8189-9e3bc70c309d None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:37.134883 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-75e17685-aff1-4b07-8189-9e3bc70c309d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:37.207021 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 513/1025] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:37.230700 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd235a4-1a59-4971-a7f6-585d1f95692d None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:37.288184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:37.335184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd235a4-1a59-4971-a7f6-585d1f95692d None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:37.375684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f7a1c-1bcb-4d9e-a917-068ada511990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:37.376453 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7a1c-1bcb-4d9e-a917-068ada511990 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:37.376737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7a1c-1bcb-4d9e-a917-068ada511990 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:37.377036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7a1c-1bcb-4d9e-a917-068ada511990 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:37.378283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f7a1c-1bcb-4d9e-a917-068ada511990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:37.379720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f7a1c-1bcb-4d9e-a917-068ada511990 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:37.386069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 513/1026] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:37.387328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e17685-aff1-4b07-8189-9e3bc70c309d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:37.494540 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:37.501412 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da6161-c78a-49dc-b3ac-96f9b5132aac None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:37.501699 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da6161-c78a-49dc-b3ac-96f9b5132aac None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:37.501975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da6161-c78a-49dc-b3ac-96f9b5132aac None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:37.502314 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e17685-aff1-4b07-8189-9e3bc70c309d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:37.503453 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 514/1027] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:37.508241 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aca36f-194b-4269-a19e-63abd383601c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:37.508531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aca36f-194b-4269-a19e-63abd383601c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:37.509007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aca36f-194b-4269-a19e-63abd383601c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:37.525689 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-35aca36f-194b-4269-a19e-63abd383601c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:37.527034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-35aca36f-194b-4269-a19e-63abd383601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:37.539431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c40ca-ed03-4812-a0c0-7fd54cb0228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:37.540101 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c40ca-ed03-4812-a0c0-7fd54cb0228c None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:37.540388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c40ca-ed03-4812-a0c0-7fd54cb0228c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:37.540669 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c40ca-ed03-4812-a0c0-7fd54cb0228c None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:37.541533 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c40ca-ed03-4812-a0c0-7fd54cb0228c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:37.543120 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c40ca-ed03-4812-a0c0-7fd54cb0228c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:37.596708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 515/1028] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:37.620850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aca36f-194b-4269-a19e-63abd383601c None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:37.672113 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 514/1029] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jun 1 17:26:37 2022] POST /identity/v3/projects => generated 311 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:26:37.672977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:37.730863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aca36f-194b-4269-a19e-63abd383601c None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:37.769239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa967a8-b7eb-4c1c-ad66-5a1ba41bb8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:37.770070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa967a8-b7eb-4c1c-ad66-5a1ba41bb8ed None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:37.770353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa967a8-b7eb-4c1c-ad66-5a1ba41bb8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:37.770628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa967a8-b7eb-4c1c-ad66-5a1ba41bb8ed None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:37.782967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa967a8-b7eb-4c1c-ad66-5a1ba41bb8ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-6fa967a8-b7eb-4c1c-ad66-5a1ba41bb8ed None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:26:37.791366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:37.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:37.793621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:37.793621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:37.793621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:37.793621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:37.793621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:26:37.793621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:26:37.793621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:26:37.793621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:26:37.793621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:26:37.793621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:26:37.793621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 17:26:37.793621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:37.793621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 516/1030] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Jun 1 17:26:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:37.801616 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c40ca-ed03-4812-a0c0-7fd54cb0228c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:37.923049 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c40ca-ed03-4812-a0c0-7fd54cb0228c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:37.957158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44349e0-002e-43c8-8ac3-869f545f7a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:37.957843 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44349e0-002e-43c8-8ac3-869f545f7a15 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:37.958127 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44349e0-002e-43c8-8ac3-869f545f7a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:37.958407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44349e0-002e-43c8-8ac3-869f545f7a15 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:37.959164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44349e0-002e-43c8-8ac3-869f545f7a15 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:37.959477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44349e0-002e-43c8-8ac3-869f545f7a15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:37.960866 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44349e0-002e-43c8-8ac3-869f545f7a15 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:37.971173 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 515/1031] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Jun 1 17:26:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:37.976322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa967a8-b7eb-4c1c-ad66-5a1ba41bb8ed None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:38.082379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa967a8-b7eb-4c1c-ad66-5a1ba41bb8ed None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:38.094156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:38.118780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeba974-8eec-45ca-860d-6a92d427f7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:38.119587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeba974-8eec-45ca-860d-6a92d427f7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:38.119874 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeba974-8eec-45ca-860d-6a92d427f7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:38.120153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeba974-8eec-45ca-860d-6a92d427f7c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:38.131102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeba974-8eec-45ca-860d-6a92d427f7c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:38.132599 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeba974-8eec-45ca-860d-6a92d427f7c7 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:38.151522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-4eeba974-8eec-45ca-860d-6a92d427f7c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:38.151522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:38.151522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:38.151522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:38.151522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:38.151522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:38.151522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:38.151522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:38.151522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:38.151522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:38.151522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:38.151522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:38.151522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:38.151522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:38.151522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:38.152508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:38.154104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:38.154104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:38.154104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:38.154104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:38.157021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 517/1032] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:38.159495 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44349e0-002e-43c8-8ac3-869f545f7a15 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:38.173290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:38.264236 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44349e0-002e-43c8-8ac3-869f545f7a15 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:38.298860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da945d-8c32-4a9d-ab35-0987bd12eb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:38.299533 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da945d-8c32-4a9d-ab35-0987bd12eb6a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:38.299877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da945d-8c32-4a9d-ab35-0987bd12eb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:38.300159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da945d-8c32-4a9d-ab35-0987bd12eb6a None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:38.300929 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da945d-8c32-4a9d-ab35-0987bd12eb6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:38.301262 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da945d-8c32-4a9d-ab35-0987bd12eb6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:38.302635 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da945d-8c32-4a9d-ab35-0987bd12eb6a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:38.319300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 516/1033] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:38.320896 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeba974-8eec-45ca-860d-6a92d427f7c7 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:38.430195 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeba974-8eec-45ca-860d-6a92d427f7c7 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:38.469510 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0713c9-c6db-4de0-80e5-0f6ceaa8bf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:38.470320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0713c9-c6db-4de0-80e5-0f6ceaa8bf6d None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:38.470608 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0713c9-c6db-4de0-80e5-0f6ceaa8bf6d None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:38.470891 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0713c9-c6db-4de0-80e5-0f6ceaa8bf6d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:38.481400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0713c9-c6db-4de0-80e5-0f6ceaa8bf6d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:38.483291 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0713c9-c6db-4de0-80e5-0f6ceaa8bf6d None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-7c0713c9-c6db-4de0-80e5-0f6ceaa8bf6d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:26:38.498439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:38.499397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:38.500378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:38.500378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:38.500378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:26:38.500378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:26:38.500378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:26:38.500378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:26:38.500378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:26:38.500378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:26:38.500378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:26:38.500378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:38.500378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 518/1034] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jun 1 17:26:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:38.506970 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da945d-8c32-4a9d-ab35-0987bd12eb6a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:38.578626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:38.609956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da945d-8c32-4a9d-ab35-0987bd12eb6a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:38.646353 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409eef85-0e28-4b37-a0bf-c3203b2bb601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:38.647029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eef85-0e28-4b37-a0bf-c3203b2bb601 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:38.647325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eef85-0e28-4b37-a0bf-c3203b2bb601 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:38.647608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eef85-0e28-4b37-a0bf-c3203b2bb601 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:38.648443 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409eef85-0e28-4b37-a0bf-c3203b2bb601 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:38.648755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409eef85-0e28-4b37-a0bf-c3203b2bb601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:38.650224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409eef85-0e28-4b37-a0bf-c3203b2bb601 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:38.672484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 517/1035] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jun 1 17:26:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:38.674095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0713c9-c6db-4de0-80e5-0f6ceaa8bf6d None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:38.701268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:38.711639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fdf48-1935-410d-b6f4-e1e0a373bb7f None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:38.714630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fdf48-1935-410d-b6f4-e1e0a373bb7f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:38.714630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fdf48-1935-410d-b6f4-e1e0a373bb7f None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:38.714630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 518/1036] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:26:38.718483 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7748b-3e9c-4f05-be5f-3915eb4c7c80 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:38.718777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7748b-3e9c-4f05-be5f-3915eb4c7c80 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:38.719059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7748b-3e9c-4f05-be5f-3915eb4c7c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:38.736109 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-88f7748b-3e9c-4f05-be5f-3915eb4c7c80 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:38.737384 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-88f7748b-3e9c-4f05-be5f-3915eb4c7c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:38.793317 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0713c9-c6db-4de0-80e5-0f6ceaa8bf6d None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:38.811040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 519/1037] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:38.832093 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49673f-ea04-4a37-9548-46108365797e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:38.832972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49673f-ea04-4a37-9548-46108365797e None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:38.833266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49673f-ea04-4a37-9548-46108365797e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:38.833549 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49673f-ea04-4a37-9548-46108365797e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:38.833752 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7748b-3e9c-4f05-be5f-3915eb4c7c80 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:38.906246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:38.908962 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49673f-ea04-4a37-9548-46108365797e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:38.910434 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49673f-ea04-4a37-9548-46108365797e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:38.937476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:38.950167 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7748b-3e9c-4f05-be5f-3915eb4c7c80 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:38.988234 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8063287-d145-49e6-8331-ef6aa7f0ce1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:38.988966 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8063287-d145-49e6-8331-ef6aa7f0ce1a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:38.989274 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8063287-d145-49e6-8331-ef6aa7f0ce1a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:38.989551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8063287-d145-49e6-8331-ef6aa7f0ce1a None admin] PATH_INFO: `/v3/services/image` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:38.990211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8063287-d145-49e6-8331-ef6aa7f0ce1a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:38.991611 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8063287-d145-49e6-8331-ef6aa7f0ce1a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-d8063287-d145-49e6-8331-ef6aa7f0ce1a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:39.004399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:39.005512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:39.006355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:39.006355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:39.006355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:39.006355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:39.006355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:39.006355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:39.006355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:39.006355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:39.006355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:39.006355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:39.006355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:26:39.006355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:26:39.006355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 01 17:26:39.006355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:39.006355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 520/1038] 10.222.0.33 () {56 vars in 1105 bytes} [Wed Jun 1 17:26:38 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:39.012250 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8063287-d145-49e6-8331-ef6aa7f0ce1a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:39.020618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 519/1039] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:26:38 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:26:39.026381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49673f-ea04-4a37-9548-46108365797e None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:39.126695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8063287-d145-49e6-8331-ef6aa7f0ce1a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:39.131330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49673f-ea04-4a37-9548-46108365797e None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:39.151640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:39.158671 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:39.164317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7806b-20fc-4f0d-8e06-294ec5ba714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:39.165008 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7806b-20fc-4f0d-8e06-294ec5ba714b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:39.171191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7806b-20fc-4f0d-8e06-294ec5ba714b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:39.171191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7806b-20fc-4f0d-8e06-294ec5ba714b None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:39.171191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7806b-20fc-4f0d-8e06-294ec5ba714b None admin] RBAC: Adding query filter params (name=image) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:39.171191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7806b-20fc-4f0d-8e06-294ec5ba714b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:39.171191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7806b-20fc-4f0d-8e06-294ec5ba714b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:39.173623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 521/1040] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:39.177061 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2566992-19d0-4338-ac28-494d59bd7c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:39.177869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2566992-19d0-4338-ac28-494d59bd7c85 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:39.178159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2566992-19d0-4338-ac28-494d59bd7c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:39.178436 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2566992-19d0-4338-ac28-494d59bd7c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:39.179790 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7806b-20fc-4f0d-8e06-294ec5ba714b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:39.189445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2566992-19d0-4338-ac28-494d59bd7c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:39.190912 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2566992-19d0-4338-ac28-494d59bd7c85 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:39.209925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-a2566992-19d0-4338-ac28-494d59bd7c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:39.209925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:39.209925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:39.209925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:39.209925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:39.209925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:39.209925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:39.209925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:39.209925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:39.209925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:39.209925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:39.209925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:39.209925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:39.209925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:39.209925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:39.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:39.212821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:39.212821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:39.212821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:39.212821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:39.212821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 520/1041] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:39.216669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2566992-19d0-4338-ac28-494d59bd7c85 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:39.289951 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7806b-20fc-4f0d-8e06-294ec5ba714b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:39.319761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2566992-19d0-4338-ac28-494d59bd7c85 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:39.325972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1541f-8643-4b05-9b0e-a7715cab5340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:39.326639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1541f-8643-4b05-9b0e-a7715cab5340 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:39.326921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1541f-8643-4b05-9b0e-a7715cab5340 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:39.327199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1541f-8643-4b05-9b0e-a7715cab5340 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:39.328037 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1541f-8643-4b05-9b0e-a7715cab5340 None admin] RBAC: Adding query filter params (type=image) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:39.328345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1541f-8643-4b05-9b0e-a7715cab5340 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:39.329876 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1541f-8643-4b05-9b0e-a7715cab5340 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:39.335161 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 522/1042] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:39.340900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1541f-8643-4b05-9b0e-a7715cab5340 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:39.363686 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6e870-3a3f-42e6-a152-b281c8f7510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:39.364556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6e870-3a3f-42e6-a152-b281c8f7510e None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:39.365195 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6e870-3a3f-42e6-a152-b281c8f7510e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:39.365556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6e870-3a3f-42e6-a152-b281c8f7510e None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:39.366297 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6e870-3a3f-42e6-a152-b281c8f7510e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:39.366607 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6e870-3a3f-42e6-a152-b281c8f7510e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:39.367990 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6e870-3a3f-42e6-a152-b281c8f7510e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:39.380974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 521/1043] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:39.387638 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6e870-3a3f-42e6-a152-b281c8f7510e None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:39.405927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:39.428253 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:39.461670 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1541f-8643-4b05-9b0e-a7715cab5340 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:39.500602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17eae5d-7601-4bfd-bc3f-918807c3e204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:39.501522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17eae5d-7601-4bfd-bc3f-918807c3e204 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:39.501965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17eae5d-7601-4bfd-bc3f-918807c3e204 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:39.502244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17eae5d-7601-4bfd-bc3f-918807c3e204 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:39.502987 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17eae5d-7601-4bfd-bc3f-918807c3e204 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:39.504356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17eae5d-7601-4bfd-bc3f-918807c3e204 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:39.506905 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6e870-3a3f-42e6-a152-b281c8f7510e None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:39.542685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da9dd6-fd4c-4c05-bbfb-6ddcb16b9d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:39.543422 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da9dd6-fd4c-4c05-bbfb-6ddcb16b9d63 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:39.543704 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da9dd6-fd4c-4c05-bbfb-6ddcb16b9d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:39.544560 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da9dd6-fd4c-4c05-bbfb-6ddcb16b9d63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:39.551287 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da9dd6-fd4c-4c05-bbfb-6ddcb16b9d63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:39.552728 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da9dd6-fd4c-4c05-bbfb-6ddcb16b9d63 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:39.567222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-17da9dd6-fd4c-4c05-bbfb-6ddcb16b9d63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:39.567222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:39.567222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:39.567222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:39.567222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:39.567222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:39.567222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:39.567222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:39.567222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:39.567222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:39.567222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:39.567222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:39.567222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:26:39.567222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:26:39.567222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:39.569836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:39.570953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:26:39.570953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:26:39.570953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:26:39.570953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:26:39.570953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:26:39.570953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:26:39.570953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:39.570953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:39.570953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 522/1044] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:39.574257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da9dd6-fd4c-4c05-bbfb-6ddcb16b9d63 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:39.613678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 523/1045] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jun 1 17:26:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:26:39.713089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:39.722589 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da9dd6-fd4c-4c05-bbfb-6ddcb16b9d63 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:39.780287 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd950635-9b61-4c30-8c26-75c18236d50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:39.781394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd950635-9b61-4c30-8c26-75c18236d50c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:39.781901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd950635-9b61-4c30-8c26-75c18236d50c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:39.782316 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd950635-9b61-4c30-8c26-75c18236d50c None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:39.783298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd950635-9b61-4c30-8c26-75c18236d50c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:39.783761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd950635-9b61-4c30-8c26-75c18236d50c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:39.785418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd950635-9b61-4c30-8c26-75c18236d50c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:39.800624 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 523/1046] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:26:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:39.809033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17eae5d-7601-4bfd-bc3f-918807c3e204 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:39.923729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17eae5d-7601-4bfd-bc3f-918807c3e204 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:39.933317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:39.958301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371162c-14cd-4c6a-892a-82b76caf283c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:39.959177 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371162c-14cd-4c6a-892a-82b76caf283c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:39.959568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371162c-14cd-4c6a-892a-82b76caf283c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:39.959950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371162c-14cd-4c6a-892a-82b76caf283c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:39.960892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371162c-14cd-4c6a-892a-82b76caf283c None admin] RBAC: Adding query filter params (role.id=1d49fbf041c949b2a9b2d7f173d4228c, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=5d5a5ba6aecd46e79dc7199589384a4f) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:39.961344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371162c-14cd-4c6a-892a-82b76caf283c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:39.962882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371162c-14cd-4c6a-892a-82b76caf283c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:39.976636 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 524/1047] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:26:39 2022] GET /identity/v3/role_assignments?user.id=5d5a5ba6aecd46e79dc7199589384a4f&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=1d49fbf041c949b2a9b2d7f173d4228c => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:40.049350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a605b9-6a8c-4006-af75-561f70752623 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:40.049632 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a605b9-6a8c-4006-af75-561f70752623 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:40.049913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a605b9-6a8c-4006-af75-561f70752623 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:40.051540 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 524/1048] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:40.057162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4264638-7e31-4fc9-a2ae-9b52fbb1fb34 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:40.057449 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4264638-7e31-4fc9-a2ae-9b52fbb1fb34 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:40.057719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4264638-7e31-4fc9-a2ae-9b52fbb1fb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:40.076235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f4264638-7e31-4fc9-a2ae-9b52fbb1fb34 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:40.077533 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f4264638-7e31-4fc9-a2ae-9b52fbb1fb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:40.156975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 525/1049] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:40.182231 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a605b9-6a8c-4006-af75-561f70752623 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:40.290812 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a605b9-6a8c-4006-af75-561f70752623 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:40.324384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e961d34-1243-4ba0-bce2-186de4061ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:40.325651 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e961d34-1243-4ba0-bce2-186de4061ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:40.325960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e961d34-1243-4ba0-bce2-186de4061ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:40.326236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e961d34-1243-4ba0-bce2-186de4061ff9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:40.327407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e961d34-1243-4ba0-bce2-186de4061ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:40.328851 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e961d34-1243-4ba0-bce2-186de4061ff9 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:40.335153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 525/1050] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:40.336301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4264638-7e31-4fc9-a2ae-9b52fbb1fb34 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:40.440106 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:40.444308 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4264638-7e31-4fc9-a2ae-9b52fbb1fb34 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:40.489279 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d26ea-964f-45c2-bfd1-283cf0447e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:40.489968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d26ea-964f-45c2-bfd1-283cf0447e42 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:40.490259 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d26ea-964f-45c2-bfd1-283cf0447e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:40.490542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d26ea-964f-45c2-bfd1-283cf0447e42 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:40.491258 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d26ea-964f-45c2-bfd1-283cf0447e42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:40.492717 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d26ea-964f-45c2-bfd1-283cf0447e42 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:40.586337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 526/1051] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:26:40 2022] POST /identity/v3/users => generated 285 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:26:41.996476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9716f-839a-413c-938f-b5671c9f02be None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:41.997182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9716f-839a-413c-938f-b5671c9f02be None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:41.997182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9716f-839a-413c-938f-b5671c9f02be None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:41.998470 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 526/1052] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:42.003897 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684da854-d1fb-4ad9-a350-31cd00d7a6b6 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:42.004320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684da854-d1fb-4ad9-a350-31cd00d7a6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:42.004484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684da854-d1fb-4ad9-a350-31cd00d7a6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:42.022472 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-684da854-d1fb-4ad9-a350-31cd00d7a6b6 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:42.023641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-684da854-d1fb-4ad9-a350-31cd00d7a6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:42.092969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 527/1053] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:42.113630 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9716f-839a-413c-938f-b5671c9f02be None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:42.134565 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:42.223373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9716f-839a-413c-938f-b5671c9f02be None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:42.258758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f9ff7-4f62-48b4-81a0-fb848675af1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:42.259782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f9ff7-4f62-48b4-81a0-fb848675af1a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:42.260264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f9ff7-4f62-48b4-81a0-fb848675af1a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:42.260730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f9ff7-4f62-48b4-81a0-fb848675af1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:42.272840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2b7d9-f7f9-4991-9ae3-efd8dda4aa57 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:42.273158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2b7d9-f7f9-4991-9ae3-efd8dda4aa57 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:42.273436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2b7d9-f7f9-4991-9ae3-efd8dda4aa57 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:42.275058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 528/1054] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:42.280346 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dd923-81d8-419c-8deb-01e418d34cdf None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:42.280634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dd923-81d8-419c-8deb-01e418d34cdf None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:42.280913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dd923-81d8-419c-8deb-01e418d34cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:42.297414 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-eb7dd923-81d8-419c-8deb-01e418d34cdf None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:42.298594 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-eb7dd923-81d8-419c-8deb-01e418d34cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:42.336245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f9ff7-4f62-48b4-81a0-fb848675af1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:42.337953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f9ff7-4f62-48b4-81a0-fb848675af1a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:42.356729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:42.366482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 529/1055] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:42.390058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dd923-81d8-419c-8deb-01e418d34cdf None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:42.408341 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:42.447905 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 527/1056] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:26:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:26:42.453852 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f9ff7-4f62-48b4-81a0-fb848675af1a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:42.508027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dd923-81d8-419c-8deb-01e418d34cdf None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:42.547652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323b4cd-211c-44ea-94d4-3bb706e36e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:42.548469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323b4cd-211c-44ea-94d4-3bb706e36e27 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:42.548750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323b4cd-211c-44ea-94d4-3bb706e36e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:42.549055 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323b4cd-211c-44ea-94d4-3bb706e36e27 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:42.559552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323b4cd-211c-44ea-94d4-3bb706e36e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:26:42.566012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f9ff7-4f62-48b4-81a0-fb848675af1a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-a323b4cd-211c-44ea-94d4-3bb706e36e27 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:26:42.567888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:42.568815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:42.569737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:42.569737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:42.569737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:42.569737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:42.569737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:26:42.569737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:26:42.569737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:26:42.569737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:26:42.569737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:26:42.569737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:26:42.569737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 17:26:42.569737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:42.569737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 530/1057] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Jun 1 17:26:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:42.574872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323b4cd-211c-44ea-94d4-3bb706e36e27 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:42.590228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:42.614401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543acb0-e8d1-4e40-88a2-79a3c707e214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:42.615213 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543acb0-e8d1-4e40-88a2-79a3c707e214 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:42.615501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543acb0-e8d1-4e40-88a2-79a3c707e214 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:42.615810 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543acb0-e8d1-4e40-88a2-79a3c707e214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:42.629305 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543acb0-e8d1-4e40-88a2-79a3c707e214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:42.630775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543acb0-e8d1-4e40-88a2-79a3c707e214 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:42.652054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-5543acb0-e8d1-4e40-88a2-79a3c707e214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:42.652054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:42.652054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:42.652054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:42.652054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:42.652054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:42.652054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:42.652054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:42.652054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:42.652054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:42.652054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:42.652054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:42.652054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:42.652054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:42.652054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:42.653210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:42.660180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:42.660180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:42.660180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:42.660180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:42.660180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 528/1058] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:42.660180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543acb0-e8d1-4e40-88a2-79a3c707e214 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:42.662065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:42.691048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323b4cd-211c-44ea-94d4-3bb706e36e27 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:42.728912 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fc8c9-2680-4d4e-bbd9-ffd725533c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:42.729626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fc8c9-2680-4d4e-bbd9-ffd725533c4b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:42.729907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fc8c9-2680-4d4e-bbd9-ffd725533c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:42.730196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fc8c9-2680-4d4e-bbd9-ffd725533c4b None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:42.730958 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fc8c9-2680-4d4e-bbd9-ffd725533c4b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:42.731319 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fc8c9-2680-4d4e-bbd9-ffd725533c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:42.732832 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fc8c9-2680-4d4e-bbd9-ffd725533c4b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:42.745431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 531/1059] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Jun 1 17:26:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:42.748626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fc8c9-2680-4d4e-bbd9-ffd725533c4b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:42.776209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543acb0-e8d1-4e40-88a2-79a3c707e214 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:42.813098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0021c-55f3-4bff-a386-841eeb297071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:42.813693 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0021c-55f3-4bff-a386-841eeb297071 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:42.813974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0021c-55f3-4bff-a386-841eeb297071 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:42.814249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0021c-55f3-4bff-a386-841eeb297071 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:42.814966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0021c-55f3-4bff-a386-841eeb297071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:42.815271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0021c-55f3-4bff-a386-841eeb297071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:42.816701 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0021c-55f3-4bff-a386-841eeb297071 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:42.857406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fc8c9-2680-4d4e-bbd9-ffd725533c4b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:42.893031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b1504-6e3c-4da4-9317-fa626bbf38aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:42.893836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b1504-6e3c-4da4-9317-fa626bbf38aa None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:42.894114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b1504-6e3c-4da4-9317-fa626bbf38aa None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:42.894390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b1504-6e3c-4da4-9317-fa626bbf38aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:42.901713 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:42.906861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b1504-6e3c-4da4-9317-fa626bbf38aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:42.908206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b1504-6e3c-4da4-9317-fa626bbf38aa None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:42.920229 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 529/1060] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:42.926862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-335b1504-6e3c-4da4-9317-fa626bbf38aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:42.926862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:42.926862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:42.926862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:42.926862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:42.926862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:42.926862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:42.926862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:42.926862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:42.926862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:42.926862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:42.926862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:42.926862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:42.926862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:42.926862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:42.927903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:42.928833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:42.928833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:42.928833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:42.928833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:42.929923 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 532/1061] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:42.934326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0021c-55f3-4bff-a386-841eeb297071 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:42.974502 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:43.026403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8f135-84fb-44dd-92e5-32c68b0fb1d0 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:43.027027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8f135-84fb-44dd-92e5-32c68b0fb1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:43.027248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8f135-84fb-44dd-92e5-32c68b0fb1d0 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:43.028674 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 533/1062] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:26:43.034820 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a10eea-13ac-4794-b07a-7c6c485e12a6 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:43.035126 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a10eea-13ac-4794-b07a-7c6c485e12a6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:43.035545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a10eea-13ac-4794-b07a-7c6c485e12a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:43.055693 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d2a10eea-13ac-4794-b07a-7c6c485e12a6 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:43.057978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d2a10eea-13ac-4794-b07a-7c6c485e12a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:43.065251 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0021c-55f3-4bff-a386-841eeb297071 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:43.117459 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8fb83-0a5b-4709-9c50-542d4d292498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:43.118332 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8fb83-0a5b-4709-9c50-542d4d292498 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:43.118833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8fb83-0a5b-4709-9c50-542d4d292498 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:43.119316 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8fb83-0a5b-4709-9c50-542d4d292498 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:43.120600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8fb83-0a5b-4709-9c50-542d4d292498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:43.121220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8fb83-0a5b-4709-9c50-542d4d292498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:43.123586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8fb83-0a5b-4709-9c50-542d4d292498 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:43.142205 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 530/1063] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:43.147290 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8fb83-0a5b-4709-9c50-542d4d292498 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:43.161845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 534/1064] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:43.188887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a10eea-13ac-4794-b07a-7c6c485e12a6 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:43.333354 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a10eea-13ac-4794-b07a-7c6c485e12a6 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:43.337412 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:43.348445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8fb83-0a5b-4709-9c50-542d4d292498 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:43.356867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:43.371264 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ece6a-5852-41e8-8200-e47e611d00d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:43.372065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ece6a-5852-41e8-8200-e47e611d00d6 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:43.372352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ece6a-5852-41e8-8200-e47e611d00d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:43.372628 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ece6a-5852-41e8-8200-e47e611d00d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:43.383459 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ece6a-5852-41e8-8200-e47e611d00d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:26:43.388450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5395e3e-9ca8-4f9b-af85-98eba0069276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:43.389296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5395e3e-9ca8-4f9b-af85-98eba0069276 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:43.389581 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5395e3e-9ca8-4f9b-af85-98eba0069276 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:43.389864 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5395e3e-9ca8-4f9b-af85-98eba0069276 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-540ece6a-5852-41e8-8200-e47e611d00d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:26:43.391888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:43.392903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:43.399441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:43.399441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:43.399441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:43.399441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:43.399441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:26:43.399441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:26:43.399441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:26:43.399441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:26:43.399441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:26:43.399441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:26:43.399441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:26:43.399441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:43.399441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 535/1065] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:26:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:43.400175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5395e3e-9ca8-4f9b-af85-98eba0069276 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:43.400251 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ece6a-5852-41e8-8200-e47e611d00d6 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:43.400321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5395e3e-9ca8-4f9b-af85-98eba0069276 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-f5395e3e-9ca8-4f9b-af85-98eba0069276 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:26:43.417414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:43.418469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:43.419947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:43.419947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:43.419947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:26:43.419947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:26:43.419947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:26:43.419947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:26:43.419947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:26:43.419947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:26:43.419947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:26:43.419947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:43.419947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 531/1066] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jun 1 17:26:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:43.426085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5395e3e-9ca8-4f9b-af85-98eba0069276 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:43.510421 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ece6a-5852-41e8-8200-e47e611d00d6 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:43.537104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5395e3e-9ca8-4f9b-af85-98eba0069276 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:43.551956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb9c47-26bf-432a-a6db-405f71fcff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:43.552651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb9c47-26bf-432a-a6db-405f71fcff06 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:43.552922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb9c47-26bf-432a-a6db-405f71fcff06 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:43.553227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb9c47-26bf-432a-a6db-405f71fcff06 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:43.553979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb9c47-26bf-432a-a6db-405f71fcff06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:43.554289 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb9c47-26bf-432a-a6db-405f71fcff06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:43.555689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb9c47-26bf-432a-a6db-405f71fcff06 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:43.564126 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 536/1067] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:26:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:43.570087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb9c47-26bf-432a-a6db-405f71fcff06 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:43.579896 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029ae3d-5d30-4a1a-8811-cc3212f68fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:43.580574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029ae3d-5d30-4a1a-8811-cc3212f68fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:43.580855 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029ae3d-5d30-4a1a-8811-cc3212f68fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:43.581159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029ae3d-5d30-4a1a-8811-cc3212f68fa9 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:43.582100 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029ae3d-5d30-4a1a-8811-cc3212f68fa9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:43.582406 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029ae3d-5d30-4a1a-8811-cc3212f68fa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:43.584040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029ae3d-5d30-4a1a-8811-cc3212f68fa9 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:43.605140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 532/1068] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jun 1 17:26:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:43.611529 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029ae3d-5d30-4a1a-8811-cc3212f68fa9 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:43.618864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:43.624881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:43.684059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb9c47-26bf-432a-a6db-405f71fcff06 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:43.720539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029ae3d-5d30-4a1a-8811-cc3212f68fa9 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:43.721155 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1a5e0-ddf4-4723-a118-c93175acad1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:43.722059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1a5e0-ddf4-4723-a118-c93175acad1f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:43.722341 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1a5e0-ddf4-4723-a118-c93175acad1f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:43.722614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1a5e0-ddf4-4723-a118-c93175acad1f None admin] PATH_INFO: `/v3/users/b6970a9f10d64f89b87f2ab261256da9` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:43.737977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1a5e0-ddf4-4723-a118-c93175acad1f None admin] RBAC: Authorizing `identity:get_user(user_id=b6970a9f10d64f89b87f2ab261256da9)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:43.739461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1a5e0-ddf4-4723-a118-c93175acad1f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:43.741993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 537/1069] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:26:43 2022] GET /identity/v3/users/b6970a9f10d64f89b87f2ab261256da9 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:43.748015 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1a5e0-ddf4-4723-a118-c93175acad1f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:43.765329 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244165b-271a-4042-b338-870f1b15bcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:43.766181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244165b-271a-4042-b338-870f1b15bcbe None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:43.766548 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244165b-271a-4042-b338-870f1b15bcbe None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:43.766831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244165b-271a-4042-b338-870f1b15bcbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:43.778849 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244165b-271a-4042-b338-870f1b15bcbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:43.781250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244165b-271a-4042-b338-870f1b15bcbe None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:43.804677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-6244165b-271a-4042-b338-870f1b15bcbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:43.804677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:43.804677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:43.804677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:43.804677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:43.804677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:43.804677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:43.804677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:43.804677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:43.804677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:43.804677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:43.804677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:43.804677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:43.804677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:43.804677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:43.805764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:43.806668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:43.806668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:43.806668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:43.806668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:43.807419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 533/1070] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:43.813559 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244165b-271a-4042-b338-870f1b15bcbe None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:43.864338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:43.867446 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1a5e0-ddf4-4723-a118-c93175acad1f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:43.896113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:43.901751 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f9040-bcfb-4dbb-be6a-3724a5d9e34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:43.902408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f9040-bcfb-4dbb-be6a-3724a5d9e34d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:43.902694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f9040-bcfb-4dbb-be6a-3724a5d9e34d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:43.902977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f9040-bcfb-4dbb-be6a-3724a5d9e34d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:43.936956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244165b-271a-4042-b338-870f1b15bcbe None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:43.972588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e090bb-10a7-4a85-ad8f-b4e47e94f8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:43.973418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e090bb-10a7-4a85-ad8f-b4e47e94f8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:43.973736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e090bb-10a7-4a85-ad8f-b4e47e94f8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:43.974019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e090bb-10a7-4a85-ad8f-b4e47e94f8a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:43.975091 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e090bb-10a7-4a85-ad8f-b4e47e94f8a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:43.975399 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e090bb-10a7-4a85-ad8f-b4e47e94f8a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:43.976755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e090bb-10a7-4a85-ad8f-b4e47e94f8a9 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:43.986186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f9040-bcfb-4dbb-be6a-3724a5d9e34d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:43.987633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f9040-bcfb-4dbb-be6a-3724a5d9e34d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:43.988758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 534/1071] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:43.994313 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e090bb-10a7-4a85-ad8f-b4e47e94f8a9 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:44.083997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:44.087913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 538/1072] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:26:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 01 17:26:44.093731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f9040-bcfb-4dbb-be6a-3724a5d9e34d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:44.094910 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e090bb-10a7-4a85-ad8f-b4e47e94f8a9 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:44.116116 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:44.130430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a4623-b791-4f73-a499-49677abe07c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:44.131287 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a4623-b791-4f73-a499-49677abe07c3 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:44.131573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a4623-b791-4f73-a499-49677abe07c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:44.131849 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a4623-b791-4f73-a499-49677abe07c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:44.139198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a4623-b791-4f73-a499-49677abe07c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:44.140731 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a4623-b791-4f73-a499-49677abe07c3 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:44.155574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-6a2a4623-b791-4f73-a499-49677abe07c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:44.155574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:44.155574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:44.155574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:44.155574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:44.155574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:44.155574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:44.155574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:44.155574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:44.155574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:44.155574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:44.155574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:44.155574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:26:44.155574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:26:44.155574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:44.156597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:44.157554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:26:44.157554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:26:44.157554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:26:44.157554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:26:44.157554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:26:44.157554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:26:44.157554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:44.157554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:44.157554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 535/1073] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:44.162452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a4623-b791-4f73-a499-49677abe07c3 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:44.193430 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f9040-bcfb-4dbb-be6a-3724a5d9e34d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:44.228629 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf887d-b145-4e47-8e04-b081166f9e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:44.229511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf887d-b145-4e47-8e04-b081166f9e08 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:44.229795 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf887d-b145-4e47-8e04-b081166f9e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:44.230069 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf887d-b145-4e47-8e04-b081166f9e08 None admin] PATH_INFO: `/v3/projects/61a6f79790fd44a289ff4e7b556a959f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:44.231734 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf887d-b145-4e47-8e04-b081166f9e08 None admin] RBAC: Authorizing `identity:get_project(project_id=61a6f79790fd44a289ff4e7b556a959f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:44.233316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf887d-b145-4e47-8e04-b081166f9e08 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:44.235021 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 539/1074] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:26:44 2022] GET /identity/v3/projects/61a6f79790fd44a289ff4e7b556a959f => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:44.241317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf887d-b145-4e47-8e04-b081166f9e08 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:44.264215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a4623-b791-4f73-a499-49677abe07c3 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:44.298147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fc3a1-79fb-4fb4-ad6b-bab229dc1904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:44.298804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fc3a1-79fb-4fb4-ad6b-bab229dc1904 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:44.299092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fc3a1-79fb-4fb4-ad6b-bab229dc1904 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:44.299366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fc3a1-79fb-4fb4-ad6b-bab229dc1904 None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:44.300147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fc3a1-79fb-4fb4-ad6b-bab229dc1904 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:44.300456 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fc3a1-79fb-4fb4-ad6b-bab229dc1904 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:44.301908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fc3a1-79fb-4fb4-ad6b-bab229dc1904 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:44.307496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:44.314296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 536/1075] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:26:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:44.320144 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fc3a1-79fb-4fb4-ad6b-bab229dc1904 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:44.341125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf887d-b145-4e47-8e04-b081166f9e08 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:44.361098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:44.375728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d3ee8-5cca-468b-8b14-2503eaf00c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:44.376324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d3ee8-5cca-468b-8b14-2503eaf00c02 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:44.376614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d3ee8-5cca-468b-8b14-2503eaf00c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:44.376895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d3ee8-5cca-468b-8b14-2503eaf00c02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:44.377760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d3ee8-5cca-468b-8b14-2503eaf00c02 None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=61a6f79790fd44a289ff4e7b556a959f, user.id=b6970a9f10d64f89b87f2ab261256da9) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:44.378077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d3ee8-5cca-468b-8b14-2503eaf00c02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:44.379648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d3ee8-5cca-468b-8b14-2503eaf00c02 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:44.395856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 540/1076] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:26:44 2022] GET /identity/v3/role_assignments?user.id=b6970a9f10d64f89b87f2ab261256da9&scope.project.id=61a6f79790fd44a289ff4e7b556a959f&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:44.423652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fc3a1-79fb-4fb4-ad6b-bab229dc1904 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:44.460782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085be6d-5f86-4c9e-bafa-82d6a15a9034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:44.461734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085be6d-5f86-4c9e-bafa-82d6a15a9034 None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:44.462027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085be6d-5f86-4c9e-bafa-82d6a15a9034 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:44.462310 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085be6d-5f86-4c9e-bafa-82d6a15a9034 None admin] PATH_INFO: `/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/5d5a5ba6aecd46e79dc7199589384a4f/roles/1d49fbf041c949b2a9b2d7f173d4228c` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:44.464593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085be6d-5f86-4c9e-bafa-82d6a15a9034 None admin] RBAC: Authorizing `identity:create_grant(project_id=68bf9a1e88a64a02ba53d0bedb76072a, user_id=5d5a5ba6aecd46e79dc7199589384a4f, role_id=1d49fbf041c949b2a9b2d7f173d4228c)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:44.466700 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085be6d-5f86-4c9e-bafa-82d6a15a9034 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:44.557363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 537/1077] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:26:44 2022] PUT /identity/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/5d5a5ba6aecd46e79dc7199589384a4f/roles/1d49fbf041c949b2a9b2d7f173d4228c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:26:46.618313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97768b96-27af-4f1f-9cbd-5b85b60969a4 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:46.618840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97768b96-27af-4f1f-9cbd-5b85b60969a4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:46.618840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97768b96-27af-4f1f-9cbd-5b85b60969a4 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:46.620199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 541/1078] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:46.626410 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43b9c5-7806-4f7d-ab13-a63a145df298 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:46.626840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43b9c5-7806-4f7d-ab13-a63a145df298 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:46.626970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43b9c5-7806-4f7d-ab13-a63a145df298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:46.643541 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-8a43b9c5-7806-4f7d-ab13-a63a145df298 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:46.644726 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8a43b9c5-7806-4f7d-ab13-a63a145df298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:46.711068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 538/1079] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:46.735512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97768b96-27af-4f1f-9cbd-5b85b60969a4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:46.811560 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992a77e-7de1-44f0-b26f-0b4f2a98835e None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:46.811850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992a77e-7de1-44f0-b26f-0b4f2a98835e None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:46.812138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992a77e-7de1-44f0-b26f-0b4f2a98835e None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:46.813562 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 539/1080] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:26:46.818517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b3c39-e306-4f6e-8416-ded1efd61b2f None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:46.818808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b3c39-e306-4f6e-8416-ded1efd61b2f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:46.819090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b3c39-e306-4f6e-8416-ded1efd61b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:46.835447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-1e9b3c39-e306-4f6e-8416-ded1efd61b2f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:46.835630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97768b96-27af-4f1f-9cbd-5b85b60969a4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:46.836627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-1e9b3c39-e306-4f6e-8416-ded1efd61b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:46.861338 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:46.866001 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:46.870723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572428a9-74b4-4d6a-861c-4fbb1feb8f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:46.871566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572428a9-74b4-4d6a-861c-4fbb1feb8f09 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:46.871935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572428a9-74b4-4d6a-861c-4fbb1feb8f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:46.872150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572428a9-74b4-4d6a-861c-4fbb1feb8f09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:46.882087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572428a9-74b4-4d6a-861c-4fbb1feb8f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-572428a9-74b4-4d6a-861c-4fbb1feb8f09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:26:46.889973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:46.890938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:46.891793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:46.891793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:46.891793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:46.891793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:46.891793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:26:46.891793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:26:46.891793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:26:46.891793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:26:46.891793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:26:46.891793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:26:46.891793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:26:46.891793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:46.891793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 542/1081] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:26:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:46.897311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572428a9-74b4-4d6a-861c-4fbb1feb8f09 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:46.905975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 540/1082] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:26:46.929928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b3c39-e306-4f6e-8416-ded1efd61b2f None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:46.997979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572428a9-74b4-4d6a-861c-4fbb1feb8f09 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:47.028870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b3c39-e306-4f6e-8416-ded1efd61b2f None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:47.031593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eff42b-a71e-4cb2-9b11-557c7d9a7e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:47.032264 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eff42b-a71e-4cb2-9b11-557c7d9a7e2c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:47.032549 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eff42b-a71e-4cb2-9b11-557c7d9a7e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:47.032827 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eff42b-a71e-4cb2-9b11-557c7d9a7e2c None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:47.033616 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eff42b-a71e-4cb2-9b11-557c7d9a7e2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:47.033930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eff42b-a71e-4cb2-9b11-557c7d9a7e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:47.035309 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eff42b-a71e-4cb2-9b11-557c7d9a7e2c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:47.043424 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 543/1083] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:26:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:47.049327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eff42b-a71e-4cb2-9b11-557c7d9a7e2c None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:47.062641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebb11b-d64b-4f08-a110-2a73fed76d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:47.063447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebb11b-d64b-4f08-a110-2a73fed76d68 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:47.063729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebb11b-d64b-4f08-a110-2a73fed76d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:47.063999 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebb11b-d64b-4f08-a110-2a73fed76d68 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:47.073946 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebb11b-d64b-4f08-a110-2a73fed76d68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-4cebb11b-d64b-4f08-a110-2a73fed76d68 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:26:47.082846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:47.083790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:47.084711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:47.084711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:47.084711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:47.084711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:47.084711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:26:47.084711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:26:47.084711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:26:47.084711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:26:47.084711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:26:47.084711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:26:47.084711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 01 17:26:47.084711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:47.084711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 541/1084] 10.222.0.33 () {56 vars in 1120 bytes} [Wed Jun 1 17:26:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:47.089780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebb11b-d64b-4f08-a110-2a73fed76d68 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:47.104753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:47.112254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:47.149083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eff42b-a71e-4cb2-9b11-557c7d9a7e2c None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:47.183702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57019a5e-60fd-426d-9906-9e4b2e68703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:47.184610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57019a5e-60fd-426d-9906-9e4b2e68703a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:47.184893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57019a5e-60fd-426d-9906-9e4b2e68703a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:47.185197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57019a5e-60fd-426d-9906-9e4b2e68703a None admin] PATH_INFO: `/v3/users/b6970a9f10d64f89b87f2ab261256da9` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:47.186394 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57019a5e-60fd-426d-9906-9e4b2e68703a None admin] RBAC: Authorizing `identity:get_user(user_id=b6970a9f10d64f89b87f2ab261256da9)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:47.187826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57019a5e-60fd-426d-9906-9e4b2e68703a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:47.188412 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebb11b-d64b-4f08-a110-2a73fed76d68 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:47.189482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 544/1085] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:26:47 2022] GET /identity/v3/users/b6970a9f10d64f89b87f2ab261256da9 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:47.195005 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57019a5e-60fd-426d-9906-9e4b2e68703a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:47.222484 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6e7b1-6015-493d-a5f5-054c78e636cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:47.223149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6e7b1-6015-493d-a5f5-054c78e636cd None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:47.223430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6e7b1-6015-493d-a5f5-054c78e636cd None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:47.223709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6e7b1-6015-493d-a5f5-054c78e636cd None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:47.224444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6e7b1-6015-493d-a5f5-054c78e636cd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:47.225029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6e7b1-6015-493d-a5f5-054c78e636cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:47.226382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6e7b1-6015-493d-a5f5-054c78e636cd None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:47.234316 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 542/1086] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Jun 1 17:26:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:47.239906 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6e7b1-6015-493d-a5f5-054c78e636cd None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:47.296312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57019a5e-60fd-426d-9906-9e4b2e68703a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:47.317801 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:47.319235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:47.329623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ed45-bd99-4891-b31e-fb86078cc105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:47.332219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ed45-bd99-4891-b31e-fb86078cc105 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:47.332219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ed45-bd99-4891-b31e-fb86078cc105 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:47.332219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ed45-bd99-4891-b31e-fb86078cc105 None admin] PATH_INFO: `/v3/projects/61a6f79790fd44a289ff4e7b556a959f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:47.332219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4ed45-bd99-4891-b31e-fb86078cc105 None admin] RBAC: Authorizing `identity:get_project(project_id=61a6f79790fd44a289ff4e7b556a959f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:47.333692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4ed45-bd99-4891-b31e-fb86078cc105 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:47.335399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 545/1087] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:26:47 2022] GET /identity/v3/projects/61a6f79790fd44a289ff4e7b556a959f => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:47.337066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6e7b1-6015-493d-a5f5-054c78e636cd None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:47.341300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ed45-bd99-4891-b31e-fb86078cc105 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:47.370988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fa160-f427-4472-9c53-9878964176da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:47.371834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fa160-f427-4472-9c53-9878964176da None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:47.372118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fa160-f427-4472-9c53-9878964176da None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:47.372393 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fa160-f427-4472-9c53-9878964176da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:47.383222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fa160-f427-4472-9c53-9878964176da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:47.384665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fa160-f427-4472-9c53-9878964176da None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:47.402070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-fb6fa160-f427-4472-9c53-9878964176da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:47.402070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:47.402070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:47.402070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:47.402070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:47.402070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:47.402070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:47.402070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:47.402070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:47.402070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:47.402070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:47.402070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:47.402070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:47.402070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:47.402070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:47.403017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:47.404018 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:47.404018 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:47.404018 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:47.404018 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:47.404018 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 543/1088] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:47.409417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fa160-f427-4472-9c53-9878964176da None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:47.441125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ed45-bd99-4891-b31e-fb86078cc105 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:47.476392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bc533-4d1a-4a2a-989c-22ee07eb819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:47.477315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bc533-4d1a-4a2a-989c-22ee07eb819a None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:47.477604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bc533-4d1a-4a2a-989c-22ee07eb819a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:47.477884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bc533-4d1a-4a2a-989c-22ee07eb819a None admin] PATH_INFO: `/v3/projects/61a6f79790fd44a289ff4e7b556a959f/users/b6970a9f10d64f89b87f2ab261256da9/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:47.479868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bc533-4d1a-4a2a-989c-22ee07eb819a None admin] RBAC: Authorizing `identity:create_grant(project_id=61a6f79790fd44a289ff4e7b556a959f, user_id=b6970a9f10d64f89b87f2ab261256da9, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:47.482029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bc533-4d1a-4a2a-989c-22ee07eb819a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:47.512882 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fa160-f427-4472-9c53-9878964176da None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:47.546381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e3964-7a51-4658-8d34-82b54cc38aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:47.546983 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e3964-7a51-4658-8d34-82b54cc38aaf None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:47.547268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e3964-7a51-4658-8d34-82b54cc38aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:47.547546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e3964-7a51-4658-8d34-82b54cc38aaf None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:47.548255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e3964-7a51-4658-8d34-82b54cc38aaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:47.548596 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e3964-7a51-4658-8d34-82b54cc38aaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:47.550027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e3964-7a51-4658-8d34-82b54cc38aaf None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:47.551458 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:47.562341 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 546/1090] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:26:47 2022] PUT /identity/v3/projects/61a6f79790fd44a289ff4e7b556a959f/users/b6970a9f10d64f89b87f2ab261256da9/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:26:47.562496 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 544/1090] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:47.567841 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bc533-4d1a-4a2a-989c-22ee07eb819a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:47.623775 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:47.679185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bc533-4d1a-4a2a-989c-22ee07eb819a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:47.714931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5d85e-4c46-4061-906a-ff94bf3b08f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:47.716451 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5d85e-4c46-4061-906a-ff94bf3b08f3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:47.716732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5d85e-4c46-4061-906a-ff94bf3b08f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:47.717041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5d85e-4c46-4061-906a-ff94bf3b08f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:47.725929 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5d85e-4c46-4061-906a-ff94bf3b08f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:47.727393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5d85e-4c46-4061-906a-ff94bf3b08f3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-76c5d85e-4c46-4061-906a-ff94bf3b08f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:26:47.743542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:47.744651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:47.746252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:47.746252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:47.746252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:26:47.746252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:26:47.746252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:26:47.746252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:26:47.746252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:26:47.746252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:26:47.746252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 01 17:26:47.746252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:47.746252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 547/1091] 10.222.0.33 () {56 vars in 1093 bytes} [Wed Jun 1 17:26:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:47.751245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e3964-7a51-4658-8d34-82b54cc38aaf None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:47.858057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e3964-7a51-4658-8d34-82b54cc38aaf None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:47.891927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323923d-598e-4d11-a525-e3f757e87891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:47.892599 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323923d-598e-4d11-a525-e3f757e87891 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:47.892881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323923d-598e-4d11-a525-e3f757e87891 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:47.893195 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323923d-598e-4d11-a525-e3f757e87891 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:47.894021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323923d-598e-4d11-a525-e3f757e87891 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:47.894329 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323923d-598e-4d11-a525-e3f757e87891 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:47.895748 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323923d-598e-4d11-a525-e3f757e87891 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:47.917804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 545/1092] 10.222.0.33 () {56 vars in 1133 bytes} [Wed Jun 1 17:26:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:47.919563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5d85e-4c46-4061-906a-ff94bf3b08f3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:48.019310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5d85e-4c46-4061-906a-ff94bf3b08f3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:48.029559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:48.053208 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ec381-2bf5-464c-8ba6-a3f1db827693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:48.053857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ec381-2bf5-464c-8ba6-a3f1db827693 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:48.054162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ec381-2bf5-464c-8ba6-a3f1db827693 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:48.054438 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ec381-2bf5-464c-8ba6-a3f1db827693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:48.122673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ec381-2bf5-464c-8ba6-a3f1db827693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:48.124048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ec381-2bf5-464c-8ba6-a3f1db827693 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:48.220077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 548/1093] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:26:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 01 17:26:48.225973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323923d-598e-4d11-a525-e3f757e87891 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:48.278118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:48.323850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323923d-598e-4d11-a525-e3f757e87891 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:48.357996 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce87b6-ed7c-4b36-afeb-0ce0a0a40eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:48.358790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce87b6-ed7c-4b36-afeb-0ce0a0a40eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:48.359074 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce87b6-ed7c-4b36-afeb-0ce0a0a40eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:48.359350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce87b6-ed7c-4b36-afeb-0ce0a0a40eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:48.369311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce87b6-ed7c-4b36-afeb-0ce0a0a40eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:48.370757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce87b6-ed7c-4b36-afeb-0ce0a0a40eb5 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:48.389657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-44ce87b6-ed7c-4b36-afeb-0ce0a0a40eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:48.389657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:48.389657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:48.389657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:48.389657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:48.389657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:48.389657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:48.389657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:48.389657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:48.389657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:48.389657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:48.389657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:48.389657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:26:48.389657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:26:48.389657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:48.390544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:48.391444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:26:48.391444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:26:48.391444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:26:48.391444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:48.391444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 546/1094] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:26:48.396440 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ec381-2bf5-464c-8ba6-a3f1db827693 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:48.408294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:48.500847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ec381-2bf5-464c-8ba6-a3f1db827693 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:48.534586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de78201-923d-4308-8f7f-315517b9dd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:48.535243 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de78201-923d-4308-8f7f-315517b9dd9f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:48.535531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de78201-923d-4308-8f7f-315517b9dd9f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:48.535811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de78201-923d-4308-8f7f-315517b9dd9f None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:48.536529 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de78201-923d-4308-8f7f-315517b9dd9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:48.536839 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de78201-923d-4308-8f7f-315517b9dd9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:48.538255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de78201-923d-4308-8f7f-315517b9dd9f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:48.549725 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 549/1095] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:48.555322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce87b6-ed7c-4b36-afeb-0ce0a0a40eb5 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:48.653339 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce87b6-ed7c-4b36-afeb-0ce0a0a40eb5 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:48.655584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:48.689099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c802e-4d8f-4c09-84d8-fd9264c90558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:48.689909 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c802e-4d8f-4c09-84d8-fd9264c90558 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:48.690196 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c802e-4d8f-4c09-84d8-fd9264c90558 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:48.690476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c802e-4d8f-4c09-84d8-fd9264c90558 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:48.697279 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c802e-4d8f-4c09-84d8-fd9264c90558 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:48.698770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c802e-4d8f-4c09-84d8-fd9264c90558 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:48.713552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-e86c802e-4d8f-4c09-84d8-fd9264c90558 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:48.713552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:48.713552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:48.713552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:48.713552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:48.713552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:48.713552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:48.713552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:48.713552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:48.713552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:48.713552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:48.713552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:48.713552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:26:48.713552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:26:48.713552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:48.714713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:48.715658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:26:48.715658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:26:48.715658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:26:48.715658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:26:48.715658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:26:48.715658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:26:48.715658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:26:48.715658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:26:48.715658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 547/1096] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:26:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:48.720837 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de78201-923d-4308-8f7f-315517b9dd9f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:48.790136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:48.821014 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de78201-923d-4308-8f7f-315517b9dd9f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:48.858107 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b5220-7b65-4552-80a0-223b699c4cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:48.858772 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b5220-7b65-4552-80a0-223b699c4cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:48.859059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b5220-7b65-4552-80a0-223b699c4cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:48.859341 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b5220-7b65-4552-80a0-223b699c4cd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:48.860129 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b5220-7b65-4552-80a0-223b699c4cd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:48.860446 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b5220-7b65-4552-80a0-223b699c4cd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:48.861912 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b5220-7b65-4552-80a0-223b699c4cd5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:48.874397 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 550/1097] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:26:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:48.880247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c802e-4d8f-4c09-84d8-fd9264c90558 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:48.979386 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c802e-4d8f-4c09-84d8-fd9264c90558 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:49.012131 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b3ee1-3998-43ba-a11b-50146712099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:49.012990 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b3ee1-3998-43ba-a11b-50146712099a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:49.013284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b3ee1-3998-43ba-a11b-50146712099a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:49.013565 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b3ee1-3998-43ba-a11b-50146712099a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:49.014395 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b3ee1-3998-43ba-a11b-50146712099a None admin] RBAC: Adding query filter params (role.id=1d49fbf041c949b2a9b2d7f173d4228c, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=5d5a5ba6aecd46e79dc7199589384a4f) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:49.014710 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b3ee1-3998-43ba-a11b-50146712099a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:49.016154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b3ee1-3998-43ba-a11b-50146712099a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:49.022071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 548/1098] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:26:48 2022] GET /identity/v3/role_assignments?user.id=5d5a5ba6aecd46e79dc7199589384a4f&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=1d49fbf041c949b2a9b2d7f173d4228c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:26:49.824980 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46893307-cb64-4ce3-97a2-6b7e5088fb1b None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:49.825627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46893307-cb64-4ce3-97a2-6b7e5088fb1b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:49.825627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46893307-cb64-4ce3-97a2-6b7e5088fb1b None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:49.826895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 551/1099] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:49.834108 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15817600-2822-43d7-b637-3312cdc3f571 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:49.834407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15817600-2822-43d7-b637-3312cdc3f571 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:49.834694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15817600-2822-43d7-b637-3312cdc3f571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:49.853384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-15817600-2822-43d7-b637-3312cdc3f571 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:49.854583 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-15817600-2822-43d7-b637-3312cdc3f571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:49.881253 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:49.926989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 549/1100] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:49.951810 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46893307-cb64-4ce3-97a2-6b7e5088fb1b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:50.051315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46893307-cb64-4ce3-97a2-6b7e5088fb1b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:50.079056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:50.084392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1a426-a7da-45b9-b2f6-6701fe546b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:50.085265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1a426-a7da-45b9-b2f6-6701fe546b26 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:50.085548 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1a426-a7da-45b9-b2f6-6701fe546b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:50.091859 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1a426-a7da-45b9-b2f6-6701fe546b26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:50.095596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1a426-a7da-45b9-b2f6-6701fe546b26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-69c1a426-a7da-45b9-b2f6-6701fe546b26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:26:50.103542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:26:50.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:26:50.105657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:26:50.105657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:26:50.105657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:26:50.105657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:26:50.105657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:26:50.105657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:26:50.105657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:26:50.105657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:26:50.105657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:26:50.105657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:26:50.105657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:26:50.105657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:26:50.105657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 552/1101] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:26:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:26:50.111127 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15817600-2822-43d7-b637-3312cdc3f571 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:50.205413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15817600-2822-43d7-b637-3312cdc3f571 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:50.238191 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af85655-3e21-44d8-bd94-d06ad1ea1b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:50.238848 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af85655-3e21-44d8-bd94-d06ad1ea1b15 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:50.239130 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af85655-3e21-44d8-bd94-d06ad1ea1b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:50.239404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af85655-3e21-44d8-bd94-d06ad1ea1b15 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:50.240135 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af85655-3e21-44d8-bd94-d06ad1ea1b15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:50.240441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af85655-3e21-44d8-bd94-d06ad1ea1b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:50.241820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af85655-3e21-44d8-bd94-d06ad1ea1b15 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:50.250177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 550/1102] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:26:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:50.255715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1a426-a7da-45b9-b2f6-6701fe546b26 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:50.351846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1a426-a7da-45b9-b2f6-6701fe546b26 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:50.383839 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48460568-e780-428d-9ea6-4439645f3270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:50.384682 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48460568-e780-428d-9ea6-4439645f3270 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:50.384980 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48460568-e780-428d-9ea6-4439645f3270 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:50.385253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48460568-e780-428d-9ea6-4439645f3270 None admin] PATH_INFO: `/v3/users/b6970a9f10d64f89b87f2ab261256da9` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:50.386405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48460568-e780-428d-9ea6-4439645f3270 None admin] RBAC: Authorizing `identity:get_user(user_id=b6970a9f10d64f89b87f2ab261256da9)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:50.388376 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48460568-e780-428d-9ea6-4439645f3270 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:50.389974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 553/1103] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:26:50 2022] GET /identity/v3/users/b6970a9f10d64f89b87f2ab261256da9 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:50.395488 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af85655-3e21-44d8-bd94-d06ad1ea1b15 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:50.418238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:50.494214 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af85655-3e21-44d8-bd94-d06ad1ea1b15 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:50.527012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e481282-2a0a-4aa6-a39e-4537811e0144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:50.527658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e481282-2a0a-4aa6-a39e-4537811e0144 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:50.528066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e481282-2a0a-4aa6-a39e-4537811e0144 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:50.528353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e481282-2a0a-4aa6-a39e-4537811e0144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:50.593859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e481282-2a0a-4aa6-a39e-4537811e0144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:50.595302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e481282-2a0a-4aa6-a39e-4537811e0144 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:50.615961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:50.691312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 551/1104] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:26:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:26:50.697214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48460568-e780-428d-9ea6-4439645f3270 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:50.755650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:50.797628 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48460568-e780-428d-9ea6-4439645f3270 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:50.830552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42874b3f-8f12-4b32-b016-4c809be0112b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:50.831411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42874b3f-8f12-4b32-b016-4c809be0112b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:50.831696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42874b3f-8f12-4b32-b016-4c809be0112b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:50.831976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42874b3f-8f12-4b32-b016-4c809be0112b None admin] PATH_INFO: `/v3/projects/61a6f79790fd44a289ff4e7b556a959f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:50.833171 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42874b3f-8f12-4b32-b016-4c809be0112b None admin] RBAC: Authorizing `identity:get_project(project_id=61a6f79790fd44a289ff4e7b556a959f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:50.834603 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42874b3f-8f12-4b32-b016-4c809be0112b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:50.836278 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 554/1105] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:26:50 2022] GET /identity/v3/projects/61a6f79790fd44a289ff4e7b556a959f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:50.842964 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e481282-2a0a-4aa6-a39e-4537811e0144 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:50.945280 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e481282-2a0a-4aa6-a39e-4537811e0144 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:50.964845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:50.978465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824b70d-7fdf-496c-8fd7-076f322ee2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:50.981877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b70d-7fdf-496c-8fd7-076f322ee2ca None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:50.981877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b70d-7fdf-496c-8fd7-076f322ee2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:50.981877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b70d-7fdf-496c-8fd7-076f322ee2ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:50.981877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824b70d-7fdf-496c-8fd7-076f322ee2ca None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=61a6f79790fd44a289ff4e7b556a959f, user.id=b6970a9f10d64f89b87f2ab261256da9) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:50.981877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824b70d-7fdf-496c-8fd7-076f322ee2ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:50.982811 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824b70d-7fdf-496c-8fd7-076f322ee2ca None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:50.988418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 552/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:26:50 2022] GET /identity/v3/role_assignments?user.id=b6970a9f10d64f89b87f2ab261256da9&scope.project.id=61a6f79790fd44a289ff4e7b556a959f&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:53.229887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224aac24-d8eb-4036-a319-d8c893da65f6 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:53.230508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224aac24-d8eb-4036-a319-d8c893da65f6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:53.230508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224aac24-d8eb-4036-a319-d8c893da65f6 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:53.232422 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 555/1107] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:53.237678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568f694-da68-41b3-8df3-568e89dce791 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:53.238064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568f694-da68-41b3-8df3-568e89dce791 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:53.238230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568f694-da68-41b3-8df3-568e89dce791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:53.255291 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-4568f694-da68-41b3-8df3-568e89dce791 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:53.256451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4568f694-da68-41b3-8df3-568e89dce791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:53.319586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 553/1108] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:53.345163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224aac24-d8eb-4036-a319-d8c893da65f6 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:53.444272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224aac24-d8eb-4036-a319-d8c893da65f6 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:53.470382 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:53.479040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15f692-74ce-4856-a195-69cb34acc928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:53.479826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f692-74ce-4856-a195-69cb34acc928 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:53.480151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f692-74ce-4856-a195-69cb34acc928 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:53.480381 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f692-74ce-4856-a195-69cb34acc928 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:53.482407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15f692-74ce-4856-a195-69cb34acc928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:53.483837 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15f692-74ce-4856-a195-69cb34acc928 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:53.485477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 556/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:26:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:53.491120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568f694-da68-41b3-8df3-568e89dce791 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:53.593413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568f694-da68-41b3-8df3-568e89dce791 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:53.607280 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:53.626648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62092b-cb26-4f1e-9f98-0dfc8ced0dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:53.627322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62092b-cb26-4f1e-9f98-0dfc8ced0dfc None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:53.627602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62092b-cb26-4f1e-9f98-0dfc8ced0dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:53.627875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62092b-cb26-4f1e-9f98-0dfc8ced0dfc None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:53.628567 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62092b-cb26-4f1e-9f98-0dfc8ced0dfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:53.630078 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62092b-cb26-4f1e-9f98-0dfc8ced0dfc None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:53.775876 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 554/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:26:53 2022] POST /identity/v3/users => generated 286 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:26:56.078104 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad242ab-8da9-4493-a02a-fb482a47f0bf None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:56.078673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad242ab-8da9-4493-a02a-fb482a47f0bf None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:56.078673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad242ab-8da9-4493-a02a-fb482a47f0bf None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:56.080026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 557/1111] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:56.085311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58493a2-9243-4c2f-b3d7-1406d0606563 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:56.085734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58493a2-9243-4c2f-b3d7-1406d0606563 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:56.085881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58493a2-9243-4c2f-b3d7-1406d0606563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:56.103498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-e58493a2-9243-4c2f-b3d7-1406d0606563 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:56.104677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e58493a2-9243-4c2f-b3d7-1406d0606563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:56.174447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 555/1112] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:56.197615 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad242ab-8da9-4493-a02a-fb482a47f0bf None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:56.299685 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad242ab-8da9-4493-a02a-fb482a47f0bf None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:56.332671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f599a-4421-4375-95a5-278938251d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:56.333487 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f599a-4421-4375-95a5-278938251d31 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:56.333774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f599a-4421-4375-95a5-278938251d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:56.334053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f599a-4421-4375-95a5-278938251d31 None admin] PATH_INFO: `/v3/roles/58b5b157099e42bcb4ee3eff9aaf2064` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:56.335515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f599a-4421-4375-95a5-278938251d31 None admin] RBAC: Authorizing `identity:get_role(role_id=58b5b157099e42bcb4ee3eff9aaf2064)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:56.336883 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f599a-4421-4375-95a5-278938251d31 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:56.338276 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 558/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:26:56 2022] GET /identity/v3/roles/58b5b157099e42bcb4ee3eff9aaf2064 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:56.344953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58493a2-9243-4c2f-b3d7-1406d0606563 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:56.438014 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:56.440671 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58493a2-9243-4c2f-b3d7-1406d0606563 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:56.473862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ed934-2043-4e93-9495-bb5f6c355d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:56.475075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ed934-2043-4e93-9495-bb5f6c355d1f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:56.475703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ed934-2043-4e93-9495-bb5f6c355d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:56.476204 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ed934-2043-4e93-9495-bb5f6c355d1f None admin] PATH_INFO: `/v3/users/56e9c7e206fe48d2bb986f2ff84feece` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:56.490102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ed934-2043-4e93-9495-bb5f6c355d1f None admin] RBAC: Authorizing `identity:get_user(user_id=56e9c7e206fe48d2bb986f2ff84feece)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:56.491549 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ed934-2043-4e93-9495-bb5f6c355d1f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:56.493373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 556/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:26:56 2022] GET /identity/v3/users/56e9c7e206fe48d2bb986f2ff84feece => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:56.499723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f599a-4421-4375-95a5-278938251d31 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:56.560337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:56.602026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f599a-4421-4375-95a5-278938251d31 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:56.638146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f434ed-c4f3-42b2-8867-b352c415848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:56.638790 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f434ed-c4f3-42b2-8867-b352c415848d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:56.639074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f434ed-c4f3-42b2-8867-b352c415848d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:56.639348 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f434ed-c4f3-42b2-8867-b352c415848d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:56.705294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f434ed-c4f3-42b2-8867-b352c415848d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:56.706739 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f434ed-c4f3-42b2-8867-b352c415848d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:56.764776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:56.802129 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 559/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:26:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:26:56.808165 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ed934-2043-4e93-9495-bb5f6c355d1f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:56.924483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ed934-2043-4e93-9495-bb5f6c355d1f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:56.976389 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c134e-77c9-4ada-811a-49e428f8c735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:56.977289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c134e-77c9-4ada-811a-49e428f8c735 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:56.977574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c134e-77c9-4ada-811a-49e428f8c735 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:56.977848 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c134e-77c9-4ada-811a-49e428f8c735 None admin] PATH_INFO: `/v3/projects/61a6f79790fd44a289ff4e7b556a959f` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:56.979015 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c134e-77c9-4ada-811a-49e428f8c735 None admin] RBAC: Authorizing `identity:get_project(project_id=61a6f79790fd44a289ff4e7b556a959f)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:56.980449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c134e-77c9-4ada-811a-49e428f8c735 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:56.982207 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 557/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:26:56 2022] GET /identity/v3/projects/61a6f79790fd44a289ff4e7b556a959f => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:56.988472 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f434ed-c4f3-42b2-8867-b352c415848d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:57.084148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f434ed-c4f3-42b2-8867-b352c415848d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:57.116838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf952a7-b3aa-46eb-9d79-ddbdf9091d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:57.117501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf952a7-b3aa-46eb-9d79-ddbdf9091d2d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:57.117782 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf952a7-b3aa-46eb-9d79-ddbdf9091d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:57.118056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf952a7-b3aa-46eb-9d79-ddbdf9091d2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:57.118881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf952a7-b3aa-46eb-9d79-ddbdf9091d2d None admin] RBAC: Adding query filter params (role.id=58b5b157099e42bcb4ee3eff9aaf2064, scope.project.id=61a6f79790fd44a289ff4e7b556a959f, user.id=56e9c7e206fe48d2bb986f2ff84feece) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:26:57.119190 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf952a7-b3aa-46eb-9d79-ddbdf9091d2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:57.120633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf952a7-b3aa-46eb-9d79-ddbdf9091d2d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:57.126481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 560/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:26:56 2022] GET /identity/v3/role_assignments?user.id=56e9c7e206fe48d2bb986f2ff84feece&scope.project.id=61a6f79790fd44a289ff4e7b556a959f&role.id=58b5b157099e42bcb4ee3eff9aaf2064 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:59.334681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be64420-2c02-4920-90fd-a21b7802a2c4 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:59.335283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be64420-2c02-4920-90fd-a21b7802a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:59.335283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be64420-2c02-4920-90fd-a21b7802a2c4 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:59.336611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 558/1118] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:26:59.341805 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fca6a-f1f1-437f-a90d-e03bff38b968 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:59.342246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fca6a-f1f1-437f-a90d-e03bff38b968 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:59.342378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fca6a-f1f1-437f-a90d-e03bff38b968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:59.359604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a65fca6a-f1f1-437f-a90d-e03bff38b968 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:26:59.360776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a65fca6a-f1f1-437f-a90d-e03bff38b968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:26:59.381101 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:59.426525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 561/1119] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:26:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:26:59.448653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be64420-2c02-4920-90fd-a21b7802a2c4 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:59.476549 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:59.549807 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be64420-2c02-4920-90fd-a21b7802a2c4 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:59.582080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61718-8358-4e9c-8683-0d9447b524c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:59.582921 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61718-8358-4e9c-8683-0d9447b524c7 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:59.583201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61718-8358-4e9c-8683-0d9447b524c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:59.583473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61718-8358-4e9c-8683-0d9447b524c7 None admin] PATH_INFO: `/v3/roles/58b5b157099e42bcb4ee3eff9aaf2064` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:59.584981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab61718-8358-4e9c-8683-0d9447b524c7 None admin] RBAC: Authorizing `identity:get_role(role_id=58b5b157099e42bcb4ee3eff9aaf2064)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:59.586282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab61718-8358-4e9c-8683-0d9447b524c7 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:59.587640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 559/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:26:59 2022] GET /identity/v3/roles/58b5b157099e42bcb4ee3eff9aaf2064 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:59.594096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fca6a-f1f1-437f-a90d-e03bff38b968 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:59.692576 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fca6a-f1f1-437f-a90d-e03bff38b968 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:59.725581 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ba6c2-eea1-454a-b245-9298236cfa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:59.726433 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ba6c2-eea1-454a-b245-9298236cfa42 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:59.726710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ba6c2-eea1-454a-b245-9298236cfa42 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:59.726984 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ba6c2-eea1-454a-b245-9298236cfa42 None admin] PATH_INFO: `/v3/users/56e9c7e206fe48d2bb986f2ff84feece` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:59.728133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ba6c2-eea1-454a-b245-9298236cfa42 None admin] RBAC: Authorizing `identity:get_user(user_id=56e9c7e206fe48d2bb986f2ff84feece)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:59.729596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ba6c2-eea1-454a-b245-9298236cfa42 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:59.731821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 562/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:26:59 2022] GET /identity/v3/users/56e9c7e206fe48d2bb986f2ff84feece => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:59.737563 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61718-8358-4e9c-8683-0d9447b524c7 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:59.828174 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:59.834585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61718-8358-4e9c-8683-0d9447b524c7 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:26:59.868354 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519646c-dd76-488f-9d61-8a50f68eb3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:26:59.869191 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519646c-dd76-488f-9d61-8a50f68eb3fe None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:26:59.869477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519646c-dd76-488f-9d61-8a50f68eb3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:26:59.869753 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519646c-dd76-488f-9d61-8a50f68eb3fe None admin] PATH_INFO: `/v3/projects/61a6f79790fd44a289ff4e7b556a959f` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:26:59.870921 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519646c-dd76-488f-9d61-8a50f68eb3fe None admin] RBAC: Authorizing `identity:get_project(project_id=61a6f79790fd44a289ff4e7b556a959f)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:26:59.872388 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519646c-dd76-488f-9d61-8a50f68eb3fe None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:26:59.874107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 560/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:26:59 2022] GET /identity/v3/projects/61a6f79790fd44a289ff4e7b556a959f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:26:59.879869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ba6c2-eea1-454a-b245-9298236cfa42 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:26:59.905982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:26:59.983298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ba6c2-eea1-454a-b245-9298236cfa42 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:00.016051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e570e-358f-4c88-b070-d258b841e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:00.016927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e570e-358f-4c88-b070-d258b841e6e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:00.017398 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e570e-358f-4c88-b070-d258b841e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:00.017677 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e570e-358f-4c88-b070-d258b841e6e2 None admin] PATH_INFO: `/v3/projects/61a6f79790fd44a289ff4e7b556a959f/users/56e9c7e206fe48d2bb986f2ff84feece/roles/58b5b157099e42bcb4ee3eff9aaf2064` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:00.019848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e570e-358f-4c88-b070-d258b841e6e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=61a6f79790fd44a289ff4e7b556a959f, user_id=56e9c7e206fe48d2bb986f2ff84feece, role_id=58b5b157099e42bcb4ee3eff9aaf2064)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:00.021324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e570e-358f-4c88-b070-d258b841e6e2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:00.092667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 563/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:26:59 2022] PUT /identity/v3/projects/61a6f79790fd44a289ff4e7b556a959f/users/56e9c7e206fe48d2bb986f2ff84feece/roles/58b5b157099e42bcb4ee3eff9aaf2064 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:27:02.320584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75aeaf-ffc0-47b5-815a-a265f4ee62c2 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:02.321176 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75aeaf-ffc0-47b5-815a-a265f4ee62c2 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:02.321176 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75aeaf-ffc0-47b5-815a-a265f4ee62c2 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:02.322534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 561/1124] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:27:02.327845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59bed8-34e0-436f-8e0b-72ce2d16cd7d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:02.328266 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59bed8-34e0-436f-8e0b-72ce2d16cd7d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:02.328403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59bed8-34e0-436f-8e0b-72ce2d16cd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:02.344798 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0f59bed8-34e0-436f-8e0b-72ce2d16cd7d None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:27:02.346019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0f59bed8-34e0-436f-8e0b-72ce2d16cd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:27:02.413726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 564/1125] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:27:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:27:02.437759 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75aeaf-ffc0-47b5-815a-a265f4ee62c2 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:02.536669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75aeaf-ffc0-47b5-815a-a265f4ee62c2 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:02.569686 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600754d-0d81-41c0-be94-1ba0bab8a055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:02.570547 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600754d-0d81-41c0-be94-1ba0bab8a055 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:02.570881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600754d-0d81-41c0-be94-1ba0bab8a055 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:02.571112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600754d-0d81-41c0-be94-1ba0bab8a055 None admin] PATH_INFO: `/v3/roles/58b5b157099e42bcb4ee3eff9aaf2064` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:02.572586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600754d-0d81-41c0-be94-1ba0bab8a055 None admin] RBAC: Authorizing `identity:get_role(role_id=58b5b157099e42bcb4ee3eff9aaf2064)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:02.573990 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600754d-0d81-41c0-be94-1ba0bab8a055 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:02.575369 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 562/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:27:02 2022] GET /identity/v3/roles/58b5b157099e42bcb4ee3eff9aaf2064 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:02.581174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59bed8-34e0-436f-8e0b-72ce2d16cd7d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:02.596386 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:02.679182 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59bed8-34e0-436f-8e0b-72ce2d16cd7d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:02.712842 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad4449-6c9d-4fc6-ab40-d72aeade9401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:02.713735 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad4449-6c9d-4fc6-ab40-d72aeade9401 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:02.714023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad4449-6c9d-4fc6-ab40-d72aeade9401 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:02.714300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad4449-6c9d-4fc6-ab40-d72aeade9401 None admin] PATH_INFO: `/v3/users/56e9c7e206fe48d2bb986f2ff84feece` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:02.715643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad4449-6c9d-4fc6-ab40-d72aeade9401 None admin] RBAC: Authorizing `identity:get_user(user_id=56e9c7e206fe48d2bb986f2ff84feece)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:02.717117 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad4449-6c9d-4fc6-ab40-d72aeade9401 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:02.718733 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 565/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:27:02 2022] GET /identity/v3/users/56e9c7e206fe48d2bb986f2ff84feece => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:02.724647 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600754d-0d81-41c0-be94-1ba0bab8a055 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:02.753848 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:02.821424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600754d-0d81-41c0-be94-1ba0bab8a055 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:02.853826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53416e5-9fd5-417b-a1d4-b91747be58c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:02.854466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53416e5-9fd5-417b-a1d4-b91747be58c5 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:02.854750 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53416e5-9fd5-417b-a1d4-b91747be58c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:02.855024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53416e5-9fd5-417b-a1d4-b91747be58c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:02.920629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53416e5-9fd5-417b-a1d4-b91747be58c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:02.922102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53416e5-9fd5-417b-a1d4-b91747be58c5 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:02.950286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:03.017072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 563/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:27:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:27:03.022972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad4449-6c9d-4fc6-ab40-d72aeade9401 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:03.103130 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:03.120211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad4449-6c9d-4fc6-ab40-d72aeade9401 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:03.154348 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760d169-d248-4918-b6f1-a0d1e419998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:03.155206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d169-d248-4918-b6f1-a0d1e419998c None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:03.155489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d169-d248-4918-b6f1-a0d1e419998c None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:03.155766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760d169-d248-4918-b6f1-a0d1e419998c None admin] PATH_INFO: `/v3/projects/61a6f79790fd44a289ff4e7b556a959f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:03.156923 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760d169-d248-4918-b6f1-a0d1e419998c None admin] RBAC: Authorizing `identity:get_project(project_id=61a6f79790fd44a289ff4e7b556a959f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:03.158532 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760d169-d248-4918-b6f1-a0d1e419998c None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:03.160199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 566/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:27:03 2022] GET /identity/v3/projects/61a6f79790fd44a289ff4e7b556a959f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:03.166197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53416e5-9fd5-417b-a1d4-b91747be58c5 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:03.263588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53416e5-9fd5-417b-a1d4-b91747be58c5 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:03.291370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:03.297464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825d49c-30a9-487f-ac05-cfcbfe3e8dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:03.298107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825d49c-30a9-487f-ac05-cfcbfe3e8dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:03.298395 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825d49c-30a9-487f-ac05-cfcbfe3e8dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:03.298670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825d49c-30a9-487f-ac05-cfcbfe3e8dd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:03.299483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825d49c-30a9-487f-ac05-cfcbfe3e8dd5 None admin] RBAC: Adding query filter params (role.id=58b5b157099e42bcb4ee3eff9aaf2064, scope.project.id=61a6f79790fd44a289ff4e7b556a959f, user.id=56e9c7e206fe48d2bb986f2ff84feece) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:27:03.299794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825d49c-30a9-487f-ac05-cfcbfe3e8dd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:03.301243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825d49c-30a9-487f-ac05-cfcbfe3e8dd5 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:03.306878 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 564/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:27:03 2022] GET /identity/v3/role_assignments?user.id=56e9c7e206fe48d2bb986f2ff84feece&scope.project.id=61a6f79790fd44a289ff4e7b556a959f&role.id=58b5b157099e42bcb4ee3eff9aaf2064 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:05.544010 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93e98c-ad9b-424f-a5f4-a37fb4a19384 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:05.544544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93e98c-ad9b-424f-a5f4-a37fb4a19384 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:05.544544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93e98c-ad9b-424f-a5f4-a37fb4a19384 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:05.545944 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 567/1131] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:27:05.551195 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196f3f4-950d-4cd2-9268-9b6e3ffd0811 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:05.551622 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196f3f4-950d-4cd2-9268-9b6e3ffd0811 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:05.551728 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196f3f4-950d-4cd2-9268-9b6e3ffd0811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:05.568721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-4196f3f4-950d-4cd2-9268-9b6e3ffd0811 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:27:05.569939 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4196f3f4-950d-4cd2-9268-9b6e3ffd0811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:27:05.636193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 565/1132] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:27:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:27:05.660702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93e98c-ad9b-424f-a5f4-a37fb4a19384 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:05.760697 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93e98c-ad9b-424f-a5f4-a37fb4a19384 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:05.794395 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6fa1b-fbde-4c64-840e-9815b3f09dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:05.795170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6fa1b-fbde-4c64-840e-9815b3f09dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:05.795451 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6fa1b-fbde-4c64-840e-9815b3f09dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:05.795725 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6fa1b-fbde-4c64-840e-9815b3f09dc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:05.796873 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6fa1b-fbde-4c64-840e-9815b3f09dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:05.798330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6fa1b-fbde-4c64-840e-9815b3f09dc5 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:05.799934 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 568/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:27:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:05.805861 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196f3f4-950d-4cd2-9268-9b6e3ffd0811 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:05.901856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196f3f4-950d-4cd2-9268-9b6e3ffd0811 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:05.924603 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:05.935684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3226d55-9080-41c7-8811-56115f23feaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:05.936345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3226d55-9080-41c7-8811-56115f23feaa None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:05.936633 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3226d55-9080-41c7-8811-56115f23feaa None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:05.936913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3226d55-9080-41c7-8811-56115f23feaa None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:05.937659 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3226d55-9080-41c7-8811-56115f23feaa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:05.939089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3226d55-9080-41c7-8811-56115f23feaa None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:06.010110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 566/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jun 1 17:27:05 2022] POST /identity/v3/projects => generated 311 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:27:08.283735 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db242921-976e-4590-bb3d-ffacf0f30cfb None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:08.284298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db242921-976e-4590-bb3d-ffacf0f30cfb None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:08.284298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db242921-976e-4590-bb3d-ffacf0f30cfb None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:08.285682 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 569/1135] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:27:08.290850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3984-610e-4096-a90d-030f79e20761 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:08.291233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3984-610e-4096-a90d-030f79e20761 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:08.291419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3984-610e-4096-a90d-030f79e20761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:08.308359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-976e3984-610e-4096-a90d-030f79e20761 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:27:08.309699 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-976e3984-610e-4096-a90d-030f79e20761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:27:08.375027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 567/1136] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:27:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:27:08.400275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db242921-976e-4590-bb3d-ffacf0f30cfb None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:08.419374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:08.501018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db242921-976e-4590-bb3d-ffacf0f30cfb None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:08.533171 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc2c33-6ce4-4605-9e7c-b633a16e105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:08.534022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc2c33-6ce4-4605-9e7c-b633a16e105a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:08.534253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc2c33-6ce4-4605-9e7c-b633a16e105a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:08.534525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc2c33-6ce4-4605-9e7c-b633a16e105a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:08.535666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc2c33-6ce4-4605-9e7c-b633a16e105a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:08.537125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc2c33-6ce4-4605-9e7c-b633a16e105a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:08.538740 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 570/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:27:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:08.544988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e3984-610e-4096-a90d-030f79e20761 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:08.641094 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e3984-610e-4096-a90d-030f79e20761 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:08.648099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:08.674652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f0ec3-d912-459c-8d7c-b38d5d352ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:08.675325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f0ec3-d912-459c-8d7c-b38d5d352ade None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:08.675608 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f0ec3-d912-459c-8d7c-b38d5d352ade None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:08.675885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f0ec3-d912-459c-8d7c-b38d5d352ade None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:08.676599 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f0ec3-d912-459c-8d7c-b38d5d352ade None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:08.678061 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f0ec3-d912-459c-8d7c-b38d5d352ade None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:08.784491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 568/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:27:08 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:27:11.080071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7dfdd-2190-4471-b104-2e7849ab4bb1 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:11.080631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7dfdd-2190-4471-b104-2e7849ab4bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:11.080631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7dfdd-2190-4471-b104-2e7849ab4bb1 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:11.081997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 571/1139] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:27:11.087197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a499e-68a8-44ff-9323-ddcb536b6133 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:11.087638 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a499e-68a8-44ff-9323-ddcb536b6133 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:11.087758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a499e-68a8-44ff-9323-ddcb536b6133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:11.106103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-5c2a499e-68a8-44ff-9323-ddcb536b6133 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:27:11.107308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-5c2a499e-68a8-44ff-9323-ddcb536b6133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:27:11.171980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 569/1140] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:27:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:27:11.195834 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7dfdd-2190-4471-b104-2e7849ab4bb1 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:11.280559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:11.300119 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7dfdd-2190-4471-b104-2e7849ab4bb1 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:11.333891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d5328-575b-48a7-9296-688fb23e6a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:11.334608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d5328-575b-48a7-9296-688fb23e6a47 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:11.334894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d5328-575b-48a7-9296-688fb23e6a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:11.335179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d5328-575b-48a7-9296-688fb23e6a47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:11.346086 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d5328-575b-48a7-9296-688fb23e6a47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-2d5d5328-575b-48a7-9296-688fb23e6a47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:27:11.353963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:27:11.355664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:27:11.356580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:27:11.356580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:27:11.356580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:27:11.356580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:27:11.356580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:27:11.356580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:27:11.356580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:27:11.356580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:27:11.356580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:27:11.356580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:27:11.356580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:27:11.356580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:27:11.356580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 572/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:27:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:27:11.362129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a499e-68a8-44ff-9323-ddcb536b6133 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:11.450029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:11.458258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a499e-68a8-44ff-9323-ddcb536b6133 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:11.492248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef23165-ef43-4291-b052-e852ec9e31a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:11.492923 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef23165-ef43-4291-b052-e852ec9e31a1 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:11.493239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef23165-ef43-4291-b052-e852ec9e31a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:11.493520 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef23165-ef43-4291-b052-e852ec9e31a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:11.494266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef23165-ef43-4291-b052-e852ec9e31a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:27:11.494579 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef23165-ef43-4291-b052-e852ec9e31a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:11.496765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef23165-ef43-4291-b052-e852ec9e31a1 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:11.504594 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 570/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:27:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:11.510481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d5328-575b-48a7-9296-688fb23e6a47 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:11.608681 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d5328-575b-48a7-9296-688fb23e6a47 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:11.644704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92055a-e277-4b3c-a06f-c6cf1227f5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:11.645634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92055a-e277-4b3c-a06f-c6cf1227f5cf None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:11.645924 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92055a-e277-4b3c-a06f-c6cf1227f5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:11.646203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92055a-e277-4b3c-a06f-c6cf1227f5cf None admin] PATH_INFO: `/v3/users/8db60fe0568346e28d4534fe799dc9ba` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:11.665359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92055a-e277-4b3c-a06f-c6cf1227f5cf None admin] RBAC: Authorizing `identity:get_user(user_id=8db60fe0568346e28d4534fe799dc9ba)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:11.666832 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92055a-e277-4b3c-a06f-c6cf1227f5cf None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:11.668713 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 573/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:27:11 2022] GET /identity/v3/users/8db60fe0568346e28d4534fe799dc9ba => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:11.674615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef23165-ef43-4291-b052-e852ec9e31a1 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:11.823036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef23165-ef43-4291-b052-e852ec9e31a1 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:11.856307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d089e71-4999-4552-b062-552c0f0702e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:11.856968 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d089e71-4999-4552-b062-552c0f0702e6 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:11.857255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d089e71-4999-4552-b062-552c0f0702e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:11.857531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d089e71-4999-4552-b062-552c0f0702e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:11.879834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:11.921332 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d089e71-4999-4552-b062-552c0f0702e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:11.922766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d089e71-4999-4552-b062-552c0f0702e6 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:12.032952 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 571/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:27:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:27:12.038862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92055a-e277-4b3c-a06f-c6cf1227f5cf None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:12.042672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:12.135893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92055a-e277-4b3c-a06f-c6cf1227f5cf None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:12.169421 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac52ec-27ee-428b-97e0-ce66a54f1543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:12.170271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac52ec-27ee-428b-97e0-ce66a54f1543 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:12.170571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac52ec-27ee-428b-97e0-ce66a54f1543 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:12.170844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac52ec-27ee-428b-97e0-ce66a54f1543 None admin] PATH_INFO: `/v3/projects/d578ba175d144c569942caf82c415bec` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:12.171995 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac52ec-27ee-428b-97e0-ce66a54f1543 None admin] RBAC: Authorizing `identity:get_project(project_id=d578ba175d144c569942caf82c415bec)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:12.173454 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac52ec-27ee-428b-97e0-ce66a54f1543 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:12.175104 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 574/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:27:12 2022] GET /identity/v3/projects/d578ba175d144c569942caf82c415bec => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:12.181178 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d089e71-4999-4552-b062-552c0f0702e6 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:12.235932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:12.278744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d089e71-4999-4552-b062-552c0f0702e6 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:12.312163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6dac83-d09c-42c8-a1ba-0229141b2d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:12.312813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dac83-d09c-42c8-a1ba-0229141b2d0e None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:12.313132 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dac83-d09c-42c8-a1ba-0229141b2d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:12.313415 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dac83-d09c-42c8-a1ba-0229141b2d0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:12.314245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6dac83-d09c-42c8-a1ba-0229141b2d0e None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=d578ba175d144c569942caf82c415bec, user.id=8db60fe0568346e28d4534fe799dc9ba) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:27:12.314562 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6dac83-d09c-42c8-a1ba-0229141b2d0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:12.316014 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6dac83-d09c-42c8-a1ba-0229141b2d0e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:12.321492 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 572/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:27:12 2022] GET /identity/v3/role_assignments?user.id=8db60fe0568346e28d4534fe799dc9ba&scope.project.id=d578ba175d144c569942caf82c415bec&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:14.546128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b61db-b50c-4828-a4fe-58e0d31269eb None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:14.546651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b61db-b50c-4828-a4fe-58e0d31269eb None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:14.546749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b61db-b50c-4828-a4fe-58e0d31269eb None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:14.548043 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 575/1147] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:27:14.553366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2cac3-27f8-41be-8cea-574e4f804ed2 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:14.553795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2cac3-27f8-41be-8cea-574e4f804ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:14.553923 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2cac3-27f8-41be-8cea-574e4f804ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:14.570841 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-2cc2cac3-27f8-41be-8cea-574e4f804ed2 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:27:14.572002 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-2cc2cac3-27f8-41be-8cea-574e4f804ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:27:14.635357 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 573/1148] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:27:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:27:14.658029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b61db-b50c-4828-a4fe-58e0d31269eb None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:14.728385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:14.758031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b61db-b50c-4828-a4fe-58e0d31269eb None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:14.791756 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee5228-36c1-4f98-82c1-b4232da05bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:14.792660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee5228-36c1-4f98-82c1-b4232da05bcf None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:14.792967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee5228-36c1-4f98-82c1-b4232da05bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:14.793237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee5228-36c1-4f98-82c1-b4232da05bcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:14.803162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee5228-36c1-4f98-82c1-b4232da05bcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-52ee5228-36c1-4f98-82c1-b4232da05bcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:27:14.811326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:27:14.812425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:27:14.813371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:27:14.813371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:27:14.813371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:27:14.813371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:27:14.813371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:27:14.813371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:27:14.813371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:27:14.813371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:27:14.813371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:27:14.813371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:27:14.813371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:27:14.813371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:27:14.813371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 576/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:27:14.818468 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2cac3-27f8-41be-8cea-574e4f804ed2 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:14.866487 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:14.919159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2cac3-27f8-41be-8cea-574e4f804ed2 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:14.952993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329300d-565f-4595-8c0a-cb9b830a182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:14.953658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329300d-565f-4595-8c0a-cb9b830a182e None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:14.953944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329300d-565f-4595-8c0a-cb9b830a182e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:14.954221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329300d-565f-4595-8c0a-cb9b830a182e None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:14.954956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329300d-565f-4595-8c0a-cb9b830a182e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:27:14.955263 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329300d-565f-4595-8c0a-cb9b830a182e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:14.956629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329300d-565f-4595-8c0a-cb9b830a182e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:14.964885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 574/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:14.970793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee5228-36c1-4f98-82c1-b4232da05bcf None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:15.068568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee5228-36c1-4f98-82c1-b4232da05bcf None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:15.097613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:15.102567 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b709ad-36cf-4f61-8f15-9bedabb980b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:15.103433 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b709ad-36cf-4f61-8f15-9bedabb980b2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:15.103707 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b709ad-36cf-4f61-8f15-9bedabb980b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:15.103976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b709ad-36cf-4f61-8f15-9bedabb980b2 None admin] PATH_INFO: `/v3/users/8db60fe0568346e28d4534fe799dc9ba` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:15.105888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b709ad-36cf-4f61-8f15-9bedabb980b2 None admin] RBAC: Authorizing `identity:get_user(user_id=8db60fe0568346e28d4534fe799dc9ba)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:15.110149 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b709ad-36cf-4f61-8f15-9bedabb980b2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:15.110149 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 577/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:27:14 2022] GET /identity/v3/users/8db60fe0568346e28d4534fe799dc9ba => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:15.114643 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329300d-565f-4595-8c0a-cb9b830a182e None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:15.211959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329300d-565f-4595-8c0a-cb9b830a182e None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:15.221886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:15.244758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf97f7-422a-4d95-b6b4-cea4b2df762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:15.246178 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf97f7-422a-4d95-b6b4-cea4b2df762a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:15.246462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf97f7-422a-4d95-b6b4-cea4b2df762a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:15.246758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf97f7-422a-4d95-b6b4-cea4b2df762a None admin] PATH_INFO: `/v3/projects/d578ba175d144c569942caf82c415bec` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:15.247918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf97f7-422a-4d95-b6b4-cea4b2df762a None admin] RBAC: Authorizing `identity:get_project(project_id=d578ba175d144c569942caf82c415bec)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:15.249421 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf97f7-422a-4d95-b6b4-cea4b2df762a None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:15.251126 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 575/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:27:15 2022] GET /identity/v3/projects/d578ba175d144c569942caf82c415bec => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:15.257144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b709ad-36cf-4f61-8f15-9bedabb980b2 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:15.355579 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b709ad-36cf-4f61-8f15-9bedabb980b2 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:15.388624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349743a-5cd0-4784-a8c1-1adc64e249cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:15.389527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349743a-5cd0-4784-a8c1-1adc64e249cc None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:15.389815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349743a-5cd0-4784-a8c1-1adc64e249cc None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:15.390093 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349743a-5cd0-4784-a8c1-1adc64e249cc None admin] PATH_INFO: `/v3/projects/d578ba175d144c569942caf82c415bec/users/8db60fe0568346e28d4534fe799dc9ba/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:15.392036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349743a-5cd0-4784-a8c1-1adc64e249cc None admin] RBAC: Authorizing `identity:create_grant(project_id=d578ba175d144c569942caf82c415bec, user_id=8db60fe0568346e28d4534fe799dc9ba, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:15.393519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349743a-5cd0-4784-a8c1-1adc64e249cc None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:15.489030 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 578/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:27:15 2022] PUT /identity/v3/projects/d578ba175d144c569942caf82c415bec/users/8db60fe0568346e28d4534fe799dc9ba/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:27:17.702383 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9fb36-c1d0-4cc3-930c-b401f147d92e None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:17.702909 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9fb36-c1d0-4cc3-930c-b401f147d92e None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:17.702909 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9fb36-c1d0-4cc3-930c-b401f147d92e None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:17.704284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 576/1154] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:27:17.709474 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538c9a2-4664-4061-a194-7a7186292f6f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:17.711933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538c9a2-4664-4061-a194-7a7186292f6f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:17.711933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538c9a2-4664-4061-a194-7a7186292f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:17.728050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d538c9a2-4664-4061-a194-7a7186292f6f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:27:17.729338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d538c9a2-4664-4061-a194-7a7186292f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:27:17.783986 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:17.795586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 579/1155] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:27:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:27:17.819243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9fb36-c1d0-4cc3-930c-b401f147d92e None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:17.918591 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9fb36-c1d0-4cc3-930c-b401f147d92e None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:17.951860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93eed6-5a2a-4f21-9552-6c5f3ade0e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:17.952637 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93eed6-5a2a-4f21-9552-6c5f3ade0e1f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:17.952916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93eed6-5a2a-4f21-9552-6c5f3ade0e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:17.953222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93eed6-5a2a-4f21-9552-6c5f3ade0e1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:17.963542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93eed6-5a2a-4f21-9552-6c5f3ade0e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-0d93eed6-5a2a-4f21-9552-6c5f3ade0e1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:27:17.971201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:27:17.972380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:27:17.973822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:27:17.973822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:27:17.973822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:27:17.973822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:27:17.973822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:27:17.973822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:27:17.973822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:27:17.973822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:27:17.973822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:27:17.973822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:27:17.973822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:27:17.973822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:27:17.973822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 577/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:27:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:27:17.978922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538c9a2-4664-4061-a194-7a7186292f6f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:18.079374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538c9a2-4664-4061-a194-7a7186292f6f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:18.112393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56628d-471d-46fd-91c5-d7ea57fac35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:18.113085 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56628d-471d-46fd-91c5-d7ea57fac35b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:18.113374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56628d-471d-46fd-91c5-d7ea57fac35b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:18.113652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56628d-471d-46fd-91c5-d7ea57fac35b None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:18.114403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56628d-471d-46fd-91c5-d7ea57fac35b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:27:18.114712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56628d-471d-46fd-91c5-d7ea57fac35b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:18.116089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56628d-471d-46fd-91c5-d7ea57fac35b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:18.124447 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 580/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:27:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:18.130264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93eed6-5a2a-4f21-9552-6c5f3ade0e1f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:18.169390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:18.226626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93eed6-5a2a-4f21-9552-6c5f3ade0e1f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:18.259947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6b47a-d442-4719-8eb6-64d5eb1fc77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:18.261348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b47a-d442-4719-8eb6-64d5eb1fc77e None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:18.261637 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b47a-d442-4719-8eb6-64d5eb1fc77e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:18.262084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6b47a-d442-4719-8eb6-64d5eb1fc77e None admin] PATH_INFO: `/v3/users/8db60fe0568346e28d4534fe799dc9ba` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:18.263259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6b47a-d442-4719-8eb6-64d5eb1fc77e None admin] RBAC: Authorizing `identity:get_user(user_id=8db60fe0568346e28d4534fe799dc9ba)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:18.264718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6b47a-d442-4719-8eb6-64d5eb1fc77e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:18.266352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 578/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:27:18 2022] GET /identity/v3/users/8db60fe0568346e28d4534fe799dc9ba => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:18.272096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56628d-471d-46fd-91c5-d7ea57fac35b None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:18.324374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:18.371273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56628d-471d-46fd-91c5-d7ea57fac35b None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:18.404049 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762a95e-9a3d-43e3-b213-1af25813d46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:18.404690 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762a95e-9a3d-43e3-b213-1af25813d46a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:18.405004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762a95e-9a3d-43e3-b213-1af25813d46a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:18.405289 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762a95e-9a3d-43e3-b213-1af25813d46a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:18.471129 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762a95e-9a3d-43e3-b213-1af25813d46a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:18.472586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762a95e-9a3d-43e3-b213-1af25813d46a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:18.522337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:18.568551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 581/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:27:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:27:18.574455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6b47a-d442-4719-8eb6-64d5eb1fc77e None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:18.670140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6b47a-d442-4719-8eb6-64d5eb1fc77e None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:18.677028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:18.702122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a010ba-31c0-4614-8a62-2b5f48870ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:18.702960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a010ba-31c0-4614-8a62-2b5f48870ddd None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:18.703526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a010ba-31c0-4614-8a62-2b5f48870ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:18.703526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a010ba-31c0-4614-8a62-2b5f48870ddd None admin] PATH_INFO: `/v3/projects/d578ba175d144c569942caf82c415bec` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:18.704627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a010ba-31c0-4614-8a62-2b5f48870ddd None admin] RBAC: Authorizing `identity:get_project(project_id=d578ba175d144c569942caf82c415bec)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:18.706079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a010ba-31c0-4614-8a62-2b5f48870ddd None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:18.708010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 579/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:27:18 2022] GET /identity/v3/projects/d578ba175d144c569942caf82c415bec => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:27:18.713749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762a95e-9a3d-43e3-b213-1af25813d46a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:18.812413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762a95e-9a3d-43e3-b213-1af25813d46a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:18.845457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5168097-c5eb-49d9-8548-b54884378ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:18.846100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5168097-c5eb-49d9-8548-b54884378ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:18.846387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5168097-c5eb-49d9-8548-b54884378ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:18.846668 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5168097-c5eb-49d9-8548-b54884378ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:18.847493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5168097-c5eb-49d9-8548-b54884378ea8 None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=d578ba175d144c569942caf82c415bec, user.id=8db60fe0568346e28d4534fe799dc9ba) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:27:18.847808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5168097-c5eb-49d9-8548-b54884378ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:18.849541 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5168097-c5eb-49d9-8548-b54884378ea8 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:18.855263 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 582/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:27:18 2022] GET /identity/v3/role_assignments?user.id=8db60fe0568346e28d4534fe799dc9ba&scope.project.id=d578ba175d144c569942caf82c415bec&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:21.095370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f04b5-e822-4bd6-94eb-b44d8a2ef5fe None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:21.095937 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f04b5-e822-4bd6-94eb-b44d8a2ef5fe None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:21.095937 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f04b5-e822-4bd6-94eb-b44d8a2ef5fe None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:21.097324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 580/1162] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:27:21.102800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1334ff2-6c13-4855-9a98-b8414bb495ae None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:21.103222 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1334ff2-6c13-4855-9a98-b8414bb495ae None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:21.103362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1334ff2-6c13-4855-9a98-b8414bb495ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:21.121002 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a1334ff2-6c13-4855-9a98-b8414bb495ae None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:27:21.122198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a1334ff2-6c13-4855-9a98-b8414bb495ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:27:21.132575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:21.188400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 583/1163] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:27:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:27:21.210622 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f04b5-e822-4bd6-94eb-b44d8a2ef5fe None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:21.309358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f04b5-e822-4bd6-94eb-b44d8a2ef5fe None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:21.342454 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adabd1-e640-4dd7-be16-7f002f354334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:21.343093 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adabd1-e640-4dd7-be16-7f002f354334 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:21.343378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adabd1-e640-4dd7-be16-7f002f354334 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:21.343657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adabd1-e640-4dd7-be16-7f002f354334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:21.383682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:21.408287 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adabd1-e640-4dd7-be16-7f002f354334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:21.409753 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adabd1-e640-4dd7-be16-7f002f354334 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:21.506775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 581/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:27:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:27:21.513287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1334ff2-6c13-4855-9a98-b8414bb495ae None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:21.609982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1334ff2-6c13-4855-9a98-b8414bb495ae None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:21.642830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35532783-6b8a-4f76-ad97-d2bbe6d48b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:21.643560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532783-6b8a-4f76-ad97-d2bbe6d48b18 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:21.643843 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532783-6b8a-4f76-ad97-d2bbe6d48b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:21.644119 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532783-6b8a-4f76-ad97-d2bbe6d48b18 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:21.650612 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35532783-6b8a-4f76-ad97-d2bbe6d48b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:21.652774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35532783-6b8a-4f76-ad97-d2bbe6d48b18 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-35532783-6b8a-4f76-ad97-d2bbe6d48b18 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:27:21.666502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:27:21.668361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:27:21.669347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:27:21.669347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:27:21.669347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:27:21.669347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:27:21.669347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:27:21.669347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:27:21.669347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:27:21.669347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:27:21.669347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:27:21.669347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:27:21.669347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 01 17:27:21.669347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:27:21.669347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 01 17:27:21.669347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:27:21.669347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 584/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jun 1 17:27:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:27:21.674297 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adabd1-e640-4dd7-be16-7f002f354334 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:21.751967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:21.775784 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adabd1-e640-4dd7-be16-7f002f354334 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:21.810901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc43d1-d994-4e99-887d-fe340f075176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:21.811695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc43d1-d994-4e99-887d-fe340f075176 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:21.812180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc43d1-d994-4e99-887d-fe340f075176 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:21.812663 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc43d1-d994-4e99-887d-fe340f075176 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:21.813944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc43d1-d994-4e99-887d-fe340f075176 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:27:21.814260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc43d1-d994-4e99-887d-fe340f075176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:21.816172 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc43d1-d994-4e99-887d-fe340f075176 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:21.823403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 582/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Wed Jun 1 17:27:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:24.064256 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d8819-d752-41d2-abde-da3d92225063 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:24.064792 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d8819-d752-41d2-abde-da3d92225063 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:24.064792 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d8819-d752-41d2-abde-da3d92225063 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:24.066206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 585/1167] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:27:24.071545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15dd79-ff55-4aa0-baa4-81a13586d463 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:24.071932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15dd79-ff55-4aa0-baa4-81a13586d463 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:24.072118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15dd79-ff55-4aa0-baa4-81a13586d463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:24.089500 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-bb15dd79-ff55-4aa0-baa4-81a13586d463 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:27:24.090556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-bb15dd79-ff55-4aa0-baa4-81a13586d463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:27:24.155159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 583/1168] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:27:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:27:24.178474 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d8819-d752-41d2-abde-da3d92225063 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:24.187924 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:24.278509 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d8819-d752-41d2-abde-da3d92225063 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:24.311094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93748a47-df73-400a-a012-928bf64d11d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:24.311743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93748a47-df73-400a-a012-928bf64d11d2 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:24.312026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93748a47-df73-400a-a012-928bf64d11d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:24.312304 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93748a47-df73-400a-a012-928bf64d11d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:24.313078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93748a47-df73-400a-a012-928bf64d11d2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:24.314496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93748a47-df73-400a-a012-928bf64d11d2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:24.405502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 586/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Wed Jun 1 17:27:24 2022] POST /identity/v3/domains => generated 267 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:27:26.682818 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d8411-d0be-496f-a37d-15cc9dcf6f1d None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:26.683350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d8411-d0be-496f-a37d-15cc9dcf6f1d None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:26.683482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d8411-d0be-496f-a37d-15cc9dcf6f1d None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:26.684838 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 584/1170] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:27:26.690208 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612c6eb-f132-425d-ab0a-06ffff5529de None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:26.690630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612c6eb-f132-425d-ab0a-06ffff5529de None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:26.690763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612c6eb-f132-425d-ab0a-06ffff5529de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:26.708152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2612c6eb-f132-425d-ab0a-06ffff5529de None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:27:26.709390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2612c6eb-f132-425d-ab0a-06ffff5529de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:27:26.771142 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:26.779193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 587/1171] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:27:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:27:26.802610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d8411-d0be-496f-a37d-15cc9dcf6f1d None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:26.869503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:26.903309 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d8411-d0be-496f-a37d-15cc9dcf6f1d None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:26.935933 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a01ef0-bf87-4e9e-90d7-d3cbad483585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:26.936805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a01ef0-bf87-4e9e-90d7-d3cbad483585 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:26.937113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a01ef0-bf87-4e9e-90d7-d3cbad483585 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:26.937387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a01ef0-bf87-4e9e-90d7-d3cbad483585 None admin] PATH_INFO: `/v3/domains/fbd07aaadbe748b29a7b9d7b3a617d24` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:26.947338 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a01ef0-bf87-4e9e-90d7-d3cbad483585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fbd07aaadbe748b29a7b9d7b3a617d24)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:26.948920 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a01ef0-bf87-4e9e-90d7-d3cbad483585 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:26.950621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 585/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Wed Jun 1 17:27:26 2022] GET /identity/v3/domains/fbd07aaadbe748b29a7b9d7b3a617d24 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:26.956458 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612c6eb-f132-425d-ab0a-06ffff5529de None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:27.055851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612c6eb-f132-425d-ab0a-06ffff5529de None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:27.097486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a747f-bcea-4b90-bcb8-7921406c0aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:27.098151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a747f-bcea-4b90-bcb8-7921406c0aa7 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:27.098437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a747f-bcea-4b90-bcb8-7921406c0aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:27.098714 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a747f-bcea-4b90-bcb8-7921406c0aa7 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:27.099682 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a747f-bcea-4b90-bcb8-7921406c0aa7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:27.101139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a747f-bcea-4b90-bcb8-7921406c0aa7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:27.210079 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 588/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jun 1 17:27:26 2022] POST /identity/v3/projects => generated 361 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:27:29.493286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e09b9f-d9dd-47d7-b932-3245eb2be799 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:29.493745 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e09b9f-d9dd-47d7-b932-3245eb2be799 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:29.493855 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e09b9f-d9dd-47d7-b932-3245eb2be799 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:29.495205 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 586/1174] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:27:29.500580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e6dcc-3ef1-4bdb-84c4-0029c700dd5d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:29.501061 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e6dcc-3ef1-4bdb-84c4-0029c700dd5d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:29.501158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e6dcc-3ef1-4bdb-84c4-0029c700dd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:29.518338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a11e6dcc-3ef1-4bdb-84c4-0029c700dd5d None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:27:29.519514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a11e6dcc-3ef1-4bdb-84c4-0029c700dd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:27:29.562180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:29.583773 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 589/1175] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:27:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:27:29.608858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e09b9f-d9dd-47d7-b932-3245eb2be799 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:29.711330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e09b9f-d9dd-47d7-b932-3245eb2be799 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:29.739080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:29.747231 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb1d90-4613-4e23-b6ea-88957fe3679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:29.759450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1d90-4613-4e23-b6ea-88957fe3679d None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:29.759450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1d90-4613-4e23-b6ea-88957fe3679d None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:29.759450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb1d90-4613-4e23-b6ea-88957fe3679d None admin] PATH_INFO: `/v3/domains/fbd07aaadbe748b29a7b9d7b3a617d24` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:29.759450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb1d90-4613-4e23-b6ea-88957fe3679d None admin] RBAC: Authorizing `identity:get_domain(domain_id=fbd07aaadbe748b29a7b9d7b3a617d24)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:29.759450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb1d90-4613-4e23-b6ea-88957fe3679d None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:29.759450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 587/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Wed Jun 1 17:27:29 2022] GET /identity/v3/domains/fbd07aaadbe748b29a7b9d7b3a617d24 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:29.759971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e6dcc-3ef1-4bdb-84c4-0029c700dd5d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:29.855858 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e6dcc-3ef1-4bdb-84c4-0029c700dd5d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:29.891075 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca899c8e-d438-42c4-af47-2e42c3b7e756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:29.891739 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca899c8e-d438-42c4-af47-2e42c3b7e756 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:29.892017 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca899c8e-d438-42c4-af47-2e42c3b7e756 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:29.892288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca899c8e-d438-42c4-af47-2e42c3b7e756 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:29.893021 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca899c8e-d438-42c4-af47-2e42c3b7e756 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:29.894478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca899c8e-d438-42c4-af47-2e42c3b7e756 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:29.984552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 590/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:27:29 2022] POST /identity/v3/users => generated 311 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:27:32.266817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4567dd-3b56-41c8-8d98-14044e08b48a None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:32.267353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4567dd-3b56-41c8-8d98-14044e08b48a None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:32.267353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4567dd-3b56-41c8-8d98-14044e08b48a None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:32.268742 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 588/1178] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:27:32.274166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c86aa4-e522-4bed-ad31-80e08dafc815 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:32.274604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c86aa4-e522-4bed-ad31-80e08dafc815 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:32.274710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c86aa4-e522-4bed-ad31-80e08dafc815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:32.291603 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-69c86aa4-e522-4bed-ad31-80e08dafc815 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:27:32.293439 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-69c86aa4-e522-4bed-ad31-80e08dafc815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:27:32.319330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:32.359012 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 591/1179] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:27:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 01 17:27:32.382100 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4567dd-3b56-41c8-8d98-14044e08b48a None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:32.483082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4567dd-3b56-41c8-8d98-14044e08b48a None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:32.516165 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad103c7-18b7-4c2a-8c7f-68a9315d8576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:32.517030 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad103c7-18b7-4c2a-8c7f-68a9315d8576 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:32.517266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad103c7-18b7-4c2a-8c7f-68a9315d8576 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:32.517543 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad103c7-18b7-4c2a-8c7f-68a9315d8576 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:32.527814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad103c7-18b7-4c2a-8c7f-68a9315d8576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-2ad103c7-18b7-4c2a-8c7f-68a9315d8576 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:27:32.535324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:27:32.536512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:27:32.537684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:27:32.537684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:27:32.537684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:27:32.537684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:27:32.537684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:27:32.537684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:27:32.537684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:27:32.537684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:27:32.537684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:27:32.537684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:27:32.537684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:27:32.537684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:27:32.537684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 589/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:27:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:27:32.542610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c86aa4-e522-4bed-ad31-80e08dafc815 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:32.640270 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c86aa4-e522-4bed-ad31-80e08dafc815 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:32.677322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf919da7-836d-4e8b-a5a5-e18f668d1f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:32.678006 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf919da7-836d-4e8b-a5a5-e18f668d1f4e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:32.678290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf919da7-836d-4e8b-a5a5-e18f668d1f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:32.678562 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf919da7-836d-4e8b-a5a5-e18f668d1f4e None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:32.679310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf919da7-836d-4e8b-a5a5-e18f668d1f4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:27:32.679613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf919da7-836d-4e8b-a5a5-e18f668d1f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:32.680997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf919da7-836d-4e8b-a5a5-e18f668d1f4e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:32.689824 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 592/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:27:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:32.695635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad103c7-18b7-4c2a-8c7f-68a9315d8576 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:32.791992 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:32.833722 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad103c7-18b7-4c2a-8c7f-68a9315d8576 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:32.866476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506be95-68ba-4ce5-a189-6c44f36ba018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:32.867334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506be95-68ba-4ce5-a189-6c44f36ba018 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:32.867613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506be95-68ba-4ce5-a189-6c44f36ba018 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:32.867888 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506be95-68ba-4ce5-a189-6c44f36ba018 None admin] PATH_INFO: `/v3/users/603829318f5142919a4ffb4851c4c8bf` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:32.880950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506be95-68ba-4ce5-a189-6c44f36ba018 None admin] RBAC: Authorizing `identity:get_user(user_id=603829318f5142919a4ffb4851c4c8bf)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:32.882403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506be95-68ba-4ce5-a189-6c44f36ba018 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:32.884019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 590/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:27:32 2022] GET /identity/v3/users/603829318f5142919a4ffb4851c4c8bf => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:32.889944 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf919da7-836d-4e8b-a5a5-e18f668d1f4e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:32.917464 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:32.988728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf919da7-836d-4e8b-a5a5-e18f668d1f4e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:33.021461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097aac6-8074-4802-b7a0-1c9f186e1726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:33.022102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097aac6-8074-4802-b7a0-1c9f186e1726 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:33.022390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097aac6-8074-4802-b7a0-1c9f186e1726 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:33.022671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097aac6-8074-4802-b7a0-1c9f186e1726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:33.090151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097aac6-8074-4802-b7a0-1c9f186e1726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:33.091775 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097aac6-8074-4802-b7a0-1c9f186e1726 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:33.117481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:33.188156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 593/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:27:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:27:33.194006 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506be95-68ba-4ce5-a189-6c44f36ba018 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:33.291970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506be95-68ba-4ce5-a189-6c44f36ba018 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:33.305526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:33.325065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b236318-c84a-44ba-bcf7-3a20e4163ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:33.325940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b236318-c84a-44ba-bcf7-3a20e4163ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:33.326225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b236318-c84a-44ba-bcf7-3a20e4163ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:33.326495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b236318-c84a-44ba-bcf7-3a20e4163ee7 None admin] PATH_INFO: `/v3/projects/537f427f807c42c2a89af91e43c20ff0` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:33.327652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b236318-c84a-44ba-bcf7-3a20e4163ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=537f427f807c42c2a89af91e43c20ff0)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:33.329224 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b236318-c84a-44ba-bcf7-3a20e4163ee7 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:33.330926 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 591/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:27:33 2022] GET /identity/v3/projects/537f427f807c42c2a89af91e43c20ff0 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:33.337519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097aac6-8074-4802-b7a0-1c9f186e1726 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:33.434967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097aac6-8074-4802-b7a0-1c9f186e1726 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:33.459565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:33.468630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4f9d3-9368-4d68-b06e-d4dea11159ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:33.474608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4f9d3-9368-4d68-b06e-d4dea11159ce None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:33.474608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4f9d3-9368-4d68-b06e-d4dea11159ce None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:33.474608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4f9d3-9368-4d68-b06e-d4dea11159ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:33.474608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4f9d3-9368-4d68-b06e-d4dea11159ce None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=537f427f807c42c2a89af91e43c20ff0, user.id=603829318f5142919a4ffb4851c4c8bf) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:27:33.474608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4f9d3-9368-4d68-b06e-d4dea11159ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:33.474608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4f9d3-9368-4d68-b06e-d4dea11159ce None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:33.478066 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 594/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:27:33 2022] GET /identity/v3/role_assignments?user.id=603829318f5142919a4ffb4851c4c8bf&scope.project.id=537f427f807c42c2a89af91e43c20ff0&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:35.694683 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9833f-40b1-4297-a659-ebe09350a60d None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:35.695211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9833f-40b1-4297-a659-ebe09350a60d None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:35.695305 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9833f-40b1-4297-a659-ebe09350a60d None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:35.696609 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 592/1186] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:27:35.702108 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648672e-5513-4fa5-9910-3426ff851fd3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:35.702547 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648672e-5513-4fa5-9910-3426ff851fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:35.702673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648672e-5513-4fa5-9910-3426ff851fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:35.719363 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-4648672e-5513-4fa5-9910-3426ff851fd3 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:27:35.720598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4648672e-5513-4fa5-9910-3426ff851fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:27:35.789657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 595/1187] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:27:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:27:35.812868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9833f-40b1-4297-a659-ebe09350a60d None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:35.914032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9833f-40b1-4297-a659-ebe09350a60d None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:35.946697 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f56b6f-2fd0-4308-b000-584e35fce7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:35.947476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f56b6f-2fd0-4308-b000-584e35fce7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:35.947759 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f56b6f-2fd0-4308-b000-584e35fce7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:35.948036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f56b6f-2fd0-4308-b000-584e35fce7c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:35.958012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f56b6f-2fd0-4308-b000-584e35fce7c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-a8f56b6f-2fd0-4308-b000-584e35fce7c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:27:35.966071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:27:35.967005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:27:35.967979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:27:35.967979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:27:35.967979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:27:35.967979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:27:35.967979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:27:35.967979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:27:35.967979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:27:35.967979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:27:35.967979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:27:35.967979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:27:35.967979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:27:35.967979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:27:35.969079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 593/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:27:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:27:35.973391 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648672e-5513-4fa5-9910-3426ff851fd3 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:36.069762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648672e-5513-4fa5-9910-3426ff851fd3 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:36.088677 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:36.102868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630368bc-df5f-4ff5-9eb0-5356379b6435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:36.109530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630368bc-df5f-4ff5-9eb0-5356379b6435 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:36.109530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630368bc-df5f-4ff5-9eb0-5356379b6435 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:36.109530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630368bc-df5f-4ff5-9eb0-5356379b6435 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:36.109530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630368bc-df5f-4ff5-9eb0-5356379b6435 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:27:36.109530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630368bc-df5f-4ff5-9eb0-5356379b6435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:36.109530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630368bc-df5f-4ff5-9eb0-5356379b6435 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:36.115182 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 596/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:27:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:36.121092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f56b6f-2fd0-4308-b000-584e35fce7c3 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:36.163561 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:36.219938 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f56b6f-2fd0-4308-b000-584e35fce7c3 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:36.252052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc739829-56f5-4997-8b89-825f80d88095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:36.252912 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc739829-56f5-4997-8b89-825f80d88095 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:36.253227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc739829-56f5-4997-8b89-825f80d88095 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:36.253505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc739829-56f5-4997-8b89-825f80d88095 None admin] PATH_INFO: `/v3/users/603829318f5142919a4ffb4851c4c8bf` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:36.254672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc739829-56f5-4997-8b89-825f80d88095 None admin] RBAC: Authorizing `identity:get_user(user_id=603829318f5142919a4ffb4851c4c8bf)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:36.256123 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc739829-56f5-4997-8b89-825f80d88095 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:36.257763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 594/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:27:36 2022] GET /identity/v3/users/603829318f5142919a4ffb4851c4c8bf => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:36.264012 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630368bc-df5f-4ff5-9eb0-5356379b6435 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:36.361461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630368bc-df5f-4ff5-9eb0-5356379b6435 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:36.393899 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233a3a1-5cba-41e4-8e85-5bbe583db097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:36.394754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a3a1-5cba-41e4-8e85-5bbe583db097 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:36.395040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a3a1-5cba-41e4-8e85-5bbe583db097 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:36.395317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233a3a1-5cba-41e4-8e85-5bbe583db097 None admin] PATH_INFO: `/v3/projects/537f427f807c42c2a89af91e43c20ff0` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:36.396490 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233a3a1-5cba-41e4-8e85-5bbe583db097 None admin] RBAC: Authorizing `identity:get_project(project_id=537f427f807c42c2a89af91e43c20ff0)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:36.397965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233a3a1-5cba-41e4-8e85-5bbe583db097 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:36.399638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 597/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:27:36 2022] GET /identity/v3/projects/537f427f807c42c2a89af91e43c20ff0 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:36.405989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc739829-56f5-4997-8b89-825f80d88095 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:36.504112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc739829-56f5-4997-8b89-825f80d88095 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:36.514051 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:36.536344 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a043f2d-be52-4a90-b817-dfb34c48a5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:36.537260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a043f2d-be52-4a90-b817-dfb34c48a5c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:36.537540 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a043f2d-be52-4a90-b817-dfb34c48a5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:36.537812 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a043f2d-be52-4a90-b817-dfb34c48a5c6 None admin] PATH_INFO: `/v3/projects/537f427f807c42c2a89af91e43c20ff0/users/603829318f5142919a4ffb4851c4c8bf/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:36.539717 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a043f2d-be52-4a90-b817-dfb34c48a5c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=537f427f807c42c2a89af91e43c20ff0, user_id=603829318f5142919a4ffb4851c4c8bf, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:36.541336 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a043f2d-be52-4a90-b817-dfb34c48a5c6 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:36.612687 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 595/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:27:36 2022] PUT /identity/v3/projects/537f427f807c42c2a89af91e43c20ff0/users/603829318f5142919a4ffb4851c4c8bf/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:27:38.826313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26934a-df2d-4707-846f-866a1eca95ff None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:38.826878 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26934a-df2d-4707-846f-866a1eca95ff None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:38.826878 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26934a-df2d-4707-846f-866a1eca95ff None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:38.828227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 598/1193] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:27:38.833491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9896a-87f4-4dca-a1f9-020b39931bd0 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:38.833893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9896a-87f4-4dca-a1f9-020b39931bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:38.834057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9896a-87f4-4dca-a1f9-020b39931bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:38.851138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-a6e9896a-87f4-4dca-a1f9-020b39931bd0 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:27:38.852320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a6e9896a-87f4-4dca-a1f9-020b39931bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:27:38.916198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 596/1194] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:27:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:27:38.940196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26934a-df2d-4707-846f-866a1eca95ff None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:38.990851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:39.040381 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26934a-df2d-4707-846f-866a1eca95ff None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:39.072840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a697bb-d62f-40ab-a4e1-fffaa2cbd07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:39.073639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a697bb-d62f-40ab-a4e1-fffaa2cbd07d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:39.073917 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a697bb-d62f-40ab-a4e1-fffaa2cbd07d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:39.074189 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a697bb-d62f-40ab-a4e1-fffaa2cbd07d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:39.085017 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a697bb-d62f-40ab-a4e1-fffaa2cbd07d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-89a697bb-d62f-40ab-a4e1-fffaa2cbd07d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:27:39.092608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:27:39.093747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:27:39.094894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:27:39.094894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:27:39.094894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:27:39.094894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:27:39.094894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:27:39.094894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:27:39.094894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:27:39.094894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:27:39.094894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:27:39.094894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:27:39.094894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:27:39.094894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:27:39.094894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 599/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:27:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:27:39.100269 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9896a-87f4-4dca-a1f9-020b39931bd0 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:39.192592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:39.195396 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9896a-87f4-4dca-a1f9-020b39931bd0 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:39.229573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b4050-9121-452f-8e83-e635a98a58a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:39.230258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b4050-9121-452f-8e83-e635a98a58a1 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:39.231064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b4050-9121-452f-8e83-e635a98a58a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:39.231338 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b4050-9121-452f-8e83-e635a98a58a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:39.232073 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b4050-9121-452f-8e83-e635a98a58a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:27:39.232376 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b4050-9121-452f-8e83-e635a98a58a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:39.233761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b4050-9121-452f-8e83-e635a98a58a1 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:39.241726 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 597/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:27:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:39.248235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a697bb-d62f-40ab-a4e1-fffaa2cbd07d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:39.345734 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a697bb-d62f-40ab-a4e1-fffaa2cbd07d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:39.356755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:39.379704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920f288-1475-4dd4-a0b4-f764384ac92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:39.380609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920f288-1475-4dd4-a0b4-f764384ac92f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:39.380893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920f288-1475-4dd4-a0b4-f764384ac92f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:39.381199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920f288-1475-4dd4-a0b4-f764384ac92f None admin] PATH_INFO: `/v3/users/603829318f5142919a4ffb4851c4c8bf` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:39.382370 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920f288-1475-4dd4-a0b4-f764384ac92f None admin] RBAC: Authorizing `identity:get_user(user_id=603829318f5142919a4ffb4851c4c8bf)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:39.383820 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920f288-1475-4dd4-a0b4-f764384ac92f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:39.385465 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 600/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Wed Jun 1 17:27:39 2022] GET /identity/v3/users/603829318f5142919a4ffb4851c4c8bf => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:27:39.391350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b4050-9121-452f-8e83-e635a98a58a1 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:39.488853 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b4050-9121-452f-8e83-e635a98a58a1 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:39.521865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a16e7e-b907-43f1-a9a3-37b6afb3e866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:39.522509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a16e7e-b907-43f1-a9a3-37b6afb3e866 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:39.522796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a16e7e-b907-43f1-a9a3-37b6afb3e866 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:39.523076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a16e7e-b907-43f1-a9a3-37b6afb3e866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:39.552784 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:39.589311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a16e7e-b907-43f1-a9a3-37b6afb3e866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:39.591366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a16e7e-b907-43f1-a9a3-37b6afb3e866 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:39.685808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 598/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:27:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:27:39.691602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920f288-1475-4dd4-a0b4-f764384ac92f None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:39.789075 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920f288-1475-4dd4-a0b4-f764384ac92f None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:39.822226 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f55d0a-8d5a-46c4-8044-e380811731d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:39.823071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f55d0a-8d5a-46c4-8044-e380811731d2 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:39.823352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f55d0a-8d5a-46c4-8044-e380811731d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:39.823625 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f55d0a-8d5a-46c4-8044-e380811731d2 None admin] PATH_INFO: `/v3/projects/537f427f807c42c2a89af91e43c20ff0` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:39.825602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f55d0a-8d5a-46c4-8044-e380811731d2 None admin] RBAC: Authorizing `identity:get_project(project_id=537f427f807c42c2a89af91e43c20ff0)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:39.827030 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f55d0a-8d5a-46c4-8044-e380811731d2 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:39.828687 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 601/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Wed Jun 1 17:27:39 2022] GET /identity/v3/projects/537f427f807c42c2a89af91e43c20ff0 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:39.834650 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a16e7e-b907-43f1-a9a3-37b6afb3e866 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:27:39.900266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:39.946490 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a16e7e-b907-43f1-a9a3-37b6afb3e866 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:27:39.980338 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb03a5a-8828-4515-a1c1-0ddb8ac49955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:27:39.981119 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb03a5a-8828-4515-a1c1-0ddb8ac49955 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:27:39.981403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb03a5a-8828-4515-a1c1-0ddb8ac49955 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:27:39.981679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb03a5a-8828-4515-a1c1-0ddb8ac49955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:27:39.982499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb03a5a-8828-4515-a1c1-0ddb8ac49955 None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=537f427f807c42c2a89af91e43c20ff0, user.id=603829318f5142919a4ffb4851c4c8bf) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:27:39.982809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb03a5a-8828-4515-a1c1-0ddb8ac49955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:27:39.984236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb03a5a-8828-4515-a1c1-0ddb8ac49955 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:27:39.989913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 599/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:27:39 2022] GET /identity/v3/role_assignments?user.id=603829318f5142919a4ffb4851c4c8bf&scope.project.id=537f427f807c42c2a89af91e43c20ff0&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:27:49.818206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=77 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:27:49.987283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=37 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:03.538798 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a46f33-3a17-4942-9772-be1b292a0dba None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:03.539369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a46f33-3a17-4942-9772-be1b292a0dba None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:03.539369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a46f33-3a17-4942-9772-be1b292a0dba None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:03.540962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 602/1201] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:29:03.546141 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8514a-14a4-43c4-a9cd-d792518f011e None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:03.546553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8514a-14a4-43c4-a9cd-d792518f011e None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:03.546696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8514a-14a4-43c4-a9cd-d792518f011e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:03.564561 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-32a8514a-14a4-43c4-a9cd-d792518f011e None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:29:03.565803 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-32a8514a-14a4-43c4-a9cd-d792518f011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:29:03.631273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 600/1202] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:29:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:29:03.656207 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a46f33-3a17-4942-9772-be1b292a0dba None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:03.758478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a46f33-3a17-4942-9772-be1b292a0dba None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:03.791425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894642b-fca4-4684-81a4-3b331a8e1255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:03.792205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894642b-fca4-4684-81a4-3b331a8e1255 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:03.792484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894642b-fca4-4684-81a4-3b331a8e1255 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:03.792783 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894642b-fca4-4684-81a4-3b331a8e1255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:03.802657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894642b-fca4-4684-81a4-3b331a8e1255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:03.804121 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894642b-fca4-4684-81a4-3b331a8e1255 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:03.821968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-0894642b-fca4-4684-81a4-3b331a8e1255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:03.821968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:03.821968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:03.821968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:03.821968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:03.821968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:03.821968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:03.821968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:03.821968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:03.821968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:03.821968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:03.821968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:03.821968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:29:03.821968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:29:03.821968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:03.822981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:03.824087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:29:03.824087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:29:03.824087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:03.824087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:03.824087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 603/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:03.829326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8514a-14a4-43c4-a9cd-d792518f011e None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:03.927044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8514a-14a4-43c4-a9cd-d792518f011e None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:03.955278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:03.960757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3eb7af-192c-4abe-b85b-7fb004b8fdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:03.961446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3eb7af-192c-4abe-b85b-7fb004b8fdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:03.961735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3eb7af-192c-4abe-b85b-7fb004b8fdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:03.962015 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3eb7af-192c-4abe-b85b-7fb004b8fdf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:03.962729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3eb7af-192c-4abe-b85b-7fb004b8fdf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:03.963063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3eb7af-192c-4abe-b85b-7fb004b8fdf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:03.964478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3eb7af-192c-4abe-b85b-7fb004b8fdf7 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:03.975519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 601/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:03.981572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894642b-fca4-4684-81a4-3b331a8e1255 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:04.034386 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:04.080080 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894642b-fca4-4684-81a4-3b331a8e1255 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:04.112697 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c12a2-86f6-471a-86a7-3ad14b00c724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:04.113401 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c12a2-86f6-471a-86a7-3ad14b00c724 None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:04.113687 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c12a2-86f6-471a-86a7-3ad14b00c724 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:04.113965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c12a2-86f6-471a-86a7-3ad14b00c724 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:04.114650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c12a2-86f6-471a-86a7-3ad14b00c724 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:04.116082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c12a2-86f6-471a-86a7-3ad14b00c724 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:04.257178 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 604/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Wed Jun 1 17:29:03 2022] POST /identity/v3/users => generated 251 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:29:06.541338 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d1ca9-042f-438e-b887-9e761599de72 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:06.541846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d1ca9-042f-438e-b887-9e761599de72 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:06.541961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d1ca9-042f-438e-b887-9e761599de72 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:06.543273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 602/1206] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:29:06.549912 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c2adc-e168-4211-b649-17c35e786cdc None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:06.550369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c2adc-e168-4211-b649-17c35e786cdc None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:06.550483 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c2adc-e168-4211-b649-17c35e786cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:06.567242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-063c2adc-e168-4211-b649-17c35e786cdc None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:29:06.568408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-063c2adc-e168-4211-b649-17c35e786cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:29:06.635164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 605/1207] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:29:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:29:06.659185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d1ca9-042f-438e-b887-9e761599de72 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:06.759676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d1ca9-042f-438e-b887-9e761599de72 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:06.792611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc6f53-e607-4565-a1b5-4f38e17a67d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:06.793428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc6f53-e607-4565-a1b5-4f38e17a67d7 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:06.793713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc6f53-e607-4565-a1b5-4f38e17a67d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:06.793991 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc6f53-e607-4565-a1b5-4f38e17a67d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:06.804997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc6f53-e607-4565-a1b5-4f38e17a67d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-3ddc6f53-e607-4565-a1b5-4f38e17a67d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:29:06.812730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:06.813903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:06.814835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:06.814835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:06.814835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:06.814835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:06.814835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:29:06.814835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:29:06.814835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:29:06.814835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:29:06.814835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:29:06.814835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:29:06.814835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:29:06.814835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:06.814835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 603/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:29:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:06.820294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c2adc-e168-4211-b649-17c35e786cdc None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:06.860577 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:06.919404 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c2adc-e168-4211-b649-17c35e786cdc None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:06.955378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18dd66-a9db-41de-bbf5-1f43de5d9239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:06.956081 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18dd66-a9db-41de-bbf5-1f43de5d9239 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:06.956369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18dd66-a9db-41de-bbf5-1f43de5d9239 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:06.956646 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18dd66-a9db-41de-bbf5-1f43de5d9239 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:06.957496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18dd66-a9db-41de-bbf5-1f43de5d9239 None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:06.957806 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18dd66-a9db-41de-bbf5-1f43de5d9239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:06.959210 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18dd66-a9db-41de-bbf5-1f43de5d9239 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:06.966910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 606/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:29:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:06.973627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc6f53-e607-4565-a1b5-4f38e17a67d7 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:07.025870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:07.074619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc6f53-e607-4565-a1b5-4f38e17a67d7 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:07.107630 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca33029-7b3d-4cfb-bd14-b041b77e2705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:07.108421 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca33029-7b3d-4cfb-bd14-b041b77e2705 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:07.108712 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca33029-7b3d-4cfb-bd14-b041b77e2705 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:07.109024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca33029-7b3d-4cfb-bd14-b041b77e2705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:07.119357 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca33029-7b3d-4cfb-bd14-b041b77e2705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:07.120818 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca33029-7b3d-4cfb-bd14-b041b77e2705 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:07.139012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-2ca33029-7b3d-4cfb-bd14-b041b77e2705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:07.139012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:07.139012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:07.139012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:07.139012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:07.139012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:07.139012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:07.139012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:07.139012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:07.139012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:07.139012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:07.139012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:07.139012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:29:07.139012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:29:07.139012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:07.140092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:07.141379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:29:07.141379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:29:07.141379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:07.141379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:07.141379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 604/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:07.146231 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18dd66-a9db-41de-bbf5-1f43de5d9239 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:07.242298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:07.245124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18dd66-a9db-41de-bbf5-1f43de5d9239 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:07.277412 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0784b1e-50cb-4ca8-a30d-d64196c9a035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:07.278024 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0784b1e-50cb-4ca8-a30d-d64196c9a035 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:07.278310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0784b1e-50cb-4ca8-a30d-d64196c9a035 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:07.278585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0784b1e-50cb-4ca8-a30d-d64196c9a035 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:07.279292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0784b1e-50cb-4ca8-a30d-d64196c9a035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:07.279596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0784b1e-50cb-4ca8-a30d-d64196c9a035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:07.280965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0784b1e-50cb-4ca8-a30d-d64196c9a035 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:07.292360 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 607/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:07.298790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca33029-7b3d-4cfb-bd14-b041b77e2705 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:07.397930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca33029-7b3d-4cfb-bd14-b041b77e2705 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:07.399489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:07.433216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720de8b-e658-4ab2-87a9-3e3bb86fde6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:07.434011 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720de8b-e658-4ab2-87a9-3e3bb86fde6e None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:07.434289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720de8b-e658-4ab2-87a9-3e3bb86fde6e None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:07.434559 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720de8b-e658-4ab2-87a9-3e3bb86fde6e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:07.441621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720de8b-e658-4ab2-87a9-3e3bb86fde6e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:07.443125 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720de8b-e658-4ab2-87a9-3e3bb86fde6e None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-2720de8b-e658-4ab2-87a9-3e3bb86fde6e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:29:07.458001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:07.459184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:07.460342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:07.460342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:07.460342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:29:07.460342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:29:07.460342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:29:07.460342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:29:07.460342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:29:07.460342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:29:07.460342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 01 17:29:07.460342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:07.460342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 605/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:29:07.465354 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0784b1e-50cb-4ca8-a30d-d64196c9a035 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:07.568522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0784b1e-50cb-4ca8-a30d-d64196c9a035 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:07.603103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92cfc3-c160-42ad-81f6-37e7660825ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:07.604026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92cfc3-c160-42ad-81f6-37e7660825ca None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:07.604315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92cfc3-c160-42ad-81f6-37e7660825ca None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:07.604596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92cfc3-c160-42ad-81f6-37e7660825ca None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:07.605464 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92cfc3-c160-42ad-81f6-37e7660825ca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:07.605836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92cfc3-c160-42ad-81f6-37e7660825ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:07.607242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92cfc3-c160-42ad-81f6-37e7660825ca None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:07.624850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 608/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Jun 1 17:29:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:07.630565 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720de8b-e658-4ab2-87a9-3e3bb86fde6e None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:07.732646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720de8b-e658-4ab2-87a9-3e3bb86fde6e None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:07.766839 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32956f-e218-4307-a9aa-655a77c9adba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:07.767491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32956f-e218-4307-a9aa-655a77c9adba None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:07.767779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32956f-e218-4307-a9aa-655a77c9adba None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:07.768056 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32956f-e218-4307-a9aa-655a77c9adba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:07.798019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:07.834760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32956f-e218-4307-a9aa-655a77c9adba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:07.836151 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32956f-e218-4307-a9aa-655a77c9adba None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:07.933519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 606/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:29:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:29:07.939913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92cfc3-c160-42ad-81f6-37e7660825ca None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:07.958647 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:08.042344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92cfc3-c160-42ad-81f6-37e7660825ca None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:08.076921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cc67a-2490-42a9-89c4-9776bb15cfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:08.077731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cc67a-2490-42a9-89c4-9776bb15cfee None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:08.078021 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cc67a-2490-42a9-89c4-9776bb15cfee None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:08.078343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cc67a-2490-42a9-89c4-9776bb15cfee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:08.088148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cc67a-2490-42a9-89c4-9776bb15cfee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:08.089604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cc67a-2490-42a9-89c4-9776bb15cfee None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:08.107645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-ab3cc67a-2490-42a9-89c4-9776bb15cfee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:08.107645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:08.107645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:08.107645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:08.107645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:08.107645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:08.107645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:08.107645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:08.107645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:08.107645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:08.107645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:08.107645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:08.107645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:29:08.107645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:29:08.107645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:08.108754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:08.110595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:29:08.110595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:29:08.110595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:08.110595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:08.110595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 609/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:08.115237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32956f-e218-4307-a9aa-655a77c9adba None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:08.174118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:08.212310 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32956f-e218-4307-a9aa-655a77c9adba None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:08.246438 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f6cd0-5fa2-4f3a-86c1-133a4fd5191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:08.247102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f6cd0-5fa2-4f3a-86c1-133a4fd5191b None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:08.247432 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f6cd0-5fa2-4f3a-86c1-133a4fd5191b None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:08.247707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f6cd0-5fa2-4f3a-86c1-133a4fd5191b None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:08.248420 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f6cd0-5fa2-4f3a-86c1-133a4fd5191b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:08.248728 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f6cd0-5fa2-4f3a-86c1-133a4fd5191b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:08.250744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f6cd0-5fa2-4f3a-86c1-133a4fd5191b None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:08.261751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 607/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:08.268028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cc67a-2490-42a9-89c4-9776bb15cfee None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:08.336614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:08.367877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cc67a-2490-42a9-89c4-9776bb15cfee None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:08.401555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9c638-4321-40ed-a5cb-58529b9ce4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:08.402345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9c638-4321-40ed-a5cb-58529b9ce4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:08.402613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9c638-4321-40ed-a5cb-58529b9ce4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:08.402904 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9c638-4321-40ed-a5cb-58529b9ce4b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:08.409437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9c638-4321-40ed-a5cb-58529b9ce4b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:08.411090 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9c638-4321-40ed-a5cb-58529b9ce4b3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:08.424747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-f3b9c638-4321-40ed-a5cb-58529b9ce4b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:29:08.424747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:08.424747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:08.424747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:08.424747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:08.424747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:08.424747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:08.424747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:08.424747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:08.424747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:08.424747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:08.424747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:08.424747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:29:08.424747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:29:08.424747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:08.425715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:08.426954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:29:08.426954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:29:08.426954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:29:08.426954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:29:08.426954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:29:08.426954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:29:08.426954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:29:08.426954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:08.426954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 610/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:29:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:08.431707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f6cd0-5fa2-4f3a-86c1-133a4fd5191b None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:08.532872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f6cd0-5fa2-4f3a-86c1-133a4fd5191b None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:08.554714 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:08.568249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc3fe7-ff42-41a7-856f-b387cf40c9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:08.568913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc3fe7-ff42-41a7-856f-b387cf40c9ea None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:08.569226 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc3fe7-ff42-41a7-856f-b387cf40c9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:08.569504 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc3fe7-ff42-41a7-856f-b387cf40c9ea None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:08.570284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc3fe7-ff42-41a7-856f-b387cf40c9ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:08.570595 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc3fe7-ff42-41a7-856f-b387cf40c9ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:08.572027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc3fe7-ff42-41a7-856f-b387cf40c9ea None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:08.584185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 608/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:29:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:08.590738 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9c638-4321-40ed-a5cb-58529b9ce4b3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:08.697224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9c638-4321-40ed-a5cb-58529b9ce4b3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:08.725228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:08.731239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b51e2-9998-4fd4-bdf0-4c744c453eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:08.731896 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b51e2-9998-4fd4-bdf0-4c744c453eab None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:08.732192 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b51e2-9998-4fd4-bdf0-4c744c453eab None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:08.732466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b51e2-9998-4fd4-bdf0-4c744c453eab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:08.733322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b51e2-9998-4fd4-bdf0-4c744c453eab None admin] RBAC: Adding query filter params (role.id=97f88c6182044737a47af038d94a74b8, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=ae952b30dffa450e97ce4a73da8d00f8) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:08.733636 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b51e2-9998-4fd4-bdf0-4c744c453eab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:08.735758 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b51e2-9998-4fd4-bdf0-4c744c453eab None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:08.741171 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 611/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:29:08 2022] GET /identity/v3/role_assignments?user.id=ae952b30dffa450e97ce4a73da8d00f8&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=97f88c6182044737a47af038d94a74b8 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:10.972336 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30818031-da17-41f4-a7a7-10da63e86766 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:10.972897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30818031-da17-41f4-a7a7-10da63e86766 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:10.972897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30818031-da17-41f4-a7a7-10da63e86766 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:10.974269 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 609/1220] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:29:10.979746 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e464eb-801f-4964-b336-8b7a3bbf1623 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:10.980172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e464eb-801f-4964-b336-8b7a3bbf1623 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:10.980312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e464eb-801f-4964-b336-8b7a3bbf1623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:10.996822 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c3e464eb-801f-4964-b336-8b7a3bbf1623 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:29:11.000457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c3e464eb-801f-4964-b336-8b7a3bbf1623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:29:11.070808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 612/1221] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:29:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:29:11.094450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30818031-da17-41f4-a7a7-10da63e86766 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:11.194238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30818031-da17-41f4-a7a7-10da63e86766 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:11.227142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc66be-ccf5-4382-8ebd-c75450bbbf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:11.227874 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc66be-ccf5-4382-8ebd-c75450bbbf97 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:11.228155 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc66be-ccf5-4382-8ebd-c75450bbbf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:11.228698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc66be-ccf5-4382-8ebd-c75450bbbf97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:11.238883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc66be-ccf5-4382-8ebd-c75450bbbf97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-47bc66be-ccf5-4382-8ebd-c75450bbbf97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:29:11.246571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:11.248519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:11.249635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:11.249635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:11.249635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:11.249635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:11.249635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:29:11.249635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:29:11.249635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:29:11.249635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:29:11.249635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:29:11.249635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:29:11.249635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:29:11.249635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:11.249635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 610/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:29:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:11.254502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e464eb-801f-4964-b336-8b7a3bbf1623 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:11.351618 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e464eb-801f-4964-b336-8b7a3bbf1623 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:11.374411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:11.385146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b2381-b221-459a-ae7c-659a8230ca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:11.385878 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b2381-b221-459a-ae7c-659a8230ca8a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:11.386108 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b2381-b221-459a-ae7c-659a8230ca8a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:11.386389 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b2381-b221-459a-ae7c-659a8230ca8a None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:11.387139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b2381-b221-459a-ae7c-659a8230ca8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:11.387448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b2381-b221-459a-ae7c-659a8230ca8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:11.388822 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b2381-b221-459a-ae7c-659a8230ca8a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:11.397676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 613/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:29:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:11.403287 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc66be-ccf5-4382-8ebd-c75450bbbf97 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:11.448339 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:11.505579 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc66be-ccf5-4382-8ebd-c75450bbbf97 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:11.539158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d20dc4-2dc7-4bc0-97dc-fca4e67dd236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:11.539948 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d20dc4-2dc7-4bc0-97dc-fca4e67dd236 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:11.540233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d20dc4-2dc7-4bc0-97dc-fca4e67dd236 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:11.540507 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d20dc4-2dc7-4bc0-97dc-fca4e67dd236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:11.551222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d20dc4-2dc7-4bc0-97dc-fca4e67dd236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:11.552672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d20dc4-2dc7-4bc0-97dc-fca4e67dd236 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:11.569832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-93d20dc4-2dc7-4bc0-97dc-fca4e67dd236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:11.569832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:11.569832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:11.569832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:11.569832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:11.569832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:11.569832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:11.569832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:11.569832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:11.569832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:11.569832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:11.569832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:11.569832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:29:11.569832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:29:11.569832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:11.570919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:11.572210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:29:11.572210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:29:11.572210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:11.572210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:11.572210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 611/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:11.577029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b2381-b221-459a-ae7c-659a8230ca8a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:11.678115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b2381-b221-459a-ae7c-659a8230ca8a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:11.713527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9d71-7081-4a49-958f-76d09253d623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:11.714192 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9d71-7081-4a49-958f-76d09253d623 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:11.714479 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9d71-7081-4a49-958f-76d09253d623 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:11.714759 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9d71-7081-4a49-958f-76d09253d623 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:11.715483 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a9d71-7081-4a49-958f-76d09253d623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:11.715795 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a9d71-7081-4a49-958f-76d09253d623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:11.717189 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a9d71-7081-4a49-958f-76d09253d623 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:11.729041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 614/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:11.735231 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d20dc4-2dc7-4bc0-97dc-fca4e67dd236 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:11.826486 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:11.833175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d20dc4-2dc7-4bc0-97dc-fca4e67dd236 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:11.866736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9c6f5-4d1d-4eea-9a4f-f5936352a783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:11.867537 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9c6f5-4d1d-4eea-9a4f-f5936352a783 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:11.867818 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9c6f5-4d1d-4eea-9a4f-f5936352a783 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:11.868098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9c6f5-4d1d-4eea-9a4f-f5936352a783 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:11.875389 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9c6f5-4d1d-4eea-9a4f-f5936352a783 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:11.877032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9c6f5-4d1d-4eea-9a4f-f5936352a783 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-c9c9c6f5-4d1d-4eea-9a4f-f5936352a783 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:29:11.890971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:11.892098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:11.893505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:11.893505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:11.893505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:29:11.893505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:29:11.893505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:29:11.893505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:29:11.893505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:29:11.893505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:29:11.893505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 01 17:29:11.893505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:11.893505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 612/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:11.898099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9d71-7081-4a49-958f-76d09253d623 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:11.946919 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:11.999546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9d71-7081-4a49-958f-76d09253d623 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:12.034950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bd53f-1ec2-48d3-a700-40b87ef5b5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:12.035621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bd53f-1ec2-48d3-a700-40b87ef5b5ea None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:12.035906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bd53f-1ec2-48d3-a700-40b87ef5b5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:12.036187 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bd53f-1ec2-48d3-a700-40b87ef5b5ea None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:12.037053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bd53f-1ec2-48d3-a700-40b87ef5b5ea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:12.037370 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bd53f-1ec2-48d3-a700-40b87ef5b5ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:12.038810 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bd53f-1ec2-48d3-a700-40b87ef5b5ea None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:12.055844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 615/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Jun 1 17:29:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:29:12.061671 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9c6f5-4d1d-4eea-9a4f-f5936352a783 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:12.162895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9c6f5-4d1d-4eea-9a4f-f5936352a783 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:12.196581 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6c39f-aa33-4b68-b15d-1b0632cd5754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:12.197400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6c39f-aa33-4b68-b15d-1b0632cd5754 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:12.197686 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6c39f-aa33-4b68-b15d-1b0632cd5754 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:12.197965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6c39f-aa33-4b68-b15d-1b0632cd5754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:12.208378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6c39f-aa33-4b68-b15d-1b0632cd5754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:12.209858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6c39f-aa33-4b68-b15d-1b0632cd5754 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:12.226428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-eef6c39f-aa33-4b68-b15d-1b0632cd5754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:12.226428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:12.226428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:12.226428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:12.226428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:12.226428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:12.226428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:12.226428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:12.226428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:12.226428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:12.226428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:12.226428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:12.226428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:29:12.226428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:29:12.226428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:12.229619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:12.230760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:29:12.230760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:29:12.230760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:12.230760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:12.230760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 613/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:12.233639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bd53f-1ec2-48d3-a700-40b87ef5b5ea None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:12.338022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bd53f-1ec2-48d3-a700-40b87ef5b5ea None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:12.345538 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:12.372189 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285429a8-d3b9-47a8-bc95-51108372e8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:12.372860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285429a8-d3b9-47a8-bc95-51108372e8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:12.373176 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285429a8-d3b9-47a8-bc95-51108372e8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:12.373457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285429a8-d3b9-47a8-bc95-51108372e8c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:12.374185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285429a8-d3b9-47a8-bc95-51108372e8c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:12.374497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285429a8-d3b9-47a8-bc95-51108372e8c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:12.376469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285429a8-d3b9-47a8-bc95-51108372e8c3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:12.387601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 616/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:12.393542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6c39f-aa33-4b68-b15d-1b0632cd5754 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:12.402819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:12.491442 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6c39f-aa33-4b68-b15d-1b0632cd5754 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:12.524777 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6dad0-e7b0-4e9d-be7a-ac0da8bdd066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:12.525596 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6dad0-e7b0-4e9d-be7a-ac0da8bdd066 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:12.525885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6dad0-e7b0-4e9d-be7a-ac0da8bdd066 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:12.526165 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6dad0-e7b0-4e9d-be7a-ac0da8bdd066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:12.533390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6dad0-e7b0-4e9d-be7a-ac0da8bdd066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:12.534834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6dad0-e7b0-4e9d-be7a-ac0da8bdd066 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:12.549087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-2ad6dad0-e7b0-4e9d-be7a-ac0da8bdd066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:29:12.549087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:12.549087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:12.549087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:12.549087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:12.549087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:12.549087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:12.549087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:12.549087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:12.549087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:12.549087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:12.549087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:12.549087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:29:12.549087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:29:12.549087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:12.550166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:12.551109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:29:12.551109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:29:12.551109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:29:12.551109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:29:12.551109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:29:12.551109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:29:12.551109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:29:12.551109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:12.551543 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 614/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:29:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:12.556255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285429a8-d3b9-47a8-bc95-51108372e8c3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:12.660843 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285429a8-d3b9-47a8-bc95-51108372e8c3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:12.694777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17322b5f-4d70-4e81-93bd-f88efaa8efb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:12.695439 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17322b5f-4d70-4e81-93bd-f88efaa8efb3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:12.695726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17322b5f-4d70-4e81-93bd-f88efaa8efb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:12.696006 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17322b5f-4d70-4e81-93bd-f88efaa8efb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:12.696787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17322b5f-4d70-4e81-93bd-f88efaa8efb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:12.697127 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17322b5f-4d70-4e81-93bd-f88efaa8efb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:12.698562 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17322b5f-4d70-4e81-93bd-f88efaa8efb3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:12.710405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 617/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:29:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:12.716489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6dad0-e7b0-4e9d-be7a-ac0da8bdd066 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:12.784148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:12.817895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6dad0-e7b0-4e9d-be7a-ac0da8bdd066 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:12.852236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d121f-a650-467f-905b-94e6bfd00972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:12.853144 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d121f-a650-467f-905b-94e6bfd00972 None admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:12.853686 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d121f-a650-467f-905b-94e6bfd00972 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:12.853962 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d121f-a650-467f-905b-94e6bfd00972 None admin] PATH_INFO: `/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/ae952b30dffa450e97ce4a73da8d00f8/roles/97f88c6182044737a47af038d94a74b8` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:12.869352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d121f-a650-467f-905b-94e6bfd00972 None admin] RBAC: Authorizing `identity:create_grant(project_id=68bf9a1e88a64a02ba53d0bedb76072a, user_id=ae952b30dffa450e97ce4a73da8d00f8, role_id=97f88c6182044737a47af038d94a74b8)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:12.870785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d121f-a650-467f-905b-94e6bfd00972 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:12.983479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 615/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:29:12 2022] PUT /identity/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/ae952b30dffa450e97ce4a73da8d00f8/roles/97f88c6182044737a47af038d94a74b8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:29:15.248721 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8af68c-97ee-4d57-b29f-c4f8b73bf067 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:15.249289 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8af68c-97ee-4d57-b29f-c4f8b73bf067 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:15.249289 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8af68c-97ee-4d57-b29f-c4f8b73bf067 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:15.251520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 618/1233] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:29:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:29:15.256819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132c5c5-cdc7-4582-be21-c902b7357c8a None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:15.257304 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132c5c5-cdc7-4582-be21-c902b7357c8a None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:15.257397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132c5c5-cdc7-4582-be21-c902b7357c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:15.281935 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-f132c5c5-cdc7-4582-be21-c902b7357c8a None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:29:15.289347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f132c5c5-cdc7-4582-be21-c902b7357c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:29:15.364158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 616/1234] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:29:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:29:15.388320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8af68c-97ee-4d57-b29f-c4f8b73bf067 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:15.413602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:15.489106 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8af68c-97ee-4d57-b29f-c4f8b73bf067 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:15.523701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396bdaa-e089-4043-bbd2-7adfa5d4e9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:15.524497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396bdaa-e089-4043-bbd2-7adfa5d4e9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:15.524784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396bdaa-e089-4043-bbd2-7adfa5d4e9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:15.525090 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396bdaa-e089-4043-bbd2-7adfa5d4e9c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:15.535603 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396bdaa-e089-4043-bbd2-7adfa5d4e9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-7396bdaa-e089-4043-bbd2-7adfa5d4e9c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:29:15.543481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:15.544573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:15.545642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:15.545642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:15.545642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:15.545642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:15.545642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:29:15.545642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:29:15.545642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:29:15.545642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:29:15.545642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:29:15.545642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:29:15.545642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 01 17:29:15.545642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:15.545642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 619/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Wed Jun 1 17:29:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:15.551381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132c5c5-cdc7-4582-be21-c902b7357c8a None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:15.598200 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:15.655334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132c5c5-cdc7-4582-be21-c902b7357c8a None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:15.689895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98e415-3d21-4418-9575-df56a8576114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:15.690565 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98e415-3d21-4418-9575-df56a8576114 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:15.690846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98e415-3d21-4418-9575-df56a8576114 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:15.691122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98e415-3d21-4418-9575-df56a8576114 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:15.691900 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98e415-3d21-4418-9575-df56a8576114 None admin] RBAC: Adding query filter params (name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:15.692202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98e415-3d21-4418-9575-df56a8576114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:15.693747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98e415-3d21-4418-9575-df56a8576114 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:15.702613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 617/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Wed Jun 1 17:29:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:15.708542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396bdaa-e089-4043-bbd2-7adfa5d4e9c5 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:15.794629 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:15.810557 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396bdaa-e089-4043-bbd2-7adfa5d4e9c5 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:15.842835 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff1232-75ed-4ce7-9916-31dd4df06158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:15.843672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff1232-75ed-4ce7-9916-31dd4df06158 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:15.844613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff1232-75ed-4ce7-9916-31dd4df06158 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:15.844898 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff1232-75ed-4ce7-9916-31dd4df06158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:15.855250 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff1232-75ed-4ce7-9916-31dd4df06158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:15.856699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff1232-75ed-4ce7-9916-31dd4df06158 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:15.875626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-15ff1232-75ed-4ce7-9916-31dd4df06158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:15.875626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:15.875626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:15.875626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:15.875626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:15.875626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:15.875626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:15.875626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:15.875626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:15.875626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:15.875626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:15.875626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:15.875626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:29:15.875626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:29:15.875626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:15.878901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:15.880042 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:29:15.880042 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:29:15.880042 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:15.880042 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:15.880042 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 620/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:15.882719 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98e415-3d21-4418-9575-df56a8576114 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:15.987796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98e415-3d21-4418-9575-df56a8576114 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:15.997286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:16.021776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb73c61-8442-4f4f-b0ab-82482dcc2b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:16.022441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb73c61-8442-4f4f-b0ab-82482dcc2b17 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:16.022724 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb73c61-8442-4f4f-b0ab-82482dcc2b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:16.022999 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb73c61-8442-4f4f-b0ab-82482dcc2b17 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:16.023712 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb73c61-8442-4f4f-b0ab-82482dcc2b17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:16.024019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb73c61-8442-4f4f-b0ab-82482dcc2b17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:16.025451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb73c61-8442-4f4f-b0ab-82482dcc2b17 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:16.036900 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 618/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:16.042591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff1232-75ed-4ce7-9916-31dd4df06158 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:16.142056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff1232-75ed-4ce7-9916-31dd4df06158 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:16.175995 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21666c44-9e1c-4426-946f-a8e075d87102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:16.176798 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21666c44-9e1c-4426-946f-a8e075d87102 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:16.177114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21666c44-9e1c-4426-946f-a8e075d87102 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:16.177395 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21666c44-9e1c-4426-946f-a8e075d87102 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:16.180035 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:16.184619 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21666c44-9e1c-4426-946f-a8e075d87102 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:16.186122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21666c44-9e1c-4426-946f-a8e075d87102 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-21666c44-9e1c-4426-946f-a8e075d87102 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:29:16.200519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:16.201722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:16.202872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:16.202872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:16.202872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:29:16.202872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:29:16.202872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:29:16.202872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:29:16.202872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:29:16.202872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:29:16.202872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 01 17:29:16.202872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:16.202872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 621/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:16.208151 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb73c61-8442-4f4f-b0ab-82482dcc2b17 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:16.311086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb73c61-8442-4f4f-b0ab-82482dcc2b17 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:16.345806 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e37dc9-f8aa-49bd-a9ef-e73a28e04b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:16.346476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e37dc9-f8aa-49bd-a9ef-e73a28e04b27 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:16.346763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e37dc9-f8aa-49bd-a9ef-e73a28e04b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:16.347043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e37dc9-f8aa-49bd-a9ef-e73a28e04b27 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:16.347878 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e37dc9-f8aa-49bd-a9ef-e73a28e04b27 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:16.348199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e37dc9-f8aa-49bd-a9ef-e73a28e04b27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:16.349665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e37dc9-f8aa-49bd-a9ef-e73a28e04b27 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:16.366703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 619/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Jun 1 17:29:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:16.372524 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21666c44-9e1c-4426-946f-a8e075d87102 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:16.472850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21666c44-9e1c-4426-946f-a8e075d87102 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:16.508407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030156-aefb-47e8-b3c9-8b4d1c93098a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:16.509139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030156-aefb-47e8-b3c9-8b4d1c93098a None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:16.509509 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030156-aefb-47e8-b3c9-8b4d1c93098a None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:16.509787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030156-aefb-47e8-b3c9-8b4d1c93098a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:16.569705 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:16.576100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a030156-aefb-47e8-b3c9-8b4d1c93098a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:16.577588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a030156-aefb-47e8-b3c9-8b4d1c93098a None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:16.678245 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 622/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:29:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:29:16.684081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e37dc9-f8aa-49bd-a9ef-e73a28e04b27 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:16.711654 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:16.782832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e37dc9-f8aa-49bd-a9ef-e73a28e04b27 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:16.815863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefea46-944d-4333-86ce-3558f7a450c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:16.816650 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefea46-944d-4333-86ce-3558f7a450c7 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:16.816960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefea46-944d-4333-86ce-3558f7a450c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:16.817246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefea46-944d-4333-86ce-3558f7a450c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:16.829250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefea46-944d-4333-86ce-3558f7a450c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:16.830729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefea46-944d-4333-86ce-3558f7a450c7 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:16.848137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-8fefea46-944d-4333-86ce-3558f7a450c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:16.848137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:16.848137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:16.848137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:16.848137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:16.848137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:16.848137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:16.848137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:16.848137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:16.848137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:16.848137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:16.848137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:16.848137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:29:16.848137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:29:16.848137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:16.849243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:16.850143 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:29:16.850143 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:29:16.850143 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:16.850143 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:16.850143 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 620/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:16.855455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030156-aefb-47e8-b3c9-8b4d1c93098a None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:16.948741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:16.954419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030156-aefb-47e8-b3c9-8b4d1c93098a None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:16.987879 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1983959-b43d-4934-a817-02dd38bf91f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:16.988540 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1983959-b43d-4934-a817-02dd38bf91f4 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:16.988822 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1983959-b43d-4934-a817-02dd38bf91f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:16.989126 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1983959-b43d-4934-a817-02dd38bf91f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:16.989841 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1983959-b43d-4934-a817-02dd38bf91f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:16.990142 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1983959-b43d-4934-a817-02dd38bf91f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:16.991509 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1983959-b43d-4934-a817-02dd38bf91f4 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:17.002667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 623/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:17.008307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefea46-944d-4333-86ce-3558f7a450c7 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:17.086800 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:17.110235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefea46-944d-4333-86ce-3558f7a450c7 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:17.145738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60215f3a-513e-4130-8d80-24b3e3d7a8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:17.146537 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60215f3a-513e-4130-8d80-24b3e3d7a8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:17.146823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60215f3a-513e-4130-8d80-24b3e3d7a8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:17.147103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60215f3a-513e-4130-8d80-24b3e3d7a8d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:17.153700 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60215f3a-513e-4130-8d80-24b3e3d7a8d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:17.155146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60215f3a-513e-4130-8d80-24b3e3d7a8d9 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:17.168550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-60215f3a-513e-4130-8d80-24b3e3d7a8d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:29:17.168550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:17.168550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:17.168550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:17.168550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:17.168550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:17.168550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:17.168550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:17.168550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:17.168550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:17.168550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:17.168550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:17.168550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:29:17.168550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:29:17.168550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:17.169652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:17.175720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:29:17.175720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:29:17.175720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:29:17.175720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:29:17.175720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:29:17.175720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:29:17.175720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:29:17.175720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:17.175720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 621/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:29:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:17.176318 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1983959-b43d-4934-a817-02dd38bf91f4 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:17.275474 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1983959-b43d-4934-a817-02dd38bf91f4 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:17.308275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3decd-abb5-4104-b7f6-ab9e05a10823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:17.308927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3decd-abb5-4104-b7f6-ab9e05a10823 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:17.309237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3decd-abb5-4104-b7f6-ab9e05a10823 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:17.309509 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3decd-abb5-4104-b7f6-ab9e05a10823 None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:17.310286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3decd-abb5-4104-b7f6-ab9e05a10823 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:17.310596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3decd-abb5-4104-b7f6-ab9e05a10823 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:17.312030 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3decd-abb5-4104-b7f6-ab9e05a10823 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:17.324303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 624/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:29:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:17.331254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60215f3a-513e-4130-8d80-24b3e3d7a8d9 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:17.429812 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60215f3a-513e-4130-8d80-24b3e3d7a8d9 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:17.462401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d367a-4bdb-4eb5-96a8-89be2a153896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:17.463055 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d367a-4bdb-4eb5-96a8-89be2a153896 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:17.463337 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d367a-4bdb-4eb5-96a8-89be2a153896 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:17.463611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d367a-4bdb-4eb5-96a8-89be2a153896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:17.464431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d367a-4bdb-4eb5-96a8-89be2a153896 None admin] RBAC: Adding query filter params (role.id=97f88c6182044737a47af038d94a74b8, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=ae952b30dffa450e97ce4a73da8d00f8) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:17.464739 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d367a-4bdb-4eb5-96a8-89be2a153896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:17.466248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d367a-4bdb-4eb5-96a8-89be2a153896 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:17.472248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 622/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:29:17 2022] GET /identity/v3/role_assignments?user.id=ae952b30dffa450e97ce4a73da8d00f8&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=97f88c6182044737a47af038d94a74b8 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:19.830649 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c056219-ac94-4b30-998e-fa722e4a721f None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:19.831202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c056219-ac94-4b30-998e-fa722e4a721f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:19.831202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c056219-ac94-4b30-998e-fa722e4a721f None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:19.832543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 625/1247] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:29:19.838082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1e7a-2418-4a54-9ff2-508e45ff4dfe None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:19.839158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1e7a-2418-4a54-9ff2-508e45ff4dfe None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:19.839158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1e7a-2418-4a54-9ff2-508e45ff4dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:19.843764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:19.855896 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-dade1e7a-2418-4a54-9ff2-508e45ff4dfe None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:29:19.857121 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-dade1e7a-2418-4a54-9ff2-508e45ff4dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:29:19.921665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 623/1248] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:29:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:29:19.945985 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c056219-ac94-4b30-998e-fa722e4a721f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:19.964447 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:20.049279 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c056219-ac94-4b30-998e-fa722e4a721f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:20.083467 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c461d-1ade-4fd7-8459-778a55cd7909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:20.084192 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c461d-1ade-4fd7-8459-778a55cd7909 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:20.084477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c461d-1ade-4fd7-8459-778a55cd7909 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:20.084756 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c461d-1ade-4fd7-8459-778a55cd7909 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:20.095716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c461d-1ade-4fd7-8459-778a55cd7909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-c17c461d-1ade-4fd7-8459-778a55cd7909 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:29:20.103396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:20.104900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:20.105914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:20.105914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:20.105914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:20.105914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:20.105914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:29:20.105914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:29:20.105914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:29:20.105914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:29:20.105914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:29:20.105914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:29:20.105914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:29:20.105914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:20.105914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 626/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:29:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:20.112032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1e7a-2418-4a54-9ff2-508e45ff4dfe None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:20.209239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1e7a-2418-4a54-9ff2-508e45ff4dfe None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:20.238816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:20.243932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce4047-278f-4ccf-8d71-067ca13d68b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:20.244608 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce4047-278f-4ccf-8d71-067ca13d68b4 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:20.244898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce4047-278f-4ccf-8d71-067ca13d68b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:20.245213 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce4047-278f-4ccf-8d71-067ca13d68b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:20.245959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce4047-278f-4ccf-8d71-067ca13d68b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:20.246271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce4047-278f-4ccf-8d71-067ca13d68b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:20.247645 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce4047-278f-4ccf-8d71-067ca13d68b4 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:20.256436 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 624/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:29:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:20.262326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c461d-1ade-4fd7-8459-778a55cd7909 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:20.340024 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:20.362250 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c461d-1ade-4fd7-8459-778a55cd7909 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:20.395564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20838a5d-812a-44e7-8f77-82826278adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:20.396354 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838a5d-812a-44e7-8f77-82826278adb3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:20.396643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838a5d-812a-44e7-8f77-82826278adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:20.396923 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20838a5d-812a-44e7-8f77-82826278adb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:20.407308 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20838a5d-812a-44e7-8f77-82826278adb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:20.408766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20838a5d-812a-44e7-8f77-82826278adb3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:20.426293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-20838a5d-812a-44e7-8f77-82826278adb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:20.426293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:20.426293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:20.426293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:20.426293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:20.426293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:20.426293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:20.426293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:20.426293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:20.426293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:20.426293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:20.426293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:20.426293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:29:20.426293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:29:20.426293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:20.429745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:20.430907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:29:20.430907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:29:20.430907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:20.430907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:20.430907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 627/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:20.433375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce4047-278f-4ccf-8d71-067ca13d68b4 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:20.532157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce4047-278f-4ccf-8d71-067ca13d68b4 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:20.565277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802d73e-9894-4b91-b208-46c63e672897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:20.565938 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802d73e-9894-4b91-b208-46c63e672897 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:20.566223 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802d73e-9894-4b91-b208-46c63e672897 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:20.566501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802d73e-9894-4b91-b208-46c63e672897 None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:20.567211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802d73e-9894-4b91-b208-46c63e672897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:20.567515 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802d73e-9894-4b91-b208-46c63e672897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:20.568884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802d73e-9894-4b91-b208-46c63e672897 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:20.581205 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 625/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:20.586953 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20838a5d-812a-44e7-8f77-82826278adb3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:20.687619 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20838a5d-812a-44e7-8f77-82826278adb3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:20.713400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:20.721571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce438c-8ebb-48fc-9513-8ca14bbf7689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:20.722379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce438c-8ebb-48fc-9513-8ca14bbf7689 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:20.722666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce438c-8ebb-48fc-9513-8ca14bbf7689 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:20.722945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce438c-8ebb-48fc-9513-8ca14bbf7689 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:20.730692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce438c-8ebb-48fc-9513-8ca14bbf7689 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:20.732147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce438c-8ebb-48fc-9513-8ca14bbf7689 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-2cce438c-8ebb-48fc-9513-8ca14bbf7689 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:29:20.746701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:20.747860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:20.748864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:20.748864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:20.748864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:29:20.748864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:29:20.748864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:29:20.748864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:29:20.748864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:29:20.748864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:29:20.748864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 01 17:29:20.748864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:20.748864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 628/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:20.754397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802d73e-9894-4b91-b208-46c63e672897 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:20.809565 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:20.852828 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802d73e-9894-4b91-b208-46c63e672897 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:20.886151 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe3edb-60cf-4819-a7d4-1321dd0871f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:20.892392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe3edb-60cf-4819-a7d4-1321dd0871f3 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:20.892392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe3edb-60cf-4819-a7d4-1321dd0871f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:20.892392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe3edb-60cf-4819-a7d4-1321dd0871f3 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:20.892392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe3edb-60cf-4819-a7d4-1321dd0871f3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:20.892392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe3edb-60cf-4819-a7d4-1321dd0871f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:20.892392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe3edb-60cf-4819-a7d4-1321dd0871f3 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:20.907200 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 626/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Jun 1 17:29:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:20.913268 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce438c-8ebb-48fc-9513-8ca14bbf7689 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:21.011597 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce438c-8ebb-48fc-9513-8ca14bbf7689 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:21.044566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0ccc1-c305-464a-a046-5940fa531ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:21.047253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ccc1-c305-464a-a046-5940fa531ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:21.047253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ccc1-c305-464a-a046-5940fa531ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:21.047253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ccc1-c305-464a-a046-5940fa531ce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:21.100425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:21.113092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0ccc1-c305-464a-a046-5940fa531ce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:21.114546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0ccc1-c305-464a-a046-5940fa531ce7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:21.212559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 629/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:29:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:29:21.218475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe3edb-60cf-4819-a7d4-1321dd0871f3 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:21.316100 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe3edb-60cf-4819-a7d4-1321dd0871f3 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:21.330342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:21.351068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde87a4a-7438-4a46-aec1-f162a3b14d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:21.351861 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde87a4a-7438-4a46-aec1-f162a3b14d9f None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:21.352154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde87a4a-7438-4a46-aec1-f162a3b14d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:21.352433 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde87a4a-7438-4a46-aec1-f162a3b14d9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:21.362455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde87a4a-7438-4a46-aec1-f162a3b14d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:21.368482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde87a4a-7438-4a46-aec1-f162a3b14d9f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:21.381046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-cde87a4a-7438-4a46-aec1-f162a3b14d9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:21.381046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:21.381046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:21.381046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:21.381046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:21.381046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:21.381046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:21.381046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:21.381046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:21.381046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:21.381046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:21.381046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:21.381046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:29:21.381046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:29:21.381046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:21.382095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:21.383228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:29:21.383228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:29:21.383228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:21.383228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:21.383228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 627/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:21.387922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0ccc1-c305-464a-a046-5940fa531ce7 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:21.478334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:21.490578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0ccc1-c305-464a-a046-5940fa531ce7 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:21.524674 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7f42b-a108-4383-b59f-71232025f128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:21.525371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7f42b-a108-4383-b59f-71232025f128 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:21.525659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7f42b-a108-4383-b59f-71232025f128 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:21.525937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7f42b-a108-4383-b59f-71232025f128 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:21.526671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7f42b-a108-4383-b59f-71232025f128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:21.526972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7f42b-a108-4383-b59f-71232025f128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:21.528343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7f42b-a108-4383-b59f-71232025f128 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:21.540217 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 630/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:21.545872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde87a4a-7438-4a46-aec1-f162a3b14d9f None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:21.645988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde87a4a-7438-4a46-aec1-f162a3b14d9f None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:21.679685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697188f7-cd83-4498-9b46-c95bb4ba5256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:21.680481 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697188f7-cd83-4498-9b46-c95bb4ba5256 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:21.680771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697188f7-cd83-4498-9b46-c95bb4ba5256 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:21.681088 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697188f7-cd83-4498-9b46-c95bb4ba5256 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:21.688472 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697188f7-cd83-4498-9b46-c95bb4ba5256 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:21.690003 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697188f7-cd83-4498-9b46-c95bb4ba5256 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:21.704447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-697188f7-cd83-4498-9b46-c95bb4ba5256 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:29:21.704447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:21.704447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:21.704447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:21.704447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:21.704447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:21.704447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:21.704447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:21.704447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:21.704447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:21.704447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:21.704447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:21.704447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:29:21.704447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:29:21.704447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:21.707447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:21.708590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:29:21.708590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:29:21.708590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:29:21.708590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:29:21.708590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:29:21.708590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:29:21.708590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:29:21.708590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:21.708590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 628/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:21.711524 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7f42b-a108-4383-b59f-71232025f128 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:21.812488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7f42b-a108-4383-b59f-71232025f128 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:21.847538 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0803640-0a0a-4a85-8b28-0c931a82326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:21.848203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0803640-0a0a-4a85-8b28-0c931a82326f None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:21.848493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0803640-0a0a-4a85-8b28-0c931a82326f None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:21.848774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0803640-0a0a-4a85-8b28-0c931a82326f None admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:21.849605 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0803640-0a0a-4a85-8b28-0c931a82326f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:21.849922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0803640-0a0a-4a85-8b28-0c931a82326f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:21.851348 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0803640-0a0a-4a85-8b28-0c931a82326f None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:21.864237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 631/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:21.870388 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697188f7-cd83-4498-9b46-c95bb4ba5256 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:21.901054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:21.970756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697188f7-cd83-4498-9b46-c95bb4ba5256 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:22.003729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf258c-3ccd-45fe-9757-7997f1726e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:22.004376 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf258c-3ccd-45fe-9757-7997f1726e69 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:22.004657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf258c-3ccd-45fe-9757-7997f1726e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:22.004963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf258c-3ccd-45fe-9757-7997f1726e69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:22.005803 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf258c-3ccd-45fe-9757-7997f1726e69 None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=ae952b30dffa450e97ce4a73da8d00f8) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:22.006162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf258c-3ccd-45fe-9757-7997f1726e69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:22.007626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf258c-3ccd-45fe-9757-7997f1726e69 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:22.013157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 629/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:29:21 2022] GET /identity/v3/role_assignments?user.id=ae952b30dffa450e97ce4a73da8d00f8&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:24.228460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8def01c-d045-4d73-95eb-5cee9989b3b1 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:24.229311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8def01c-d045-4d73-95eb-5cee9989b3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:24.229406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8def01c-d045-4d73-95eb-5cee9989b3b1 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:24.230764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 632/1261] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:29:24.236384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3d583-7e9c-4e62-aaa5-4a26faf517ee None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:24.236772 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3d583-7e9c-4e62-aaa5-4a26faf517ee None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:24.236953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3d583-7e9c-4e62-aaa5-4a26faf517ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:24.254139 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-a3e3d583-7e9c-4e62-aaa5-4a26faf517ee None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:29:24.255320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a3e3d583-7e9c-4e62-aaa5-4a26faf517ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:29:24.321358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 630/1262] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:29:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:29:24.343968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8def01c-d045-4d73-95eb-5cee9989b3b1 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:24.355062 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:24.442466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8def01c-d045-4d73-95eb-5cee9989b3b1 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:24.476583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193d586-1d5f-4b29-b878-a9d56dce03bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:24.477593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193d586-1d5f-4b29-b878-a9d56dce03bd None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:24.477932 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193d586-1d5f-4b29-b878-a9d56dce03bd None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:24.479252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193d586-1d5f-4b29-b878-a9d56dce03bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:24.489830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193d586-1d5f-4b29-b878-a9d56dce03bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-a193d586-1d5f-4b29-b878-a9d56dce03bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:29:24.497539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:24.498575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:24.499501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:24.499501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:24.499501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:24.499501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:24.499501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:29:24.499501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:29:24.499501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:29:24.499501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:29:24.499501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:29:24.499501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:29:24.499501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:29:24.499501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:24.499501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 633/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:29:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:24.504791 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3d583-7e9c-4e62-aaa5-4a26faf517ee None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:24.523199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:24.602842 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3d583-7e9c-4e62-aaa5-4a26faf517ee None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:24.636450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e11ca-b327-4c06-ab57-d5f136d31713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:24.637157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e11ca-b327-4c06-ab57-d5f136d31713 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:24.637442 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e11ca-b327-4c06-ab57-d5f136d31713 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:24.637719 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e11ca-b327-4c06-ab57-d5f136d31713 None admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:24.638463 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e11ca-b327-4c06-ab57-d5f136d31713 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:24.638771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e11ca-b327-4c06-ab57-d5f136d31713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:24.640133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e11ca-b327-4c06-ab57-d5f136d31713 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:24.648872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 631/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:29:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:24.654684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193d586-1d5f-4b29-b878-a9d56dce03bd None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:24.721744 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:24.755710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193d586-1d5f-4b29-b878-a9d56dce03bd None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:24.789019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d79e87-e15d-47b9-b8dd-e8ee430a194e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:24.789811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d79e87-e15d-47b9-b8dd-e8ee430a194e None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:24.790097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d79e87-e15d-47b9-b8dd-e8ee430a194e None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:24.790376 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d79e87-e15d-47b9-b8dd-e8ee430a194e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:24.802119 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d79e87-e15d-47b9-b8dd-e8ee430a194e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:24.803660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d79e87-e15d-47b9-b8dd-e8ee430a194e None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:24.820818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-e6d79e87-e15d-47b9-b8dd-e8ee430a194e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:24.820818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:24.820818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:24.820818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:24.820818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:24.820818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:24.820818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:24.820818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:24.820818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:24.820818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:24.820818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:24.820818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:24.820818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:29:24.820818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:29:24.820818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:24.821943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:24.823071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:29:24.823071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:29:24.823071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:24.823071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:24.825091 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 634/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:24.827754 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e11ca-b327-4c06-ab57-d5f136d31713 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:24.908359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:24.927395 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e11ca-b327-4c06-ab57-d5f136d31713 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:24.960912 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bb8ee-3b2a-4c78-a023-d74c68add87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:24.961611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bb8ee-3b2a-4c78-a023-d74c68add87c None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:24.961896 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bb8ee-3b2a-4c78-a023-d74c68add87c None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:24.962174 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bb8ee-3b2a-4c78-a023-d74c68add87c None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:24.962892 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bb8ee-3b2a-4c78-a023-d74c68add87c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:24.963202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bb8ee-3b2a-4c78-a023-d74c68add87c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:24.964577 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bb8ee-3b2a-4c78-a023-d74c68add87c None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:24.977239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 632/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:24.983367 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d79e87-e15d-47b9-b8dd-e8ee430a194e None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:25.083406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d79e87-e15d-47b9-b8dd-e8ee430a194e None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:25.102764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:25.117184 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568ff2a-6370-418a-a7b0-36a4c0075c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:25.117983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568ff2a-6370-418a-a7b0-36a4c0075c64 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:25.118268 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568ff2a-6370-418a-a7b0-36a4c0075c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:25.118543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568ff2a-6370-418a-a7b0-36a4c0075c64 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:25.126485 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568ff2a-6370-418a-a7b0-36a4c0075c64 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:25.127918 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568ff2a-6370-418a-a7b0-36a4c0075c64 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-9568ff2a-6370-418a-a7b0-36a4c0075c64 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:29:25.141949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:25.143096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:25.144593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:25.144593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:25.144593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:29:25.144593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:29:25.144593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:29:25.144593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:29:25.144593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:29:25.144593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:29:25.144593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 01 17:29:25.144593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:25.144593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 635/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:25.149683 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bb8ee-3b2a-4c78-a023-d74c68add87c None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:25.247203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bb8ee-3b2a-4c78-a023-d74c68add87c None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:25.281034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed981e10-8e86-463f-9d70-4fd527ef9d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:25.284281 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed981e10-8e86-463f-9d70-4fd527ef9d60 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:25.284582 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed981e10-8e86-463f-9d70-4fd527ef9d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:25.284957 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed981e10-8e86-463f-9d70-4fd527ef9d60 None admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:25.285861 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed981e10-8e86-463f-9d70-4fd527ef9d60 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:25.286178 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed981e10-8e86-463f-9d70-4fd527ef9d60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:25.287690 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed981e10-8e86-463f-9d70-4fd527ef9d60 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:25.296830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:25.307599 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 633/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Jun 1 17:29:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:25.313720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568ff2a-6370-418a-a7b0-36a4c0075c64 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:25.414851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568ff2a-6370-418a-a7b0-36a4c0075c64 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:25.448534 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918409f0-de97-48b4-8c8c-9e5b4ab99644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:25.449358 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918409f0-de97-48b4-8c8c-9e5b4ab99644 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:25.449648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918409f0-de97-48b4-8c8c-9e5b4ab99644 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:25.449931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918409f0-de97-48b4-8c8c-9e5b4ab99644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:25.460673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918409f0-de97-48b4-8c8c-9e5b4ab99644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:25.462183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918409f0-de97-48b4-8c8c-9e5b4ab99644 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:25.480313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-918409f0-de97-48b4-8c8c-9e5b4ab99644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:25.480313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:25.480313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:25.480313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:25.480313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:25.480313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:25.480313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:25.480313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:25.480313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:25.480313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:25.480313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:25.480313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:25.480313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:29:25.480313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:29:25.480313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:25.482726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:25.483885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:29:25.483885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:29:25.483885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:25.483885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:25.483885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 636/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:25.487803 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed981e10-8e86-463f-9d70-4fd527ef9d60 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:25.585180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed981e10-8e86-463f-9d70-4fd527ef9d60 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:25.620171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cf3fb-c940-4219-b005-606abce484ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:25.620839 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cf3fb-c940-4219-b005-606abce484ff None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:25.621156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cf3fb-c940-4219-b005-606abce484ff None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:25.621435 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cf3fb-c940-4219-b005-606abce484ff None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:25.622152 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cf3fb-c940-4219-b005-606abce484ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:25.622461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cf3fb-c940-4219-b005-606abce484ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:25.623835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cf3fb-c940-4219-b005-606abce484ff None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:25.643623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 634/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:25.649656 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918409f0-de97-48b4-8c8c-9e5b4ab99644 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:25.682122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:25.748688 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918409f0-de97-48b4-8c8c-9e5b4ab99644 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:25.781131 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d113f4-bd61-448e-a5ff-640c9da94f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:25.782016 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d113f4-bd61-448e-a5ff-640c9da94f5d None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:25.782889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d113f4-bd61-448e-a5ff-640c9da94f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:25.783164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d113f4-bd61-448e-a5ff-640c9da94f5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:25.789596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d113f4-bd61-448e-a5ff-640c9da94f5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:25.791025 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d113f4-bd61-448e-a5ff-640c9da94f5d None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:25.804666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-00d113f4-bd61-448e-a5ff-640c9da94f5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:29:25.804666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:25.804666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:25.804666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:25.804666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:25.804666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:25.804666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:25.804666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:25.804666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:25.804666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:25.804666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:25.804666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:25.804666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:29:25.804666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:29:25.804666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:25.807840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:25.808997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:29:25.808997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:29:25.808997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:29:25.808997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:29:25.808997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:29:25.808997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:29:25.808997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:29:25.808997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:25.808997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 637/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:25.811868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cf3fb-c940-4219-b005-606abce484ff None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:25.870477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:25.911556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cf3fb-c940-4219-b005-606abce484ff None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:25.943532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53687c79-b590-4fc0-bb68-2620b3673666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:25.944140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53687c79-b590-4fc0-bb68-2620b3673666 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:25.944427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53687c79-b590-4fc0-bb68-2620b3673666 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:25.944708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53687c79-b590-4fc0-bb68-2620b3673666 None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:25.945524 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53687c79-b590-4fc0-bb68-2620b3673666 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:25.945861 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53687c79-b590-4fc0-bb68-2620b3673666 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:25.947311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53687c79-b590-4fc0-bb68-2620b3673666 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:25.959423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 635/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:29:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:25.965591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d113f4-bd61-448e-a5ff-640c9da94f5d None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:26.057815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:26.067505 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d113f4-bd61-448e-a5ff-640c9da94f5d None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:26.103327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287881f0-fa87-43a0-93e7-7a219003e1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:26.104470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287881f0-fa87-43a0-93e7-7a219003e1ec None admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:26.104752 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287881f0-fa87-43a0-93e7-7a219003e1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:26.105056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287881f0-fa87-43a0-93e7-7a219003e1ec None admin] PATH_INFO: `/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/ae952b30dffa450e97ce4a73da8d00f8/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:26.107040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287881f0-fa87-43a0-93e7-7a219003e1ec None admin] RBAC: Authorizing `identity:create_grant(project_id=68bf9a1e88a64a02ba53d0bedb76072a, user_id=ae952b30dffa450e97ce4a73da8d00f8, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:26.108492 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287881f0-fa87-43a0-93e7-7a219003e1ec None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:26.288818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 638/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Wed Jun 1 17:29:25 2022] PUT /identity/v3/projects/68bf9a1e88a64a02ba53d0bedb76072a/users/ae952b30dffa450e97ce4a73da8d00f8/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:29:28.526354 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0db80-3f09-485c-b42c-794ea206ff0c None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:28.526859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0db80-3f09-485c-b42c-794ea206ff0c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:28.526955 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0db80-3f09-485c-b42c-794ea206ff0c None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:28.528281 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 636/1274] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:29:28.533675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478f8d-5500-4d73-ab6a-7e880b57d6ca None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:28.534097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478f8d-5500-4d73-ab6a-7e880b57d6ca None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:28.534239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478f8d-5500-4d73-ab6a-7e880b57d6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:28.550526 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6b478f8d-5500-4d73-ab6a-7e880b57d6ca None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:29:28.551737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6b478f8d-5500-4d73-ab6a-7e880b57d6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:29:28.620347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 639/1275] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:29:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:29:28.644631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0db80-3f09-485c-b42c-794ea206ff0c None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:28.746946 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0db80-3f09-485c-b42c-794ea206ff0c None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:28.763966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:28.780462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9bb10-cb3d-496d-b9b9-4a7cb6e5428a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:28.781275 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9bb10-cb3d-496d-b9b9-4a7cb6e5428a None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:28.781565 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9bb10-cb3d-496d-b9b9-4a7cb6e5428a None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:28.782500 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9bb10-cb3d-496d-b9b9-4a7cb6e5428a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:28.792295 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9bb10-cb3d-496d-b9b9-4a7cb6e5428a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-eee9bb10-cb3d-496d-b9b9-4a7cb6e5428a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 01 17:29:28.800048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:28.803685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:28.804749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:28.804749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:28.804749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:28.804749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:28.804749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 01 17:29:28.804749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 01 17:29:28.804749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 01 17:29:28.804749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 01 17:29:28.804749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 01 17:29:28.804749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 01 17:29:28.804749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 01 17:29:28.804749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:28.804749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 637/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Wed Jun 1 17:29:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:28.807240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b478f8d-5500-4d73-ab6a-7e880b57d6ca None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:28.887693 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:28.906187 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b478f8d-5500-4d73-ab6a-7e880b57d6ca None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:28.940547 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20541a9-7c75-438c-b382-0e900a4fb762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:28.941346 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20541a9-7c75-438c-b382-0e900a4fb762 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:28.941634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20541a9-7c75-438c-b382-0e900a4fb762 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:28.941915 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20541a9-7c75-438c-b382-0e900a4fb762 None admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:28.942659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20541a9-7c75-438c-b382-0e900a4fb762 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:28.942968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20541a9-7c75-438c-b382-0e900a4fb762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:28.944336 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20541a9-7c75-438c-b382-0e900a4fb762 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:28.952275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 640/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Wed Jun 1 17:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:28.958665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9bb10-cb3d-496d-b9b9-4a7cb6e5428a None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:29.060995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9bb10-cb3d-496d-b9b9-4a7cb6e5428a None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:29.094934 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e714a-013a-4929-8e2f-98fc1f405662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:29.095720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e714a-013a-4929-8e2f-98fc1f405662 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:29.096005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e714a-013a-4929-8e2f-98fc1f405662 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:29.096280 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e714a-013a-4929-8e2f-98fc1f405662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:29.106864 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e714a-013a-4929-8e2f-98fc1f405662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:29.108321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e714a-013a-4929-8e2f-98fc1f405662 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:29.125017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-b62e714a-013a-4929-8e2f-98fc1f405662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:29.125017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:29.125017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:29.125017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:29.125017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:29.125017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:29.125017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:29.125017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:29.125017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:29.125017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:29.125017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:29.125017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:29.125017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:29:29.125017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:29:29.125017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:29.126820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:29.127980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:29:29.127980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:29:29.127980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:29.127980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:29.127980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 638/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 01 17:29:29.132748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20541a9-7c75-438c-b382-0e900a4fb762 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:29.234727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20541a9-7c75-438c-b382-0e900a4fb762 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:29.269854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129bc4b-abbb-4f18-beb3-8909e55f9f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:29.270510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129bc4b-abbb-4f18-beb3-8909e55f9f05 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:29.270789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129bc4b-abbb-4f18-beb3-8909e55f9f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:29.271067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129bc4b-abbb-4f18-beb3-8909e55f9f05 None admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:29.271777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129bc4b-abbb-4f18-beb3-8909e55f9f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:29.272082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129bc4b-abbb-4f18-beb3-8909e55f9f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:29.273565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129bc4b-abbb-4f18-beb3-8909e55f9f05 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:29.285487 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 641/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:29.291247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e714a-013a-4929-8e2f-98fc1f405662 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:29.322281 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:29.397478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e714a-013a-4929-8e2f-98fc1f405662 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:29.431375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dd7d8-38d9-4b28-b28e-7d511108d3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:29.432182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dd7d8-38d9-4b28-b28e-7d511108d3ac None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:29.432463 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dd7d8-38d9-4b28-b28e-7d511108d3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:29.432740 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dd7d8-38d9-4b28-b28e-7d511108d3ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:29.441048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dd7d8-38d9-4b28-b28e-7d511108d3ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:29.442494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dd7d8-38d9-4b28-b28e-7d511108d3ac None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-166dd7d8-38d9-4b28-b28e-7d511108d3ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 01 17:29:29.456706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:29.460278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:29.461530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:29.461530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:29.461530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 01 17:29:29.461530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 01 17:29:29.461530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 01 17:29:29.461530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 01 17:29:29.461530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 01 17:29:29.461530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 01 17:29:29.461530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 01 17:29:29.461530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:29.461530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 639/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:29.463830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129bc4b-abbb-4f18-beb3-8909e55f9f05 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:29.467672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:29.562702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129bc4b-abbb-4f18-beb3-8909e55f9f05 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:29.598232 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae6867-94a3-4a45-87c6-cb52fab46af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:29.598907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae6867-94a3-4a45-87c6-cb52fab46af7 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:29.599192 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae6867-94a3-4a45-87c6-cb52fab46af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:29.599472 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae6867-94a3-4a45-87c6-cb52fab46af7 None admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:29.600308 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae6867-94a3-4a45-87c6-cb52fab46af7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:29.600621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae6867-94a3-4a45-87c6-cb52fab46af7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:29.602088 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae6867-94a3-4a45-87c6-cb52fab46af7 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:29.619616 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 642/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Wed Jun 1 17:29:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:29.625808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dd7d8-38d9-4b28-b28e-7d511108d3ac None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:29.728587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:29.738639 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dd7d8-38d9-4b28-b28e-7d511108d3ac None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:29.771757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebaef45-4ab6-4d25-9122-06a4d4ac6c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:29.772417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebaef45-4ab6-4d25-9122-06a4d4ac6c78 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:29.772706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebaef45-4ab6-4d25-9122-06a4d4ac6c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:29.773040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebaef45-4ab6-4d25-9122-06a4d4ac6c78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:29.838268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebaef45-4ab6-4d25-9122-06a4d4ac6c78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:29.839727 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebaef45-4ab6-4d25-9122-06a4d4ac6c78 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:29.928239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:29.938469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 640/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Wed Jun 1 17:29:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 01 17:29:29.946853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae6867-94a3-4a45-87c6-cb52fab46af7 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:30.014058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:30.054653 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae6867-94a3-4a45-87c6-cb52fab46af7 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:30.089214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8f792-a953-4b36-9eae-a9caaa69f3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:30.090010 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8f792-a953-4b36-9eae-a9caaa69f3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:30.090294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8f792-a953-4b36-9eae-a9caaa69f3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:30.090569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8f792-a953-4b36-9eae-a9caaa69f3b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:30.100848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8f792-a953-4b36-9eae-a9caaa69f3b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:30.102321 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8f792-a953-4b36-9eae-a9caaa69f3b3 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:30.118994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-e8d8f792-a953-4b36-9eae-a9caaa69f3b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:30.118994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:30.118994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:30.118994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:30.118994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:30.118994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:30.118994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:30.118994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:30.118994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:30.118994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:30.118994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:30.118994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:30.118994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 01 17:29:30.118994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 01 17:29:30.118994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:30.120094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:30.121415 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 01 17:29:30.121415 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 01 17:29:30.121415 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 01 17:29:30.121415 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:30.121415 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 643/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:30.126480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebaef45-4ab6-4d25-9122-06a4d4ac6c78 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:30.224535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebaef45-4ab6-4d25-9122-06a4d4ac6c78 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:30.258653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897f577-6f21-4f2d-970a-02cc58ce7bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:30.262587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897f577-6f21-4f2d-970a-02cc58ce7bca None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:30.262587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897f577-6f21-4f2d-970a-02cc58ce7bca None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:30.262587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897f577-6f21-4f2d-970a-02cc58ce7bca None admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:30.262587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897f577-6f21-4f2d-970a-02cc58ce7bca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:30.262587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897f577-6f21-4f2d-970a-02cc58ce7bca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:30.262587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897f577-6f21-4f2d-970a-02cc58ce7bca None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:30.273392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 641/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Wed Jun 1 17:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:30.279046 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8f792-a953-4b36-9eae-a9caaa69f3b3 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:30.384755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8f792-a953-4b36-9eae-a9caaa69f3b3 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:30.398557 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:30.418319 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f480b9-c2e1-46fe-9389-431074af0811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:30.419117 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f480b9-c2e1-46fe-9389-431074af0811 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:30.419408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f480b9-c2e1-46fe-9389-431074af0811 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:30.419690 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f480b9-c2e1-46fe-9389-431074af0811 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:30.426797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f480b9-c2e1-46fe-9389-431074af0811 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:30.428265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f480b9-c2e1-46fe-9389-431074af0811 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:30.442991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application [None req-86f480b9-c2e1-46fe-9389-431074af0811 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:29:30.442991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:30.442991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:30.442991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:30.442991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:30.442991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:30.442991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:30.442991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:30.442991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:30.442991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:30.442991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:30.442991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:30.442991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 01 17:29:30.442991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 01 17:29:30.442991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:30.444099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:30.445095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 01 17:29:30.445095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 01 17:29:30.445095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 01 17:29:30.445095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 01 17:29:30.445095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 01 17:29:30.445095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 01 17:29:30.445095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 01 17:29:30.445095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: ERROR keystone.server.flask.application Jun 01 17:29:30.445095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 644/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Wed Jun 1 17:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:30.450301 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897f577-6f21-4f2d-970a-02cc58ce7bca None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:30.508627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:30.557993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897f577-6f21-4f2d-970a-02cc58ce7bca None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:30.590083 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be3f50-180c-499c-a931-af823bcd8ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:30.590743 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be3f50-180c-499c-a931-af823bcd8ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:30.591029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be3f50-180c-499c-a931-af823bcd8ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:30.591306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be3f50-180c-499c-a931-af823bcd8ce4 None admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:30.592090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be3f50-180c-499c-a931-af823bcd8ce4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:30.592404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be3f50-180c-499c-a931-af823bcd8ce4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:30.593893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be3f50-180c-499c-a931-af823bcd8ce4 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:30.606386 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 642/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Wed Jun 1 17:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:30.614413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f480b9-c2e1-46fe-9389-431074af0811 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:30.727160 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f480b9-c2e1-46fe-9389-431074af0811 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:30.761548 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8354a1-f6ac-4aeb-b6ee-2462a74e838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:30.762210 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8354a1-f6ac-4aeb-b6ee-2462a74e838b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:30.762497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8354a1-f6ac-4aeb-b6ee-2462a74e838b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:30.762774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8354a1-f6ac-4aeb-b6ee-2462a74e838b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:30.763609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8354a1-f6ac-4aeb-b6ee-2462a74e838b None admin] RBAC: Adding query filter params (role.id=7b6b405f7b6f4090a7c5ea400474f8c5, scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a, user.id=ae952b30dffa450e97ce4a73da8d00f8) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:30.763923 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8354a1-f6ac-4aeb-b6ee-2462a74e838b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:30.765396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8354a1-f6ac-4aeb-b6ee-2462a74e838b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:30.771296 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 645/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Wed Jun 1 17:29:30 2022] GET /identity/v3/role_assignments?user.id=ae952b30dffa450e97ce4a73da8d00f8&scope.project.id=68bf9a1e88a64a02ba53d0bedb76072a&role.id=7b6b405f7b6f4090a7c5ea400474f8c5 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:33.059822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d3f68-1273-489c-856c-abddb5bf0a53 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:33.060432 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d3f68-1273-489c-856c-abddb5bf0a53 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:33.060432 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d3f68-1273-489c-856c-abddb5bf0a53 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:33.061813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 643/1288] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:29:33.067218 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c28bd-f7c5-484e-8d3c-2a2396b44e5e None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:33.067671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c28bd-f7c5-484e-8d3c-2a2396b44e5e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:33.067788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c28bd-f7c5-484e-8d3c-2a2396b44e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:33.085137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a99c28bd-f7c5-484e-8d3c-2a2396b44e5e None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:29:33.086323 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a99c28bd-f7c5-484e-8d3c-2a2396b44e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:29:33.117563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:33.154286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 646/1289] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:29:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:29:33.176739 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d3f68-1273-489c-856c-abddb5bf0a53 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:33.281195 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d3f68-1273-489c-856c-abddb5bf0a53 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:33.293681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:33.338980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94097ad8-24e1-4098-b146-5151c15b6378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:33.338980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94097ad8-24e1-4098-b146-5151c15b6378 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:33.338980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94097ad8-24e1-4098-b146-5151c15b6378 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:33.338980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94097ad8-24e1-4098-b146-5151c15b6378 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:33.339413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94097ad8-24e1-4098-b146-5151c15b6378 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:33.339413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94097ad8-24e1-4098-b146-5151c15b6378 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:33.339413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-94097ad8-24e1-4098-b146-5151c15b6378 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 17:29:33.339413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:33.339413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:29:33.339413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:29:33.339413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:29:33.339413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:29:33.339413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:29:33.339413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:29:33.339413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 17:29:33.339413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:33.339413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:29:33.340404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:29:33.341532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:29:33.342535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 17:29:33.342535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:33.342535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 644/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jun 1 17:29:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:33.342727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c28bd-f7c5-484e-8d3c-2a2396b44e5e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:33.438797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c28bd-f7c5-484e-8d3c-2a2396b44e5e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:33.475268 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc3d42-572f-411f-9034-aaed1aa97f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:33.475948 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc3d42-572f-411f-9034-aaed1aa97f9b None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:33.476235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc3d42-572f-411f-9034-aaed1aa97f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:33.476513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc3d42-572f-411f-9034-aaed1aa97f9b None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:33.477291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc3d42-572f-411f-9034-aaed1aa97f9b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:33.477605 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc3d42-572f-411f-9034-aaed1aa97f9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:33.479267 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc3d42-572f-411f-9034-aaed1aa97f9b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:33.484212 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 647/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Wed Jun 1 17:29:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:33.490232 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94097ad8-24e1-4098-b146-5151c15b6378 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:33.591181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94097ad8-24e1-4098-b146-5151c15b6378 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:33.624893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd971a-447e-47fa-9095-ee972d8ec163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:33.626108 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd971a-447e-47fa-9095-ee972d8ec163 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:33.626626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd971a-447e-47fa-9095-ee972d8ec163 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:33.626626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd971a-447e-47fa-9095-ee972d8ec163 None admin] PATH_INFO: `/v3/services` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:33.627333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd971a-447e-47fa-9095-ee972d8ec163 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:33.627642 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd971a-447e-47fa-9095-ee972d8ec163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:33.629116 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd971a-447e-47fa-9095-ee972d8ec163 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:33.633626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 645/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Wed Jun 1 17:29:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:35.885538 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d66f97-9c90-4c31-9e04-726426c6c723 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:35.886070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d66f97-9c90-4c31-9e04-726426c6c723 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:35.886183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d66f97-9c90-4c31-9e04-726426c6c723 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:35.887489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 648/1293] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:29:35.892909 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd6944-30e1-4e64-be21-6654f50fefd2 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:35.895249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd6944-30e1-4e64-be21-6654f50fefd2 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:35.895249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd6944-30e1-4e64-be21-6654f50fefd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:35.911032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-f0fd6944-30e1-4e64-be21-6654f50fefd2 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:29:35.912478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f0fd6944-30e1-4e64-be21-6654f50fefd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:29:35.942063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:35.977979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 646/1294] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:29:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:29:36.001588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d66f97-9c90-4c31-9e04-726426c6c723 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:36.033428 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:36.103257 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d66f97-9c90-4c31-9e04-726426c6c723 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:36.138476 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f3e7b-6f01-46bf-a9e0-5ce4945a589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:36.139195 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f3e7b-6f01-46bf-a9e0-5ce4945a589b None admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:36.139482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f3e7b-6f01-46bf-a9e0-5ce4945a589b None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:36.139756 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f3e7b-6f01-46bf-a9e0-5ce4945a589b None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:36.140479 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f3e7b-6f01-46bf-a9e0-5ce4945a589b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:36.142409 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f3e7b-6f01-46bf-a9e0-5ce4945a589b None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:36.196601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 649/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Wed Jun 1 17:29:36 2022] POST /identity/v3/services => generated 246 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:29:38.426905 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc21948-4f2f-4f10-804b-d26f27d6db01 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:38.427467 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc21948-4f2f-4f10-804b-d26f27d6db01 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:38.427467 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc21948-4f2f-4f10-804b-d26f27d6db01 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:38.428833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 647/1296] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:29:38.434247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab39eaa-18b9-4e0c-92a9-dde3e0578d02 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:38.434682 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab39eaa-18b9-4e0c-92a9-dde3e0578d02 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:38.434814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab39eaa-18b9-4e0c-92a9-dde3e0578d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:38.452107 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8ab39eaa-18b9-4e0c-92a9-dde3e0578d02 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:29:38.453367 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8ab39eaa-18b9-4e0c-92a9-dde3e0578d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:29:38.526758 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 650/1297] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:29:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:29:38.550170 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc21948-4f2f-4f10-804b-d26f27d6db01 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:38.648330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc21948-4f2f-4f10-804b-d26f27d6db01 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:38.681229 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a0cdb-9ee8-415c-9a07-e9a43ce884d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:38.681969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a0cdb-9ee8-415c-9a07-e9a43ce884d3 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:38.682251 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a0cdb-9ee8-415c-9a07-e9a43ce884d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:38.682529 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a0cdb-9ee8-415c-9a07-e9a43ce884d3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:38.683176 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a0cdb-9ee8-415c-9a07-e9a43ce884d3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:38.684546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a0cdb-9ee8-415c-9a07-e9a43ce884d3 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-ff2a0cdb-9ee8-415c-9a07-e9a43ce884d3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:38.696407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:38.704365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:38.705441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:38.705441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:38.705441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:38.705441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:38.705441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:38.705441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:38.705441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:38.705441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:38.705441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:38.705441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:38.705441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:29:38.705441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:29:38.705441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 17:29:38.705441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:38.705441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 648/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jun 1 17:29:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:38.706440 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab39eaa-18b9-4e0c-92a9-dde3e0578d02 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:38.723417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:38.803683 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab39eaa-18b9-4e0c-92a9-dde3e0578d02 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:38.838583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4e83f-6c7b-4c31-bf8b-efe666457426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:38.839241 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4e83f-6c7b-4c31-bf8b-efe666457426 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:38.839531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4e83f-6c7b-4c31-bf8b-efe666457426 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:38.839807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4e83f-6c7b-4c31-bf8b-efe666457426 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:38.840505 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4e83f-6c7b-4c31-bf8b-efe666457426 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:38.840855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4e83f-6c7b-4c31-bf8b-efe666457426 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:38.842235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4e83f-6c7b-4c31-bf8b-efe666457426 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:38.848236 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 651/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Wed Jun 1 17:29:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:38.854523 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a0cdb-9ee8-415c-9a07-e9a43ce884d3 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:38.885735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:38.953767 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a0cdb-9ee8-415c-9a07-e9a43ce884d3 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:38.987410 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c0742-b074-4047-9334-d4985fd600e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:38.988064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c0742-b074-4047-9334-d4985fd600e6 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:38.988351 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c0742-b074-4047-9334-d4985fd600e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:38.988629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c0742-b074-4047-9334-d4985fd600e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:38.989451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c0742-b074-4047-9334-d4985fd600e6 None admin] RBAC: Adding query filter params (interface=public, service_id=1cf051642f204bc29eefa0af1a1c5fe1, region_id=RegionOne) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:38.989767 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c0742-b074-4047-9334-d4985fd600e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:38.991144 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c0742-b074-4047-9334-d4985fd600e6 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:38.996208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 649/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Wed Jun 1 17:29:38 2022] GET /identity/v3/endpoints?service_id=1cf051642f204bc29eefa0af1a1c5fe1&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:29:39.005493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4e83f-6c7b-4c31-bf8b-efe666457426 None admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:39.082726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:39.100685 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4e83f-6c7b-4c31-bf8b-efe666457426 None admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:39.134592 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59075bd7-0f69-474b-8901-5e8a9099f223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:39.135267 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59075bd7-0f69-474b-8901-5e8a9099f223 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:39.135561 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59075bd7-0f69-474b-8901-5e8a9099f223 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:39.135836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59075bd7-0f69-474b-8901-5e8a9099f223 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:39.136516 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59075bd7-0f69-474b-8901-5e8a9099f223 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:39.137922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59075bd7-0f69-474b-8901-5e8a9099f223 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:39.145121 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 652/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Wed Jun 1 17:29:39 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:29:41.421677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5554c66-c896-49bf-add4-b8e22f852376 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:41.422228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5554c66-c896-49bf-add4-b8e22f852376 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:41.422228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5554c66-c896-49bf-add4-b8e22f852376 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:41.424233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 650/1302] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:29:41.429390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d01e61-008f-4e9f-9509-4f6bcf736b49 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:41.429818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d01e61-008f-4e9f-9509-4f6bcf736b49 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:41.429974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d01e61-008f-4e9f-9509-4f6bcf736b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:41.447124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-58d01e61-008f-4e9f-9509-4f6bcf736b49 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:29:41.449054 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-58d01e61-008f-4e9f-9509-4f6bcf736b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:29:41.515322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 653/1303] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:29:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 01 17:29:41.538617 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5554c66-c896-49bf-add4-b8e22f852376 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:41.634565 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:41.641422 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5554c66-c896-49bf-add4-b8e22f852376 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:41.680987 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fea8d-0f12-4e35-a325-0487d88face9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:41.681720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fea8d-0f12-4e35-a325-0487d88face9 None admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:41.682005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fea8d-0f12-4e35-a325-0487d88face9 None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:41.682281 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fea8d-0f12-4e35-a325-0487d88face9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:41.682964 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fea8d-0f12-4e35-a325-0487d88face9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:41.684327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fea8d-0f12-4e35-a325-0487d88face9 None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application [None req-769fea8d-0f12-4e35-a325-0487d88face9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 01 17:29:41.697884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 01 17:29:41.699185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.get_or_create( Jun 01 17:29:41.700211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 01 17:29:41.700211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application with Lock( Jun 01 17:29:41.700211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 01 17:29:41.700211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self._enter() Jun 01 17:29:41.700211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 01 17:29:41.700211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 01 17:29:41.700211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 01 17:29:41.700211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application return self.creator() Jun 01 17:29:41.700211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 01 17:29:41.700211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application created_value = creator( Jun 01 17:29:41.700211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 01 17:29:41.700211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 01 17:29:41.700211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 01 17:29:41.700211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: ERROR keystone.server.flask.application Jun 01 17:29:41.700211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 651/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Wed Jun 1 17:29:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 01 17:29:41.706086 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d01e61-008f-4e9f-9509-4f6bcf736b49 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:41.783103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:41.805789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d01e61-008f-4e9f-9509-4f6bcf736b49 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:41.838503 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b945e-5920-469f-a377-5a63c55b2238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:41.839155 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b945e-5920-469f-a377-5a63c55b2238 None admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:41.839439 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b945e-5920-469f-a377-5a63c55b2238 None admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:41.839712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b945e-5920-469f-a377-5a63c55b2238 None admin] PATH_INFO: `/v3/services` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:41.840409 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b945e-5920-469f-a377-5a63c55b2238 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:29:41.840714 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b945e-5920-469f-a377-5a63c55b2238 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:41.842237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b945e-5920-469f-a377-5a63c55b2238 None admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:41.847910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 654/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Wed Jun 1 17:29:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:29:41.853916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fea8d-0f12-4e35-a325-0487d88face9 None admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:29:41.952686 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fea8d-0f12-4e35-a325-0487d88face9 None admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:29:41.987715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aed1ca-b8dd-4526-9cea-8468d0897d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:29:41.988368 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aed1ca-b8dd-4526-9cea-8468d0897d3f None admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:29:41.988648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aed1ca-b8dd-4526-9cea-8468d0897d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:29:41.988920 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aed1ca-b8dd-4526-9cea-8468d0897d3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:29:41.989672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aed1ca-b8dd-4526-9cea-8468d0897d3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:29:41.991034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aed1ca-b8dd-4526-9cea-8468d0897d3f None admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:29:42.090885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 652/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Wed Jun 1 17:29:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:29:51.854962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=30 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:29:52.086327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:12.716304 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a3ff7-1a4e-4951-902f-c63cacba7ad4 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:12.717886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a3ff7-1a4e-4951-902f-c63cacba7ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:12.718547 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a3ff7-1a4e-4951-902f-c63cacba7ad4 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:12.725677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a0df2-0a29-4c93-aa19-e09fe452a729 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:12.726592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a0df2-0a29-4c93-aa19-e09fe452a729 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:12.727370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a0df2-0a29-4c93-aa19-e09fe452a729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:12.731160 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 655/1307] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:37:12 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:37:12.823463 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-db7a0df2-0a29-4c93-aa19-e09fe452a729 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:37:12.825429 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-db7a0df2-0a29-4c93-aa19-e09fe452a729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:13.063392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 653/1308] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:37:13.115868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c74f4c-ee12-417a-9eac-ceca1689fc76 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:13.116355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c74f4c-ee12-417a-9eac-ceca1689fc76 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:13.116904 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c74f4c-ee12-417a-9eac-ceca1689fc76 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:13.119045 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 656/1309] 10.222.0.33 () {54 vars in 964 bytes} [Wed Jun 1 17:37:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:37:13.132367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04d835-8a4a-429c-b50c-72e6af99a93c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:13.132773 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04d835-8a4a-429c-b50c-72e6af99a93c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:13.133187 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04d835-8a4a-429c-b50c-72e6af99a93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:13.372724 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-ac04d835-8a4a-429c-b50c-72e6af99a93c None None] MFA Rules not processed for user `4254398f2aac42f7b54f29294a73bfda`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:37:13.374021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ac04d835-8a4a-429c-b50c-72e6af99a93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:13.400968 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:13.462760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 654/1310] 10.222.0.33 () {58 vars in 1061 bytes} [Wed Jun 1 17:37:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:37:13.472807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c74f4c-ee12-417a-9eac-ceca1689fc76 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:37:13.474733 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d8c74f4c-ee12-417a-9eac-ceca1689fc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:13.603563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c74f4c-ee12-417a-9eac-ceca1689fc76 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:37:13.690515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beb183-9c43-48e5-842b-8bfebb91a005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:37:13.691360 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beb183-9c43-48e5-842b-8bfebb91a005 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:13.691754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beb183-9c43-48e5-842b-8bfebb91a005 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:13.692132 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beb183-9c43-48e5-842b-8bfebb91a005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:13.693959 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-21beb183-9c43-48e5-842b-8bfebb91a005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:13.770641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:13.837516 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21beb183-9c43-48e5-842b-8bfebb91a005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:37:13.839299 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21beb183-9c43-48e5-842b-8bfebb91a005 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:37:13.864612 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 657/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:37:16.487166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a7bff-aa29-4564-a4a6-f0392d3ccede None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:16.487691 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a7bff-aa29-4564-a4a6-f0392d3ccede None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:16.487983 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a7bff-aa29-4564-a4a6-f0392d3ccede None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:16.494378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 655/1312] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:37:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:37:16.494840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b413f-36e6-4886-84ed-badb86a24909 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:16.495238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b413f-36e6-4886-84ed-badb86a24909 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:16.495613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b413f-36e6-4886-84ed-badb86a24909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:16.580362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-dd3b413f-36e6-4886-84ed-badb86a24909 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:37:16.581711 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-dd3b413f-36e6-4886-84ed-badb86a24909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:16.678702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 658/1313] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:37:16.716764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a7bff-aa29-4564-a4a6-f0392d3ccede None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:37:16.719024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-2f3a7bff-aa29-4564-a4a6-f0392d3ccede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:16.834713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a7bff-aa29-4564-a4a6-f0392d3ccede None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:37:16.904231 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:16.907499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfd214-66e0-459f-b104-5d7e6d008770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:37:16.908146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfd214-66e0-459f-b104-5d7e6d008770 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:16.908425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfd214-66e0-459f-b104-5d7e6d008770 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:16.908696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfd214-66e0-459f-b104-5d7e6d008770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:16.910345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-86cfd214-66e0-459f-b104-5d7e6d008770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:17.020790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfd214-66e0-459f-b104-5d7e6d008770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:37:17.022270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfd214-66e0-459f-b104-5d7e6d008770 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:37:17.042606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 656/1314] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:37:19.912969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd31ab-1ef7-4edd-a180-7e77162acc76 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:19.913540 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd31ab-1ef7-4edd-a180-7e77162acc76 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:19.913540 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd31ab-1ef7-4edd-a180-7e77162acc76 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:19.914900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 659/1315] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:37:19.920492 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157778b-5918-40a4-a0ed-acd515e3cef6 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:19.921009 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157778b-5918-40a4-a0ed-acd515e3cef6 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:19.921133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157778b-5918-40a4-a0ed-acd515e3cef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:19.984599 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-2157778b-5918-40a4-a0ed-acd515e3cef6 None None] MFA Rules not processed for user `a52d7d11a1784629a115d5e9c42434a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:37:19.985833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-2157778b-5918-40a4-a0ed-acd515e3cef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:20.036520 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:20.081155 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 657/1316] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:37:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:37:20.120946 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd31ab-1ef7-4edd-a180-7e77162acc76 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:37:20.122531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-14fd31ab-1ef7-4edd-a180-7e77162acc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:20.132448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:20.228404 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd31ab-1ef7-4edd-a180-7e77162acc76 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:37:20.429434 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df373b35-8433-4974-b6ac-f91a1f55550a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:37:20.430080 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df373b35-8433-4974-b6ac-f91a1f55550a service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:20.430358 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df373b35-8433-4974-b6ac-f91a1f55550a service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:20.430630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df373b35-8433-4974-b6ac-f91a1f55550a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:20.432282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-df373b35-8433-4974-b6ac-f91a1f55550a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:20.494364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:20.541253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df373b35-8433-4974-b6ac-f91a1f55550a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:37:20.542678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df373b35-8433-4974-b6ac-f91a1f55550a service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:37:20.560326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 660/1317] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:37:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:37:23.668441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32e1ea-844d-497c-a566-4a582edf8a6a None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:23.669057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32e1ea-844d-497c-a566-4a582edf8a6a None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:23.669158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32e1ea-844d-497c-a566-4a582edf8a6a None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:23.670524 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 658/1318] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:37:23.675699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ce8db-91fd-4307-b44b-66ed2d494ad8 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:23.676131 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ce8db-91fd-4307-b44b-66ed2d494ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:23.676248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ce8db-91fd-4307-b44b-66ed2d494ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:23.740413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-491ce8db-91fd-4307-b44b-66ed2d494ad8 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:37:23.741568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-491ce8db-91fd-4307-b44b-66ed2d494ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:23.836869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 661/1319] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:37:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:37:23.888260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f85058-d1c6-4650-a472-37d75b7d2ca5 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:23.888679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f85058-d1c6-4650-a472-37d75b7d2ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:23.889632 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f85058-d1c6-4650-a472-37d75b7d2ca5 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:23.891113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 659/1320] 10.222.0.33 () {54 vars in 964 bytes} [Wed Jun 1 17:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:37:23.896831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59497fd0-dc20-4894-9328-39581e2dff81 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:23.897165 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59497fd0-dc20-4894-9328-39581e2dff81 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:23.897451 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59497fd0-dc20-4894-9328-39581e2dff81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:23.917753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:23.972343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-59497fd0-dc20-4894-9328-39581e2dff81 None None] MFA Rules not processed for user `4254398f2aac42f7b54f29294a73bfda`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:37:23.973583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-59497fd0-dc20-4894-9328-39581e2dff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:24.049192 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 662/1321] 10.222.0.33 () {58 vars in 1061 bytes} [Wed Jun 1 17:37:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:37:24.058357 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f85058-d1c6-4650-a472-37d75b7d2ca5 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:37:24.059906 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-80f85058-d1c6-4650-a472-37d75b7d2ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:24.161153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f85058-d1c6-4650-a472-37d75b7d2ca5 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:37:24.233523 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cb104-cb32-41f3-88ae-372f340eebd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:37:24.234166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cb104-cb32-41f3-88ae-372f340eebd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:24.234449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cb104-cb32-41f3-88ae-372f340eebd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:24.234723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cb104-cb32-41f3-88ae-372f340eebd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:24.236363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-629cb104-cb32-41f3-88ae-372f340eebd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:24.243593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:24.342854 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cb104-cb32-41f3-88ae-372f340eebd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:37:24.344208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cb104-cb32-41f3-88ae-372f340eebd4 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:37:24.362730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 660/1322] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:37:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:37:28.214607 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cee511-7665-429e-946f-9a720de4ed2d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:28.215146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cee511-7665-429e-946f-9a720de4ed2d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:28.215146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cee511-7665-429e-946f-9a720de4ed2d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:28.216539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 663/1323] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:37:28.222557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f374142-0d5b-48e7-991c-078cf25897f4 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:28.223013 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f374142-0d5b-48e7-991c-078cf25897f4 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:28.223246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f374142-0d5b-48e7-991c-078cf25897f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:28.290079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-6f374142-0d5b-48e7-991c-078cf25897f4 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:37:28.291305 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6f374142-0d5b-48e7-991c-078cf25897f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:28.350745 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:28.389247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 661/1324] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:37:28.425571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cee511-7665-429e-946f-9a720de4ed2d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:37:28.427090 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-98cee511-7665-429e-946f-9a720de4ed2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:28.532279 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cee511-7665-429e-946f-9a720de4ed2d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:37:28.545643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:28.608132 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaaf42-adbf-46ce-9ece-20fb9a0966cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:37:28.608830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaaf42-adbf-46ce-9ece-20fb9a0966cb service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:28.609130 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaaf42-adbf-46ce-9ece-20fb9a0966cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:28.609410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaaf42-adbf-46ce-9ece-20fb9a0966cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:28.611074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cdaaaf42-adbf-46ce-9ece-20fb9a0966cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:28.719800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaaf42-adbf-46ce-9ece-20fb9a0966cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:37:28.721300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaaf42-adbf-46ce-9ece-20fb9a0966cb service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:37:28.740251 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 664/1325] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:37:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:37:31.139338 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6c839-1003-444c-bce6-b45e09460489 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:31.140354 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6c839-1003-444c-bce6-b45e09460489 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:31.140870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6c839-1003-444c-bce6-b45e09460489 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:31.142305 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 662/1326] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:37:31.147722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab38fd-e8da-4a74-8a8a-4e8984229350 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:31.148243 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab38fd-e8da-4a74-8a8a-4e8984229350 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:31.148418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab38fd-e8da-4a74-8a8a-4e8984229350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:31.197014 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:31.215170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-40ab38fd-e8da-4a74-8a8a-4e8984229350 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:37:31.229377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-40ab38fd-e8da-4a74-8a8a-4e8984229350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:31.317068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 665/1327] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:37:31.349274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6c839-1003-444c-bce6-b45e09460489 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:37:31.350864 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-94e6c839-1003-444c-bce6-b45e09460489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:31.456120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6c839-1003-444c-bce6-b45e09460489 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:37:31.532861 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8e16a-7e4b-4f2d-aeae-473c8cba8400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:37:31.533536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8e16a-7e4b-4f2d-aeae-473c8cba8400 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:31.533830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8e16a-7e4b-4f2d-aeae-473c8cba8400 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:31.534100 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8e16a-7e4b-4f2d-aeae-473c8cba8400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:31.535761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-70d8e16a-7e4b-4f2d-aeae-473c8cba8400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:31.552635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:31.647237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8e16a-7e4b-4f2d-aeae-473c8cba8400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:37:31.648662 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8e16a-7e4b-4f2d-aeae-473c8cba8400 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:37:31.667120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 663/1328] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:37:34.000214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db7a4d-c73f-4a22-8bc4-b1099ee1f144 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:34.000731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db7a4d-c73f-4a22-8bc4-b1099ee1f144 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:34.000731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db7a4d-c73f-4a22-8bc4-b1099ee1f144 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:34.002104 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 666/1329] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:37:34.007415 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e2ee7-e472-4879-92c9-e5d69f620ece None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:34.007800 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e2ee7-e472-4879-92c9-e5d69f620ece None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:34.007984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e2ee7-e472-4879-92c9-e5d69f620ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:34.073834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-e89e2ee7-e472-4879-92c9-e5d69f620ece None None] MFA Rules not processed for user `a52d7d11a1784629a115d5e9c42434a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:37:34.075034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e89e2ee7-e472-4879-92c9-e5d69f620ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:34.143316 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:34.176264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 664/1330] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:37:34 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:37:34.214995 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db7a4d-c73f-4a22-8bc4-b1099ee1f144 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:37:34.216526 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d9db7a4d-c73f-4a22-8bc4-b1099ee1f144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:34.323017 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db7a4d-c73f-4a22-8bc4-b1099ee1f144 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:37:34.345723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:34.404823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb7d46-7d72-4120-aff3-31fff142f112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:37:34.406608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb7d46-7d72-4120-aff3-31fff142f112 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:34.406998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb7d46-7d72-4120-aff3-31fff142f112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:34.407413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb7d46-7d72-4120-aff3-31fff142f112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:34.409218 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-deeb7d46-7d72-4120-aff3-31fff142f112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:34.523773 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb7d46-7d72-4120-aff3-31fff142f112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:37:34.525248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb7d46-7d72-4120-aff3-31fff142f112 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:37:34.543746 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 667/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:37:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:37:37.330081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bb3ef-d382-4bad-89a0-9719ab945757 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:37.330610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bb3ef-d382-4bad-89a0-9719ab945757 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:37.330719 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bb3ef-d382-4bad-89a0-9719ab945757 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:37.332008 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 665/1332] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:37:37.337392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110caee-cbc9-4344-bc88-aadff05769a8 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:37.337821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110caee-cbc9-4344-bc88-aadff05769a8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:37.337949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110caee-cbc9-4344-bc88-aadff05769a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:37.400720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:37.403321 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6110caee-cbc9-4344-bc88-aadff05769a8 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:37:37.404527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6110caee-cbc9-4344-bc88-aadff05769a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:37.504848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 668/1333] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:37:37.540662 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bb3ef-d382-4bad-89a0-9719ab945757 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:37:37.542254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-331bb3ef-d382-4bad-89a0-9719ab945757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:37.648885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bb3ef-d382-4bad-89a0-9719ab945757 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:37:37.722959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd30340-47f3-4a90-9f99-a6c8931ffe5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:37:37.723613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd30340-47f3-4a90-9f99-a6c8931ffe5d service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:37.723896 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd30340-47f3-4a90-9f99-a6c8931ffe5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:37.724174 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd30340-47f3-4a90-9f99-a6c8931ffe5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:37.725847 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-5cd30340-47f3-4a90-9f99-a6c8931ffe5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:37.752183 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:37.838914 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd30340-47f3-4a90-9f99-a6c8931ffe5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:37:37.840373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd30340-47f3-4a90-9f99-a6c8931ffe5d service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:37:37.860461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 666/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:37:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:37:40.153560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd19a65-a6b5-4594-b65d-624c38d0d08a None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:40.154010 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd19a65-a6b5-4594-b65d-624c38d0d08a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:40.154103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd19a65-a6b5-4594-b65d-624c38d0d08a None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:40.155592 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 669/1335] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:37:40.160716 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eda683-f381-4178-abcb-86105cb39d41 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:40.161207 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eda683-f381-4178-abcb-86105cb39d41 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:40.161304 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eda683-f381-4178-abcb-86105cb39d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:40.225962 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-f1eda683-f381-4178-abcb-86105cb39d41 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:37:40.227430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f1eda683-f381-4178-abcb-86105cb39d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:40.302283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:40.324085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 667/1336] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:37:40.364472 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd19a65-a6b5-4594-b65d-624c38d0d08a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:37:40.366020 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fcd19a65-a6b5-4594-b65d-624c38d0d08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:40.470757 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd19a65-a6b5-4594-b65d-624c38d0d08a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:37:40.501317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:40.547293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58022a59-a7ae-4f26-ae2e-efdc209e1ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:37:40.547935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58022a59-a7ae-4f26-ae2e-efdc209e1ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:40.548214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58022a59-a7ae-4f26-ae2e-efdc209e1ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:40.548491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58022a59-a7ae-4f26-ae2e-efdc209e1ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:40.550152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-58022a59-a7ae-4f26-ae2e-efdc209e1ce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:40.657836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58022a59-a7ae-4f26-ae2e-efdc209e1ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:37:40.659252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58022a59-a7ae-4f26-ae2e-efdc209e1ce9 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:37:40.677210 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 670/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:37:43.612282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d3675-a6ec-4b7e-b68c-a09c1ac78741 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:43.612920 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d3675-a6ec-4b7e-b68c-a09c1ac78741 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:43.612920 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d3675-a6ec-4b7e-b68c-a09c1ac78741 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:43.614266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 668/1338] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:37:43.619552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecbd16-de8d-4e46-a3a1-f007efa066a3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:43.619984 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecbd16-de8d-4e46-a3a1-f007efa066a3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:43.620086 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecbd16-de8d-4e46-a3a1-f007efa066a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:43.689542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-86ecbd16-de8d-4e46-a3a1-f007efa066a3 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:37:43.690745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-86ecbd16-de8d-4e46-a3a1-f007efa066a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:43.699110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:37:43.793680 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 671/1339] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:37:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:37:43.830044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d3675-a6ec-4b7e-b68c-a09c1ac78741 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:37:43.832134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-581d3675-a6ec-4b7e-b68c-a09c1ac78741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:43.926629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d3675-a6ec-4b7e-b68c-a09c1ac78741 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:37:43.930204 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2721984-eeb6-4138-9b91-204cdc538c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:37:43.930851 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2721984-eeb6-4138-9b91-204cdc538c17 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:43.931136 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2721984-eeb6-4138-9b91-204cdc538c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:43.931414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2721984-eeb6-4138-9b91-204cdc538c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:43.940823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2721984-eeb6-4138-9b91-204cdc538c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:37:43.942257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2721984-eeb6-4138-9b91-204cdc538c17 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:37:43.951470 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 669/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:37:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:37:48.711281 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf093650-42e9-4492-8142-c13369f19f0d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:48.711891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf093650-42e9-4492-8142-c13369f19f0d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:48.711891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf093650-42e9-4492-8142-c13369f19f0d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:48.713239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 672/1341] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:37:48.719716 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463b04f-3028-445a-9679-5297971d6721 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:48.721695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463b04f-3028-445a-9679-5297971d6721 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:48.721695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463b04f-3028-445a-9679-5297971d6721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:48.750708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-1463b04f-3028-445a-9679-5297971d6721 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:37:48.752060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-1463b04f-3028-445a-9679-5297971d6721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:48.836116 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 670/1342] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:37:48.874869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf093650-42e9-4492-8142-c13369f19f0d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:37:48.885442 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf093650-42e9-4492-8142-c13369f19f0d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:37:48.889013 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7cac9-6774-44c2-a851-543ddc727094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:37:48.890233 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7cac9-6774-44c2-a851-543ddc727094 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:48.890582 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7cac9-6774-44c2-a851-543ddc727094 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:48.890929 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7cac9-6774-44c2-a851-543ddc727094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:48.899906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7cac9-6774-44c2-a851-543ddc727094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:37:48.901379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7cac9-6774-44c2-a851-543ddc727094 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:37:48.911335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 673/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:37:52.232927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd46cf-2568-4894-b076-64bcbe20a5b7 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:52.233494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd46cf-2568-4894-b076-64bcbe20a5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:52.233494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd46cf-2568-4894-b076-64bcbe20a5b7 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:52.235323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 671/1344] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:37:52.240591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f4f20-e805-475f-9c6d-c1605a900525 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:52.241093 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f4f20-e805-475f-9c6d-c1605a900525 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:52.241187 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f4f20-e805-475f-9c6d-c1605a900525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:52.258415 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-062f4f20-e805-475f-9c6d-c1605a900525 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:37:52.259585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-062f4f20-e805-475f-9c6d-c1605a900525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:52.267308 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 674/1345] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:37:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:37:52.304860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd46cf-2568-4894-b076-64bcbe20a5b7 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:37:52.316014 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd46cf-2568-4894-b076-64bcbe20a5b7 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:37:52.319506 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12a525-4d02-43c3-9b8b-f8ac9625af5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:37:52.320139 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12a525-4d02-43c3-9b8b-f8ac9625af5c service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:52.320424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12a525-4d02-43c3-9b8b-f8ac9625af5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:52.320711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12a525-4d02-43c3-9b8b-f8ac9625af5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:52.329992 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12a525-4d02-43c3-9b8b-f8ac9625af5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:37:52.331421 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12a525-4d02-43c3-9b8b-f8ac9625af5c service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:37:52.340636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 672/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:37:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:37:57.127474 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5290a-d551-4c31-b13c-6291c0afee8a None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:57.127953 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5290a-d551-4c31-b13c-6291c0afee8a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:57.128115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5290a-d551-4c31-b13c-6291c0afee8a None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:57.129405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 675/1347] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:37:57.138584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182c154-fa4a-4bc2-9650-7ddda9dced24 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:57.139414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182c154-fa4a-4bc2-9650-7ddda9dced24 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:57.140106 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182c154-fa4a-4bc2-9650-7ddda9dced24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:57.158984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-7182c154-fa4a-4bc2-9650-7ddda9dced24 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:37:57.160294 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7182c154-fa4a-4bc2-9650-7ddda9dced24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:37:57.168173 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 673/1348] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:37:57.207400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5290a-d551-4c31-b13c-6291c0afee8a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:37:57.219285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5290a-d551-4c31-b13c-6291c0afee8a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:37:57.223679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8c646-7162-429d-a992-044e41e1c47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:37:57.224421 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8c646-7162-429d-a992-044e41e1c47d service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:37:57.224777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8c646-7162-429d-a992-044e41e1c47d service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:37:57.225158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8c646-7162-429d-a992-044e41e1c47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:37:57.236089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8c646-7162-429d-a992-044e41e1c47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:37:57.238042 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8c646-7162-429d-a992-044e41e1c47d service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:37:57.249457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 676/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:38:02.776182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82329df2-db25-4e68-8beb-7d446e5e7000 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:02.776686 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82329df2-db25-4e68-8beb-7d446e5e7000 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:02.776767 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82329df2-db25-4e68-8beb-7d446e5e7000 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:02.778128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 674/1350] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jun 1 17:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:02.783900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08135d01-85b1-4092-ba45-78822ab4fe54 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:02.784370 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08135d01-85b1-4092-ba45-78822ab4fe54 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:02.784986 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08135d01-85b1-4092-ba45-78822ab4fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:02.864704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-08135d01-85b1-4092-ba45-78822ab4fe54 None None] MFA Rules not processed for user `ae952b30dffa450e97ce4a73da8d00f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:02.866501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-08135d01-85b1-4092-ba45-78822ab4fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:02.922832 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:38:02.946835 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 677/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jun 1 17:38:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:07.152898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=98 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:38:07.399295 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2700f9-2e8c-4257-bdea-190f9a9cf895 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:07.399638 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2700f9-2e8c-4257-bdea-190f9a9cf895 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:07.399857 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2700f9-2e8c-4257-bdea-190f9a9cf895 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:07.401512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 675/1352] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jun 1 17:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:07.406541 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47a690-815c-4ecc-aaca-b35aade20c32 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:07.407003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47a690-815c-4ecc-aaca-b35aade20c32 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:07.407085 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47a690-815c-4ecc-aaca-b35aade20c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:07.426492 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5f47a690-815c-4ecc-aaca-b35aade20c32 None None] MFA Rules not processed for user `ae952b30dffa450e97ce4a73da8d00f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:07.431490 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5f47a690-815c-4ecc-aaca-b35aade20c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:07.437433 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 678/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jun 1 17:38:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:09.071824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4c7d9-a2a5-4480-8f74-228b672347c3 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:09.072409 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4c7d9-a2a5-4480-8f74-228b672347c3 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:09.072409 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4c7d9-a2a5-4480-8f74-228b672347c3 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:09.073810 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 676/1354] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jun 1 17:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:09.079770 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f72b6e-a5c3-4875-9789-06b3b0d23b30 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:09.080314 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f72b6e-a5c3-4875-9789-06b3b0d23b30 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:09.080314 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f72b6e-a5c3-4875-9789-06b3b0d23b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:09.099403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a7f72b6e-a5c3-4875-9789-06b3b0d23b30 None None] MFA Rules not processed for user `ae952b30dffa450e97ce4a73da8d00f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:09.100886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a7f72b6e-a5c3-4875-9789-06b3b0d23b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:09.110398 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 679/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jun 1 17:38:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:38:12.962320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68764cf0-1aaf-4e13-8ef1-df91b2458ff5 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:12.962320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68764cf0-1aaf-4e13-8ef1-df91b2458ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:12.962320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68764cf0-1aaf-4e13-8ef1-df91b2458ff5 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:12.962320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 677/1356] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:12.963086 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e62502-aa18-40ef-8771-10427df5b0ae None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:12.963086 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e62502-aa18-40ef-8771-10427df5b0ae None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:12.963086 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e62502-aa18-40ef-8771-10427df5b0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:12.977230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-81e62502-aa18-40ef-8771-10427df5b0ae None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:12.978429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-81e62502-aa18-40ef-8771-10427df5b0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:12.987170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 680/1357] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:13.046551 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8be990-e07a-478b-8609-3d6103f0a208 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:13.046928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8be990-e07a-478b-8609-3d6103f0a208 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:13.047213 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8be990-e07a-478b-8609-3d6103f0a208 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:13.048641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 678/1358] 10.222.0.33 () {54 vars in 961 bytes} [Wed Jun 1 17:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:13.061233 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d38b6-7fb9-44e8-a7f8-ac2e8904d809 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:13.064914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d38b6-7fb9-44e8-a7f8-ac2e8904d809 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:13.064914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d38b6-7fb9-44e8-a7f8-ac2e8904d809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:13.117955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-740d38b6-7fb9-44e8-a7f8-ac2e8904d809 None None] MFA Rules not processed for user `5d5a5ba6aecd46e79dc7199589384a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:13.121612 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-740d38b6-7fb9-44e8-a7f8-ac2e8904d809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:13.218598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 681/1359] 10.222.0.33 () {58 vars in 1058 bytes} [Wed Jun 1 17:38:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:13.236679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8be990-e07a-478b-8609-3d6103f0a208 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:38:13.254343 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8be990-e07a-478b-8609-3d6103f0a208 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:38:13.260046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b18dca-4b00-4723-9964-3e5addc13c52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:38:13.260692 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b18dca-4b00-4723-9964-3e5addc13c52 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:13.261007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b18dca-4b00-4723-9964-3e5addc13c52 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:13.261295 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b18dca-4b00-4723-9964-3e5addc13c52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:13.270805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b18dca-4b00-4723-9964-3e5addc13c52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:38:13.272425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b18dca-4b00-4723-9964-3e5addc13c52 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:38:13.283640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 679/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:38:15.827998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7074e44-528a-4c57-8ee3-67c116d556da None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:15.828590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7074e44-528a-4c57-8ee3-67c116d556da None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:15.828590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7074e44-528a-4c57-8ee3-67c116d556da None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:15.830185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 682/1361] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:38:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:15.835385 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4e715-ba63-4311-8f86-81f3db29b919 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:15.835802 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4e715-ba63-4311-8f86-81f3db29b919 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:15.835939 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4e715-ba63-4311-8f86-81f3db29b919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:15.854198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-aff4e715-ba63-4311-8f86-81f3db29b919 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:15.855383 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-aff4e715-ba63-4311-8f86-81f3db29b919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:15.863984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 680/1362] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:15.909965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7074e44-528a-4c57-8ee3-67c116d556da None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:38:15.925285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7074e44-528a-4c57-8ee3-67c116d556da None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:38:15.932037 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef9073-c699-4b8f-8fe7-6d9a5685f164 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:38:15.932718 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef9073-c699-4b8f-8fe7-6d9a5685f164 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:15.933121 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef9073-c699-4b8f-8fe7-6d9a5685f164 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:15.933594 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef9073-c699-4b8f-8fe7-6d9a5685f164 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:15.945118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef9073-c699-4b8f-8fe7-6d9a5685f164 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:38:15.946809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef9073-c699-4b8f-8fe7-6d9a5685f164 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:38:15.959107 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 683/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:38:18.840810 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c3ebd-2733-4b42-ba55-9044474287d0 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:18.841387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c3ebd-2733-4b42-ba55-9044474287d0 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:18.841387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c3ebd-2733-4b42-ba55-9044474287d0 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:18.843514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 681/1364] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:38:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:18.848675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236bcef-9411-4f00-a8d9-222d002cd203 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:18.849100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236bcef-9411-4f00-a8d9-222d002cd203 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:18.849283 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236bcef-9411-4f00-a8d9-222d002cd203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:18.867160 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e236bcef-9411-4f00-a8d9-222d002cd203 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:18.868358 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e236bcef-9411-4f00-a8d9-222d002cd203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:18.876229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 684/1365] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:18.925580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b49f15-feb4-4933-84a2-e30ca1258d10 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:18.925872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b49f15-feb4-4933-84a2-e30ca1258d10 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:18.926148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b49f15-feb4-4933-84a2-e30ca1258d10 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:18.927503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 682/1366] 10.222.0.33 () {54 vars in 961 bytes} [Wed Jun 1 17:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:18.932710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3b15c-7c77-4b2e-97b9-161fb32ea244 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:18.933033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3b15c-7c77-4b2e-97b9-161fb32ea244 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:18.934968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3b15c-7c77-4b2e-97b9-161fb32ea244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:18.953827 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-15b3b15c-7c77-4b2e-97b9-161fb32ea244 None None] MFA Rules not processed for user `5d5a5ba6aecd46e79dc7199589384a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:18.955075 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-15b3b15c-7c77-4b2e-97b9-161fb32ea244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:18.964476 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 685/1367] 10.222.0.33 () {58 vars in 1058 bytes} [Wed Jun 1 17:38:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:38:18.973470 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b49f15-feb4-4933-84a2-e30ca1258d10 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:38:18.988240 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b49f15-feb4-4933-84a2-e30ca1258d10 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:38:18.993838 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f584a-dc09-4d9d-9d89-bd408e2e1516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:38:18.994483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f584a-dc09-4d9d-9d89-bd408e2e1516 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:18.994769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f584a-dc09-4d9d-9d89-bd408e2e1516 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:18.995046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f584a-dc09-4d9d-9d89-bd408e2e1516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:19.003383 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f584a-dc09-4d9d-9d89-bd408e2e1516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:38:19.004979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f584a-dc09-4d9d-9d89-bd408e2e1516 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:38:19.015163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 683/1368] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:38:21.479887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc7d92-5e4b-4f85-83ab-e0258f813e71 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:21.481247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc7d92-5e4b-4f85-83ab-e0258f813e71 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:21.481527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc7d92-5e4b-4f85-83ab-e0258f813e71 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:21.483876 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 686/1369] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:38:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:21.489190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dee8af-fc41-459d-a98b-9725a61ecd4c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:21.489621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dee8af-fc41-459d-a98b-9725a61ecd4c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:21.490077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dee8af-fc41-459d-a98b-9725a61ecd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:21.509781 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-51dee8af-fc41-459d-a98b-9725a61ecd4c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:21.511051 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-51dee8af-fc41-459d-a98b-9725a61ecd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:21.519816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 684/1370] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:21.566991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a4e7d-4893-4246-a0d1-baa8910f53c5 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:21.567280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a4e7d-4893-4246-a0d1-baa8910f53c5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:21.567766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a4e7d-4893-4246-a0d1-baa8910f53c5 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:21.569313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 687/1371] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:21.574516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd60eec-ab72-4e16-8d69-60bf71717e0a None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:21.574810 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd60eec-ab72-4e16-8d69-60bf71717e0a None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:21.575088 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd60eec-ab72-4e16-8d69-60bf71717e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:21.593989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-5bd60eec-ab72-4e16-8d69-60bf71717e0a None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:21.595196 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-5bd60eec-ab72-4e16-8d69-60bf71717e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:21.603576 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 685/1372] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:21.649808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a4e7d-4893-4246-a0d1-baa8910f53c5 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:38:21.665644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a4e7d-4893-4246-a0d1-baa8910f53c5 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:38:21.673346 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c02195-a797-4e0d-b68a-436face954af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:38:21.674008 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c02195-a797-4e0d-b68a-436face954af service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:21.674296 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c02195-a797-4e0d-b68a-436face954af service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:21.674573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c02195-a797-4e0d-b68a-436face954af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:21.683779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c02195-a797-4e0d-b68a-436face954af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:38:21.693945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c02195-a797-4e0d-b68a-436face954af service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:38:21.696329 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 688/1373] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:38:21.837045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f250db-72f1-4188-837d-b6b908125c0e None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:21.837369 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f250db-72f1-4188-837d-b6b908125c0e None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:21.840710 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f250db-72f1-4188-837d-b6b908125c0e None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:21.840710 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 686/1374] 10.222.0.33 () {54 vars in 963 bytes} [Wed Jun 1 17:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:21.845016 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fc03b-5eb4-4f3e-98e3-ad9feaf348f3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:21.845362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fc03b-5eb4-4f3e-98e3-ad9feaf348f3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:21.845761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fc03b-5eb4-4f3e-98e3-ad9feaf348f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:21.911269 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5e3fc03b-5eb4-4f3e-98e3-ad9feaf348f3 None None] MFA Rules not processed for user `98d9e5912b8c4f36922cde62830fb7ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:21.912814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5e3fc03b-5eb4-4f3e-98e3-ad9feaf348f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:21.924958 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:38:21.986241 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 689/1375] 10.222.0.33 () {58 vars in 1060 bytes} [Wed Jun 1 17:38:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:21.995472 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f250db-72f1-4188-837d-b6b908125c0e None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:38:22.008045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f250db-72f1-4188-837d-b6b908125c0e None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:38:22.011768 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2020c-65cd-46d4-996a-4e125f55b1e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:38:22.012694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2020c-65cd-46d4-996a-4e125f55b1e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:22.013009 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2020c-65cd-46d4-996a-4e125f55b1e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:22.013290 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2020c-65cd-46d4-996a-4e125f55b1e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:22.024501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2020c-65cd-46d4-996a-4e125f55b1e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:38:22.026093 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2020c-65cd-46d4-996a-4e125f55b1e4 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:38:22.037938 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 687/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:38:24.159417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff75ca-1b83-4927-b534-38e690df59d1 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:24.159973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff75ca-1b83-4927-b534-38e690df59d1 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:24.159973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff75ca-1b83-4927-b534-38e690df59d1 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:24.161398 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 690/1377] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:24.167273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c31292-070a-4dd6-91d3-56ba0f57c106 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:24.167823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c31292-070a-4dd6-91d3-56ba0f57c106 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:24.167823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c31292-070a-4dd6-91d3-56ba0f57c106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:24.187238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-99c31292-070a-4dd6-91d3-56ba0f57c106 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:24.188435 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-99c31292-070a-4dd6-91d3-56ba0f57c106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:24.196611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 688/1378] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:24.241510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff75ca-1b83-4927-b534-38e690df59d1 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:38:24.257445 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff75ca-1b83-4927-b534-38e690df59d1 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:38:24.263173 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723c9c9-0d95-4996-a544-1adbe3eaae39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:38:24.263968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723c9c9-0d95-4996-a544-1adbe3eaae39 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:24.264255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723c9c9-0d95-4996-a544-1adbe3eaae39 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:24.264531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723c9c9-0d95-4996-a544-1adbe3eaae39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:24.273365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723c9c9-0d95-4996-a544-1adbe3eaae39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:38:24.275212 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723c9c9-0d95-4996-a544-1adbe3eaae39 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:38:24.285492 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 691/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:38:26.831280 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5c1c2-56bf-4727-afa0-9f3d56b2ac96 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:26.831847 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5c1c2-56bf-4727-afa0-9f3d56b2ac96 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:26.831847 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5c1c2-56bf-4727-afa0-9f3d56b2ac96 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:26.833242 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 689/1380] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:26.838594 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a68b4-a60a-4a49-b570-4d60c20dfbd5 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:26.839379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a68b4-a60a-4a49-b570-4d60c20dfbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:26.839676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a68b4-a60a-4a49-b570-4d60c20dfbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:26.859384 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6c2a68b4-a60a-4a49-b570-4d60c20dfbd5 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:26.860560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6c2a68b4-a60a-4a49-b570-4d60c20dfbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:26.868456 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 692/1381] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:26.911571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5c1c2-56bf-4727-afa0-9f3d56b2ac96 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:38:26.927834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5c1c2-56bf-4727-afa0-9f3d56b2ac96 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:38:26.933813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d44fe-20e3-4fbf-a064-7fc3cc48995d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:38:26.934566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d44fe-20e3-4fbf-a064-7fc3cc48995d service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:26.934980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d44fe-20e3-4fbf-a064-7fc3cc48995d service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:26.935350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d44fe-20e3-4fbf-a064-7fc3cc48995d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:26.944440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d44fe-20e3-4fbf-a064-7fc3cc48995d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:38:26.946240 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d44fe-20e3-4fbf-a064-7fc3cc48995d service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:38:26.957398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 690/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:38:29.568095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054beee1-717d-4c0b-b12d-30fdab4d92d7 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:29.568677 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054beee1-717d-4c0b-b12d-30fdab4d92d7 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:29.568677 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054beee1-717d-4c0b-b12d-30fdab4d92d7 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:29.570070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 693/1383] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:29.575462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9004ab2-e081-4854-ac88-c46ca04ef0d9 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:29.575875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9004ab2-e081-4854-ac88-c46ca04ef0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:29.576026 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9004ab2-e081-4854-ac88-c46ca04ef0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:29.594604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b9004ab2-e081-4854-ac88-c46ca04ef0d9 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:29.595807 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b9004ab2-e081-4854-ac88-c46ca04ef0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:29.604592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 691/1384] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:29.648234 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054beee1-717d-4c0b-b12d-30fdab4d92d7 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:38:29.663329 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054beee1-717d-4c0b-b12d-30fdab4d92d7 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:38:29.669073 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449cb9e-98c1-4094-aa97-5dde11a60441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:38:29.669798 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449cb9e-98c1-4094-aa97-5dde11a60441 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:29.670156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449cb9e-98c1-4094-aa97-5dde11a60441 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:29.670506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449cb9e-98c1-4094-aa97-5dde11a60441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:29.680263 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449cb9e-98c1-4094-aa97-5dde11a60441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:38:29.682069 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449cb9e-98c1-4094-aa97-5dde11a60441 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:38:29.692758 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 694/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:38:32.402386 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54853ce8-4be7-48ef-a5ca-588da5e7d90d None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:32.403102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54853ce8-4be7-48ef-a5ca-588da5e7d90d None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:32.403102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54853ce8-4be7-48ef-a5ca-588da5e7d90d None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:32.405168 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 692/1386] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:32.410759 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd2d3c-e77c-475d-932c-db4abd73fe0a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:32.411317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd2d3c-e77c-475d-932c-db4abd73fe0a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:32.411317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd2d3c-e77c-475d-932c-db4abd73fe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:32.431402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-55cd2d3c-e77c-475d-932c-db4abd73fe0a None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:32.432685 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-55cd2d3c-e77c-475d-932c-db4abd73fe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:32.441728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 695/1387] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:32.490334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54853ce8-4be7-48ef-a5ca-588da5e7d90d None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:38:32.522510 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54853ce8-4be7-48ef-a5ca-588da5e7d90d None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:38:32.529922 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198a49e-3abf-4d76-b50f-1141e2a3c810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:38:32.530695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198a49e-3abf-4d76-b50f-1141e2a3c810 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:32.531000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198a49e-3abf-4d76-b50f-1141e2a3c810 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:32.531281 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198a49e-3abf-4d76-b50f-1141e2a3c810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:32.543388 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198a49e-3abf-4d76-b50f-1141e2a3c810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:38:32.545010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198a49e-3abf-4d76-b50f-1141e2a3c810 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:38:32.557266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 693/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:38:35.121551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a598117-d803-4abc-a256-b067143949e8 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:35.122143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a598117-d803-4abc-a256-b067143949e8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:35.122143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a598117-d803-4abc-a256-b067143949e8 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:35.123735 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 696/1389] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:35.129280 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3230fe-33ce-4100-918c-9d918c1ae3f9 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:35.129705 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3230fe-33ce-4100-918c-9d918c1ae3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:35.129886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3230fe-33ce-4100-918c-9d918c1ae3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:35.148379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-ee3230fe-33ce-4100-918c-9d918c1ae3f9 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:35.149618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ee3230fe-33ce-4100-918c-9d918c1ae3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:35.158196 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 694/1390] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:35.206106 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a598117-d803-4abc-a256-b067143949e8 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:38:35.221719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a598117-d803-4abc-a256-b067143949e8 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:38:35.227673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061b20c-64e6-49eb-84fa-85f991ad79e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:38:35.228350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061b20c-64e6-49eb-84fa-85f991ad79e5 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:35.228645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061b20c-64e6-49eb-84fa-85f991ad79e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:35.228955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061b20c-64e6-49eb-84fa-85f991ad79e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:35.238308 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061b20c-64e6-49eb-84fa-85f991ad79e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:38:35.239899 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061b20c-64e6-49eb-84fa-85f991ad79e5 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:38:35.249659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 697/1391] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:38:37.762684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74f054-3033-4172-9eeb-34fbf8ede906 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:37.763262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74f054-3033-4172-9eeb-34fbf8ede906 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:37.763262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74f054-3033-4172-9eeb-34fbf8ede906 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:37.765333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 695/1392] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:37.770467 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa5891-48eb-44a3-9f35-118531161bca None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:37.770925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa5891-48eb-44a3-9f35-118531161bca None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:37.771041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa5891-48eb-44a3-9f35-118531161bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:37.789404 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e3fa5891-48eb-44a3-9f35-118531161bca None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:37.790588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e3fa5891-48eb-44a3-9f35-118531161bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:37.798688 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 698/1393] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:37.843155 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74f054-3033-4172-9eeb-34fbf8ede906 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:38:37.851393 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=49 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:38:37.857884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74f054-3033-4172-9eeb-34fbf8ede906 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:38:37.863175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df0ba8-ec10-4889-8f61-c44107152b7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:38:37.866898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df0ba8-ec10-4889-8f61-c44107152b7e service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:37.866898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df0ba8-ec10-4889-8f61-c44107152b7e service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:37.866898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df0ba8-ec10-4889-8f61-c44107152b7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:37.872400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df0ba8-ec10-4889-8f61-c44107152b7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:38:37.874017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df0ba8-ec10-4889-8f61-c44107152b7e service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:38:37.883481 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 696/1394] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:38:38.557693 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c4a5f-c984-43c0-b33e-48034f8d9478 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:38.558082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c4a5f-c984-43c0-b33e-48034f8d9478 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:38.558364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c4a5f-c984-43c0-b33e-48034f8d9478 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:38.559765 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 699/1395] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:38.565721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4273e2-8d58-4d63-b1c8-eb6c60ce8692 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:38.566116 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4273e2-8d58-4d63-b1c8-eb6c60ce8692 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:38.566468 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4273e2-8d58-4d63-b1c8-eb6c60ce8692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:38.585080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-3b4273e2-8d58-4d63-b1c8-eb6c60ce8692 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:38.586260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3b4273e2-8d58-4d63-b1c8-eb6c60ce8692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:38.594643 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 697/1396] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:38.651238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5b99-8ec4-45fd-906c-709a2a3cb564 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:38.651522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5b99-8ec4-45fd-906c-709a2a3cb564 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:38.651821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5b99-8ec4-45fd-906c-709a2a3cb564 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:38.653295 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 700/1397] 10.222.0.33 () {54 vars in 962 bytes} [Wed Jun 1 17:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:38.659222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11530642-2657-4d99-ac40-8c5c5857fc5b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:38.659593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11530642-2657-4d99-ac40-8c5c5857fc5b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:38.659976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11530642-2657-4d99-ac40-8c5c5857fc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:38.720606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-11530642-2657-4d99-ac40-8c5c5857fc5b None None] MFA Rules not processed for user `b34d05889f3c4d469f4661061457cb95`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:38.722094 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-11530642-2657-4d99-ac40-8c5c5857fc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:38.794280 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 698/1398] 10.222.0.33 () {58 vars in 1059 bytes} [Wed Jun 1 17:38:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:38.802129 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c5b99-8ec4-45fd-906c-709a2a3cb564 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:38:38.813931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c5b99-8ec4-45fd-906c-709a2a3cb564 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:38:38.818100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683c096-447d-440e-b5c7-e840623b9767 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b34d05889f3c4d469f4661061457cb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:38:38.820865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683c096-447d-440e-b5c7-e840623b9767 service glance] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:38.820865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683c096-447d-440e-b5c7-e840623b9767 service glance] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:38.820865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683c096-447d-440e-b5c7-e840623b9767 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:38.829762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683c096-447d-440e-b5c7-e840623b9767 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:38:38.831237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683c096-447d-440e-b5c7-e840623b9767 service glance] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:38:38.843432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 701/1399] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:38:39.565737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc69035-46d3-482c-8d15-b8da467ce814 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:39.566031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc69035-46d3-482c-8d15-b8da467ce814 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:39.566306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc69035-46d3-482c-8d15-b8da467ce814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:39.614741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-efc69035-46d3-482c-8d15-b8da467ce814 None None] MFA Rules not processed for user `253f9ffb48dd4eaab87aae5316fb5394`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:39.615925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-efc69035-46d3-482c-8d15-b8da467ce814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:39.681396 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 699/1400] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jun 1 17:38:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:39.727242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6efeb0-8d8d-4f97-84e3-5a1ab7ea48ab None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:39.727606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6efeb0-8d8d-4f97-84e3-5a1ab7ea48ab None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:39.728047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6efeb0-8d8d-4f97-84e3-5a1ab7ea48ab None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:39.729593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 702/1401] 10.222.0.33 () {54 vars in 942 bytes} [Wed Jun 1 17:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:39.736063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcd194-3340-4524-a6dc-84881256f399 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:39.736358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcd194-3340-4524-a6dc-84881256f399 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:39.736642 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcd194-3340-4524-a6dc-84881256f399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:39.784373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:38:39.787883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-97fcd194-3340-4524-a6dc-84881256f399 None None] MFA Rules not processed for user `3f43a4bb5a18445b8836f4613cd5e14b`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:39.789141 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-97fcd194-3340-4524-a6dc-84881256f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:39.863935 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 700/1402] 10.222.0.33 () {58 vars in 1039 bytes} [Wed Jun 1 17:38:39 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:39.871461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6efeb0-8d8d-4f97-84e3-5a1ab7ea48ab None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:38:39.886319 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6efeb0-8d8d-4f97-84e3-5a1ab7ea48ab None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:38:39.891732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac26f3d-2ba3-47c1-a55e-ab1e6d10f99b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f43a4bb5a18445b8836f4613cd5e14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:38:39.892384 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac26f3d-2ba3-47c1-a55e-ab1e6d10f99b service swift] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:39.892666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac26f3d-2ba3-47c1-a55e-ab1e6d10f99b service swift] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:39.893063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac26f3d-2ba3-47c1-a55e-ab1e6d10f99b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:39.901521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac26f3d-2ba3-47c1-a55e-ab1e6d10f99b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:38:39.903095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac26f3d-2ba3-47c1-a55e-ab1e6d10f99b service swift] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:38:39.911843 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 703/1403] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jun 1 17:38:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 17:38:40.485165 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3943539-07f0-4a6f-ad04-2a0bb9a53820 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:40.485783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3943539-07f0-4a6f-ad04-2a0bb9a53820 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:40.486254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3943539-07f0-4a6f-ad04-2a0bb9a53820 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:40.488635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 701/1404] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:40.493290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe6caf-0fa7-4312-afaf-1f65616b2198 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:40.493574 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe6caf-0fa7-4312-afaf-1f65616b2198 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:40.493854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe6caf-0fa7-4312-afaf-1f65616b2198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:40.513056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-effe6caf-0fa7-4312-afaf-1f65616b2198 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:40.514389 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-effe6caf-0fa7-4312-afaf-1f65616b2198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:40.524872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 704/1405] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:40.570986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3943539-07f0-4a6f-ad04-2a0bb9a53820 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:38:40.588082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3943539-07f0-4a6f-ad04-2a0bb9a53820 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:38:40.595011 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156629c0-19ed-4ac8-9413-e1c243dec0aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:38:40.595774 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156629c0-19ed-4ac8-9413-e1c243dec0aa service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:40.596140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156629c0-19ed-4ac8-9413-e1c243dec0aa service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:40.596480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156629c0-19ed-4ac8-9413-e1c243dec0aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:40.606310 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156629c0-19ed-4ac8-9413-e1c243dec0aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:38:40.609618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156629c0-19ed-4ac8-9413-e1c243dec0aa service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:38:40.619477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 702/1406] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:38:43.187391 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93261a-142f-42ad-b44b-b228c8441c2f None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:43.188406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93261a-142f-42ad-b44b-b228c8441c2f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:43.188841 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93261a-142f-42ad-b44b-b228c8441c2f None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:43.190521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 705/1407] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:38:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:38:43.195899 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cea955-bc48-4173-9c94-2295b3ae892a None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:43.196361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cea955-bc48-4173-9c94-2295b3ae892a None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:43.196462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cea955-bc48-4173-9c94-2295b3ae892a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:43.216672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-57cea955-bc48-4173-9c94-2295b3ae892a None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:38:43.219886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-57cea955-bc48-4173-9c94-2295b3ae892a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:38:43.237322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 703/1408] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:38:43.279100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93261a-142f-42ad-b44b-b228c8441c2f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:38:43.311483 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93261a-142f-42ad-b44b-b228c8441c2f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:38:43.321623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08de1d-89ed-466c-9fe5-7a25fda7cb21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:38:43.322558 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08de1d-89ed-466c-9fe5-7a25fda7cb21 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:38:43.322848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08de1d-89ed-466c-9fe5-7a25fda7cb21 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:38:43.323127 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08de1d-89ed-466c-9fe5-7a25fda7cb21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:38:43.333607 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08de1d-89ed-466c-9fe5-7a25fda7cb21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:38:43.335213 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08de1d-89ed-466c-9fe5-7a25fda7cb21 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:38:43.347114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 706/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:38:53.211071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=39 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:38:53.341328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=68 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:39:04.973720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf7fe2-7030-4cc7-ac72-176fce4d0e50 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:04.974567 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf7fe2-7030-4cc7-ac72-176fce4d0e50 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:04.974567 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf7fe2-7030-4cc7-ac72-176fce4d0e50 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:04.975902 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 704/1410] 10.222.0.33 () {54 vars in 918 bytes} [Wed Jun 1 17:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:04.981064 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29460ceb-2427-40c8-9ebe-a006ef4a2387 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:04.981469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29460ceb-2427-40c8-9ebe-a006ef4a2387 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:04.981625 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29460ceb-2427-40c8-9ebe-a006ef4a2387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:05.000152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-29460ceb-2427-40c8-9ebe-a006ef4a2387 None None] MFA Rules not processed for user `ae952b30dffa450e97ce4a73da8d00f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:05.002311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-29460ceb-2427-40c8-9ebe-a006ef4a2387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:05.009909 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 707/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Wed Jun 1 17:39:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:05.024631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617655e-0cb4-46f1-a8b4-47789914599f None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:05.024924 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617655e-0cb4-46f1-a8b4-47789914599f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:05.025253 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617655e-0cb4-46f1-a8b4-47789914599f None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:05.026605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 705/1412] 10.222.0.33 () {54 vars in 918 bytes} [Wed Jun 1 17:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:05.031752 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70249392-1be4-46c9-a795-a77d822af194 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:05.032042 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70249392-1be4-46c9-a795-a77d822af194 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:05.032365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70249392-1be4-46c9-a795-a77d822af194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:05.050875 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-70249392-1be4-46c9-a795-a77d822af194 None None] MFA Rules not processed for user `5d5a5ba6aecd46e79dc7199589384a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:05.052098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-70249392-1be4-46c9-a795-a77d822af194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:05.061129 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 708/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Wed Jun 1 17:39:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:07.785485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e036f55-cddf-4a6f-adb4-715ba905533f None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:07.786043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e036f55-cddf-4a6f-adb4-715ba905533f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:07.786043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e036f55-cddf-4a6f-adb4-715ba905533f None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:07.787403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 17:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:07.792599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d92f7-13a5-453e-a2f4-fe1de6e066dc None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:07.793059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d92f7-13a5-453e-a2f4-fe1de6e066dc None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:07.793200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d92f7-13a5-453e-a2f4-fe1de6e066dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:07.811729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-4a4d92f7-13a5-453e-a2f4-fe1de6e066dc None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:07.812910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4a4d92f7-13a5-453e-a2f4-fe1de6e066dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:07.820515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 17:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:39:07.862842 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e036f55-cddf-4a6f-adb4-715ba905533f None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:07.878180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e036f55-cddf-4a6f-adb4-715ba905533f None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:07.883475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2beff1-c2cc-4585-b4e5-b1d782370854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:07.884119 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2beff1-c2cc-4585-b4e5-b1d782370854 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:07.884404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2beff1-c2cc-4585-b4e5-b1d782370854 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:07.884683 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2beff1-c2cc-4585-b4e5-b1d782370854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:07.893219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2beff1-c2cc-4585-b4e5-b1d782370854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:07.894805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2beff1-c2cc-4585-b4e5-b1d782370854 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:07.904420 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 707/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:08.891008 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ed656-1474-4c75-a16f-15d59aeaf079 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:08.891611 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ed656-1474-4c75-a16f-15d59aeaf079 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:08.891611 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ed656-1474-4c75-a16f-15d59aeaf079 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:08.892973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 17:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:08.897809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cbcb7-417b-4fc4-8173-596c4f84badd None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:08.898211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cbcb7-417b-4fc4-8173-596c4f84badd None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:08.898374 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cbcb7-417b-4fc4-8173-596c4f84badd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:08.916707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-2f0cbcb7-417b-4fc4-8173-596c4f84badd None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:08.917935 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-2f0cbcb7-417b-4fc4-8173-596c4f84badd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:08.926447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 17:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:09.083167 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ed656-1474-4c75-a16f-15d59aeaf079 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:09.097847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ed656-1474-4c75-a16f-15d59aeaf079 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:09.103577 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32f65d-ab18-4081-82c9-80492f51bdff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:09.104221 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32f65d-ab18-4081-82c9-80492f51bdff service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:09.104508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32f65d-ab18-4081-82c9-80492f51bdff service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:09.104789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32f65d-ab18-4081-82c9-80492f51bdff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:09.112909 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32f65d-ab18-4081-82c9-80492f51bdff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:09.114565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32f65d-ab18-4081-82c9-80492f51bdff service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:09.123854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 711/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:10.058304 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4aef4e-b06a-41af-94fe-0e661f4a813d None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:10.058888 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4aef4e-b06a-41af-94fe-0e661f4a813d None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:10.059006 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4aef4e-b06a-41af-94fe-0e661f4a813d None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:10.061079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 17:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:10.065723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da534b-c434-4153-ad89-7bf3b7bab71a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:10.066129 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da534b-c434-4153-ad89-7bf3b7bab71a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:10.066277 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da534b-c434-4153-ad89-7bf3b7bab71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:10.084338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f8da534b-c434-4153-ad89-7bf3b7bab71a None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:10.085555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f8da534b-c434-4153-ad89-7bf3b7bab71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:10.093996 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 17:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:10.244240 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4aef4e-b06a-41af-94fe-0e661f4a813d None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:10.258928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4aef4e-b06a-41af-94fe-0e661f4a813d None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:10.265448 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf549b1d-e003-4d62-8efd-8301ecb263da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:10.273707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf549b1d-e003-4d62-8efd-8301ecb263da service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:10.273707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf549b1d-e003-4d62-8efd-8301ecb263da service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:10.273707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf549b1d-e003-4d62-8efd-8301ecb263da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:10.275030 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf549b1d-e003-4d62-8efd-8301ecb263da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:10.276690 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf549b1d-e003-4d62-8efd-8301ecb263da service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:10.286652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 710/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:11.205794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50142a98-a892-4666-9ca2-23d3bc732961 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:11.206348 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50142a98-a892-4666-9ca2-23d3bc732961 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:11.206348 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50142a98-a892-4666-9ca2-23d3bc732961 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:11.207760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 17:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:39:11.212871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde5f21-3f8c-46e0-a786-46ec94a34597 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:11.213345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde5f21-3f8c-46e0-a786-46ec94a34597 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:11.213445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde5f21-3f8c-46e0-a786-46ec94a34597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:11.232746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-7fde5f21-3f8c-46e0-a786-46ec94a34597 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:11.233979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7fde5f21-3f8c-46e0-a786-46ec94a34597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:11.241683 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 17:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:11.390737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50142a98-a892-4666-9ca2-23d3bc732961 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:11.405799 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50142a98-a892-4666-9ca2-23d3bc732961 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:11.411167 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c8888-dde4-4efa-a6f6-e5093fde3ab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:11.411890 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c8888-dde4-4efa-a6f6-e5093fde3ab6 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:11.412176 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c8888-dde4-4efa-a6f6-e5093fde3ab6 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:11.412451 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c8888-dde4-4efa-a6f6-e5093fde3ab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:11.420699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c8888-dde4-4efa-a6f6-e5093fde3ab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:11.422369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c8888-dde4-4efa-a6f6-e5093fde3ab6 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:11.432157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 714/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:39:12.362510 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacb273-7875-40c0-9022-2c426584fecf None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:12.363029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacb273-7875-40c0-9022-2c426584fecf None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:12.363029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacb273-7875-40c0-9022-2c426584fecf None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:12.364423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 17:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:12.369443 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f1709-4e1b-463b-b52f-2a1765607433 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:12.369867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f1709-4e1b-463b-b52f-2a1765607433 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:12.370003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f1709-4e1b-463b-b52f-2a1765607433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:12.389239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-593f1709-4e1b-463b-b52f-2a1765607433 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:12.390439 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-593f1709-4e1b-463b-b52f-2a1765607433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:12.398151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 17:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:12.547834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacb273-7875-40c0-9022-2c426584fecf None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:12.562298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacb273-7875-40c0-9022-2c426584fecf None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:12.567554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eb4ec-f8df-4669-859e-8c01bd01fa7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:12.568186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb4ec-f8df-4669-859e-8c01bd01fa7d service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:12.568469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb4ec-f8df-4669-859e-8c01bd01fa7d service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:12.568741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eb4ec-f8df-4669-859e-8c01bd01fa7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:12.577935 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42eb4ec-f8df-4669-859e-8c01bd01fa7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:12.579510 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42eb4ec-f8df-4669-859e-8c01bd01fa7d service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:12.588800 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 713/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:13.551190 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7417571-6e6c-4541-ad43-9f606714365a None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:13.551781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7417571-6e6c-4541-ad43-9f606714365a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:13.551781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7417571-6e6c-4541-ad43-9f606714365a None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:13.553155 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 17:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:13.558187 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f8cb0-33b0-4e41-b76c-2a4aeec931e7 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:13.558618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f8cb0-33b0-4e41-b76c-2a4aeec931e7 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:13.558731 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f8cb0-33b0-4e41-b76c-2a4aeec931e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:13.579118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-113f8cb0-33b0-4e41-b76c-2a4aeec931e7 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:13.580326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-113f8cb0-33b0-4e41-b76c-2a4aeec931e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:13.588071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 17:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:39:13.747797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7417571-6e6c-4541-ad43-9f606714365a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:13.761943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7417571-6e6c-4541-ad43-9f606714365a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:13.767751 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a81ce-2659-4def-81d6-33ad0e373fa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:13.768388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a81ce-2659-4def-81d6-33ad0e373fa1 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:13.768673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a81ce-2659-4def-81d6-33ad0e373fa1 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:13.768974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a81ce-2659-4def-81d6-33ad0e373fa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:13.777140 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a81ce-2659-4def-81d6-33ad0e373fa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:13.778730 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a81ce-2659-4def-81d6-33ad0e373fa1 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:13.789083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 717/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:14.730286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d7f53-9afe-423a-bcfd-f0825448dd87 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:14.730800 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d7f53-9afe-423a-bcfd-f0825448dd87 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:14.730800 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d7f53-9afe-423a-bcfd-f0825448dd87 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:14.732150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 17:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:14.737894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3f0ac-99a4-43c4-856c-335a7da7b639 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:14.738375 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3f0ac-99a4-43c4-856c-335a7da7b639 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:14.738488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3f0ac-99a4-43c4-856c-335a7da7b639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:14.756033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-bff3f0ac-99a4-43c4-856c-335a7da7b639 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:14.757262 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-bff3f0ac-99a4-43c4-856c-335a7da7b639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:14.765011 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 17:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:14.915477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d7f53-9afe-423a-bcfd-f0825448dd87 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:14.930471 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d7f53-9afe-423a-bcfd-f0825448dd87 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:14.935731 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f5497-490d-44ca-908e-b5cef1ba7cea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:14.936436 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5497-490d-44ca-908e-b5cef1ba7cea service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:14.936724 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5497-490d-44ca-908e-b5cef1ba7cea service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:14.937038 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5497-490d-44ca-908e-b5cef1ba7cea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:14.944993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f5497-490d-44ca-908e-b5cef1ba7cea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:14.946569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f5497-490d-44ca-908e-b5cef1ba7cea service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:14.955760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 716/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:15.938947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d20a8-6992-48aa-a4f4-24a81c4f4335 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:15.939529 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d20a8-6992-48aa-a4f4-24a81c4f4335 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:15.939529 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d20a8-6992-48aa-a4f4-24a81c4f4335 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:15.940897 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 17:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:15.945972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c681505-cdc5-4d2d-8ec0-3af42b22f916 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:15.946427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c681505-cdc5-4d2d-8ec0-3af42b22f916 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:15.946605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c681505-cdc5-4d2d-8ec0-3af42b22f916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:15.964495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-8c681505-cdc5-4d2d-8ec0-3af42b22f916 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:15.965718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8c681505-cdc5-4d2d-8ec0-3af42b22f916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:15.973670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 17:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:16.124647 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d20a8-6992-48aa-a4f4-24a81c4f4335 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:16.138794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d20a8-6992-48aa-a4f4-24a81c4f4335 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:16.144175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfd38d-41bb-48eb-b52d-25ed6bac9d99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:16.144816 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfd38d-41bb-48eb-b52d-25ed6bac9d99 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:16.145137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfd38d-41bb-48eb-b52d-25ed6bac9d99 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:16.145421 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfd38d-41bb-48eb-b52d-25ed6bac9d99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:16.153471 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfd38d-41bb-48eb-b52d-25ed6bac9d99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:16.155613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfd38d-41bb-48eb-b52d-25ed6bac9d99 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:16.164912 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 720/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:17.132377 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d76de2-1bb4-4a54-9df5-ba192be53626 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:17.133024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d76de2-1bb4-4a54-9df5-ba192be53626 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:17.133024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d76de2-1bb4-4a54-9df5-ba192be53626 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:17.134364 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 17:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:17.140080 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba6de7-a5ad-4ca7-bbae-bf1e79a59c0c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:17.140469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba6de7-a5ad-4ca7-bbae-bf1e79a59c0c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:17.140624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba6de7-a5ad-4ca7-bbae-bf1e79a59c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:17.158339 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-57ba6de7-a5ad-4ca7-bbae-bf1e79a59c0c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:17.159512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-57ba6de7-a5ad-4ca7-bbae-bf1e79a59c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:17.167186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 17:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:17.322031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d76de2-1bb4-4a54-9df5-ba192be53626 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:17.336538 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d76de2-1bb4-4a54-9df5-ba192be53626 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:17.341840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb6207-bccc-4eff-a726-6daaedc76e35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:17.342592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb6207-bccc-4eff-a726-6daaedc76e35 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:17.342769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb6207-bccc-4eff-a726-6daaedc76e35 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:17.343042 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb6207-bccc-4eff-a726-6daaedc76e35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:17.352005 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb6207-bccc-4eff-a726-6daaedc76e35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:17.353701 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb6207-bccc-4eff-a726-6daaedc76e35 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:17.364167 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 719/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:39:19.553838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad29da2-a4fe-414e-9d78-dfe0120545c6 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:19.554395 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad29da2-a4fe-414e-9d78-dfe0120545c6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:19.554395 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad29da2-a4fe-414e-9d78-dfe0120545c6 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:19.555777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 17:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:19.561748 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0eea5c-e20b-4854-8062-131daa7bbb65 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:19.562180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0eea5c-e20b-4854-8062-131daa7bbb65 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:19.562303 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0eea5c-e20b-4854-8062-131daa7bbb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:19.579513 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-4b0eea5c-e20b-4854-8062-131daa7bbb65 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:19.580688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4b0eea5c-e20b-4854-8062-131daa7bbb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:19.588256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 17:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:19.627217 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad29da2-a4fe-414e-9d78-dfe0120545c6 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:19.637885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad29da2-a4fe-414e-9d78-dfe0120545c6 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:19.644235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71944aff-6af4-4db3-829d-bc75945da2fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:19.644235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71944aff-6af4-4db3-829d-bc75945da2fd service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:19.645083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71944aff-6af4-4db3-829d-bc75945da2fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:19.645083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71944aff-6af4-4db3-829d-bc75945da2fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:19.655194 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71944aff-6af4-4db3-829d-bc75945da2fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:19.657062 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71944aff-6af4-4db3-829d-bc75945da2fd service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:19.666662 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 723/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:22.063646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519ea29-90b8-4eb9-b942-ec4554ad9843 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:22.064191 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519ea29-90b8-4eb9-b942-ec4554ad9843 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:22.064191 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519ea29-90b8-4eb9-b942-ec4554ad9843 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:22.065677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 17:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:22.070982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d82ba0-5719-4d90-a82b-75dd3a8e79c3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:22.071428 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d82ba0-5719-4d90-a82b-75dd3a8e79c3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:22.071568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d82ba0-5719-4d90-a82b-75dd3a8e79c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:22.089990 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-63d82ba0-5719-4d90-a82b-75dd3a8e79c3 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:22.091237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-63d82ba0-5719-4d90-a82b-75dd3a8e79c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:22.100021 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 17:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:22.140049 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519ea29-90b8-4eb9-b942-ec4554ad9843 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:22.150785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519ea29-90b8-4eb9-b942-ec4554ad9843 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:22.154322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37199e5-0c16-4a4d-872f-7275c95db1f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:22.155767 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37199e5-0c16-4a4d-872f-7275c95db1f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:22.156055 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37199e5-0c16-4a4d-872f-7275c95db1f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:22.156332 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37199e5-0c16-4a4d-872f-7275c95db1f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:22.165115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37199e5-0c16-4a4d-872f-7275c95db1f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:22.166545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37199e5-0c16-4a4d-872f-7275c95db1f4 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:22.175941 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 722/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:24.840173 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710d13c-d647-4ece-a415-4925d5f46bf4 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:24.840858 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710d13c-d647-4ece-a415-4925d5f46bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:24.840858 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710d13c-d647-4ece-a415-4925d5f46bf4 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:24.842467 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 17:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:24.847961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988e7c4-a07c-4fe8-b59c-2b6f2cabbea9 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:24.848391 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988e7c4-a07c-4fe8-b59c-2b6f2cabbea9 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:24.848515 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988e7c4-a07c-4fe8-b59c-2b6f2cabbea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:24.866923 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b988e7c4-a07c-4fe8-b59c-2b6f2cabbea9 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:24.868116 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b988e7c4-a07c-4fe8-b59c-2b6f2cabbea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:24.876446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 17:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:24.914406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710d13c-d647-4ece-a415-4925d5f46bf4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:24.925671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710d13c-d647-4ece-a415-4925d5f46bf4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:24.929282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab080c-5e55-4e9e-a36b-4e8b22181fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:24.929913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab080c-5e55-4e9e-a36b-4e8b22181fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:24.930226 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab080c-5e55-4e9e-a36b-4e8b22181fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:24.930525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab080c-5e55-4e9e-a36b-4e8b22181fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:24.940093 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab080c-5e55-4e9e-a36b-4e8b22181fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:24.941549 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab080c-5e55-4e9e-a36b-4e8b22181fa7 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:24.952060 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 726/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:39:27.336453 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8362-5c76-401c-b1cc-1a40d38bba34 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:27.337011 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8362-5c76-401c-b1cc-1a40d38bba34 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:27.337131 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f8362-5c76-401c-b1cc-1a40d38bba34 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:27.338448 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 17:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:27.344629 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90645d-805c-4b93-810c-e9e2357ad44f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:27.345207 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90645d-805c-4b93-810c-e9e2357ad44f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:27.345207 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90645d-805c-4b93-810c-e9e2357ad44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:27.363478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8e90645d-805c-4b93-810c-e9e2357ad44f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:27.364677 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8e90645d-805c-4b93-810c-e9e2357ad44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:27.372454 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 17:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:27.419011 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f8362-5c76-401c-b1cc-1a40d38bba34 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:27.429952 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f8362-5c76-401c-b1cc-1a40d38bba34 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:27.433504 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a8743-68e1-43fe-bb72-7d4956eb6fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:27.434085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a8743-68e1-43fe-bb72-7d4956eb6fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:27.434372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a8743-68e1-43fe-bb72-7d4956eb6fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:27.434651 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a8743-68e1-43fe-bb72-7d4956eb6fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:27.444418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a8743-68e1-43fe-bb72-7d4956eb6fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:27.445999 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a8743-68e1-43fe-bb72-7d4956eb6fa0 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:27.455911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 725/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:29.787240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73d4e1-2896-4a9a-90ba-123cc16dceb3 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:29.787815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73d4e1-2896-4a9a-90ba-123cc16dceb3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:29.787930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73d4e1-2896-4a9a-90ba-123cc16dceb3 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:29.789491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 17:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:29.794726 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3b175-750a-4697-bf64-13c3ef62fb4f None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:29.795926 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3b175-750a-4697-bf64-13c3ef62fb4f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:29.795926 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3b175-750a-4697-bf64-13c3ef62fb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:29.813519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-27d3b175-750a-4697-bf64-13c3ef62fb4f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:29.814746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-27d3b175-750a-4697-bf64-13c3ef62fb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:29.822557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 17:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:29.861796 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73d4e1-2896-4a9a-90ba-123cc16dceb3 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:29.872734 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73d4e1-2896-4a9a-90ba-123cc16dceb3 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:29.876387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed892686-d4f3-45c0-bad1-3c3f91334cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:29.877139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892686-d4f3-45c0-bad1-3c3f91334cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:29.877456 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892686-d4f3-45c0-bad1-3c3f91334cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:29.877739 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed892686-d4f3-45c0-bad1-3c3f91334cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:29.886671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed892686-d4f3-45c0-bad1-3c3f91334cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:29.888107 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed892686-d4f3-45c0-bad1-3c3f91334cc9 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:29.897418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 729/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:32.220466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5d75d-1745-4a3d-847b-34edaeca77ca None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:32.221080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5d75d-1745-4a3d-847b-34edaeca77ca None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:32.221080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5d75d-1745-4a3d-847b-34edaeca77ca None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:32.222489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 17:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:32.228043 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468cf55-6176-4b87-a7c2-5ea50e25a538 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:32.228474 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468cf55-6176-4b87-a7c2-5ea50e25a538 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:32.228605 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468cf55-6176-4b87-a7c2-5ea50e25a538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:32.247494 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-3468cf55-6176-4b87-a7c2-5ea50e25a538 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:32.248997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3468cf55-6176-4b87-a7c2-5ea50e25a538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:32.256789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 17:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:32.296613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5d75d-1745-4a3d-847b-34edaeca77ca None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:32.307306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5d75d-1745-4a3d-847b-34edaeca77ca None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:32.310868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b05ce8-51be-453a-86e6-dc6fffff5088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:32.311504 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b05ce8-51be-453a-86e6-dc6fffff5088 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:32.311789 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b05ce8-51be-453a-86e6-dc6fffff5088 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:32.312065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b05ce8-51be-453a-86e6-dc6fffff5088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:32.320867 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b05ce8-51be-453a-86e6-dc6fffff5088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:32.322336 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b05ce8-51be-453a-86e6-dc6fffff5088 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:32.332352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 728/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:34.638315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b015489-e8b5-4133-83f8-350e4d98b35e None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:34.639057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b015489-e8b5-4133-83f8-350e4d98b35e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:34.639057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b015489-e8b5-4133-83f8-350e4d98b35e None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:34.640239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 17:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:34.645699 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c46d62-d542-44be-a14c-8a27c83de85f None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:34.646108 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c46d62-d542-44be-a14c-8a27c83de85f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:34.646266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c46d62-d542-44be-a14c-8a27c83de85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:34.652470 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=70 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:39:34.664309 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-e1c46d62-d542-44be-a14c-8a27c83de85f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:34.665522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e1c46d62-d542-44be-a14c-8a27c83de85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:34.673862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 17:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:34.711104 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b015489-e8b5-4133-83f8-350e4d98b35e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:34.716575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=73 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:39:34.722462 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b015489-e8b5-4133-83f8-350e4d98b35e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:34.726240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c02de-3dc3-4747-a3e9-df4801f7ac6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:34.726877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c02de-3dc3-4747-a3e9-df4801f7ac6f service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:34.727157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c02de-3dc3-4747-a3e9-df4801f7ac6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:34.727432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c02de-3dc3-4747-a3e9-df4801f7ac6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:34.738236 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c02de-3dc3-4747-a3e9-df4801f7ac6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:34.739606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4c02de-3dc3-4747-a3e9-df4801f7ac6f service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:34.751123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 732/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:37.177155 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eb0e2-d9b7-4184-badc-57d9ad5a6510 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:37.177734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eb0e2-d9b7-4184-badc-57d9ad5a6510 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:37.177734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eb0e2-d9b7-4184-badc-57d9ad5a6510 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:37.179097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 17:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:39:37.184324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529040e-a77c-40ed-a4c1-306084c305ca None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:37.184766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529040e-a77c-40ed-a4c1-306084c305ca None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:37.184885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529040e-a77c-40ed-a4c1-306084c305ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:37.203858 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1529040e-a77c-40ed-a4c1-306084c305ca None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:37.205082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1529040e-a77c-40ed-a4c1-306084c305ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:37.212971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 17:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:37.250458 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eb0e2-d9b7-4184-badc-57d9ad5a6510 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:37.261037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eb0e2-d9b7-4184-badc-57d9ad5a6510 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:37.265157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fda99-6ac1-4195-a941-f60314f3983f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:37.265794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fda99-6ac1-4195-a941-f60314f3983f service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:37.266079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fda99-6ac1-4195-a941-f60314f3983f service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:37.266357 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fda99-6ac1-4195-a941-f60314f3983f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:37.275153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fda99-6ac1-4195-a941-f60314f3983f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:37.276564 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fda99-6ac1-4195-a941-f60314f3983f service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:37.286015 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 731/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:39.552118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89cc9e-2d45-4096-ac65-f8b7ff48d92e None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:39.552664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89cc9e-2d45-4096-ac65-f8b7ff48d92e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:39.552795 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89cc9e-2d45-4096-ac65-f8b7ff48d92e None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:39.554133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 17:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:39.559536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831435d-774a-40de-b5d8-8404b4668551 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:39.559991 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831435d-774a-40de-b5d8-8404b4668551 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:39.560624 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831435d-774a-40de-b5d8-8404b4668551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:39.578987 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-a831435d-774a-40de-b5d8-8404b4668551 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:39.580181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a831435d-774a-40de-b5d8-8404b4668551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:39.587965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 17:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:39.624796 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89cc9e-2d45-4096-ac65-f8b7ff48d92e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:39.635366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89cc9e-2d45-4096-ac65-f8b7ff48d92e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:39.639539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83125e5f-4548-4644-8c41-fe4bdce1945e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:39.640176 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125e5f-4548-4644-8c41-fe4bdce1945e service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:39.640459 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125e5f-4548-4644-8c41-fe4bdce1945e service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:39.640737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83125e5f-4548-4644-8c41-fe4bdce1945e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:39.649543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83125e5f-4548-4644-8c41-fe4bdce1945e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:39.650976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83125e5f-4548-4644-8c41-fe4bdce1945e service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:39.660564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 735/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:41.923543 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5866f-52eb-452c-83fa-095b2d49aac6 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:41.924107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5866f-52eb-452c-83fa-095b2d49aac6 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:41.924107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5866f-52eb-452c-83fa-095b2d49aac6 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:41.925497 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 17:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:39:41.930803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d901e-8fe6-4036-bf02-d52bb37f49fb None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:41.931211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d901e-8fe6-4036-bf02-d52bb37f49fb None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:41.931360 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d901e-8fe6-4036-bf02-d52bb37f49fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:41.948999 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5b6d901e-8fe6-4036-bf02-d52bb37f49fb None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:39:41.950197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5b6d901e-8fe6-4036-bf02-d52bb37f49fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:39:41.958219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 17:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:39:41.996055 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5866f-52eb-452c-83fa-095b2d49aac6 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:39:42.006784 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5866f-52eb-452c-83fa-095b2d49aac6 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:39:42.010335 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025d8a8-b4a4-41dd-af4d-c2d9de614752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:39:42.010977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025d8a8-b4a4-41dd-af4d-c2d9de614752 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:39:42.011265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025d8a8-b4a4-41dd-af4d-c2d9de614752 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:39:42.011542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025d8a8-b4a4-41dd-af4d-c2d9de614752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:39:42.021347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025d8a8-b4a4-41dd-af4d-c2d9de614752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:39:42.022773 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025d8a8-b4a4-41dd-af4d-c2d9de614752 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:39:42.032856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 734/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:39:51.943870 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=17 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:39:52.027962 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=17 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:40:14.579524 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4bfe2-d910-445b-921f-d32146a3fb20 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:14.580150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4bfe2-d910-445b-921f-d32146a3fb20 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:14.580150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4bfe2-d910-445b-921f-d32146a3fb20 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:14.581614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 737/1471] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:40:14.586815 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dae74-60cc-4d30-bee3-0dbe1b9103ca None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:14.589251 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dae74-60cc-4d30-bee3-0dbe1b9103ca None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:14.589251 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dae74-60cc-4d30-bee3-0dbe1b9103ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:14.605570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-509dae74-60cc-4d30-bee3-0dbe1b9103ca None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:40:14.607276 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-509dae74-60cc-4d30-bee3-0dbe1b9103ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:40:14.615076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 735/1472] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:40:14.663704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908a09b-2c52-42ce-902b-da7ac3a24942 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:14.663997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908a09b-2c52-42ce-902b-da7ac3a24942 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:14.664277 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908a09b-2c52-42ce-902b-da7ac3a24942 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:14.665669 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 738/1473] 10.222.0.33 () {54 vars in 962 bytes} [Wed Jun 1 17:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:40:14.671243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9dba8-ea82-43e6-af74-d92b071ce1a1 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:14.671539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9dba8-ea82-43e6-af74-d92b071ce1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:14.671817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9dba8-ea82-43e6-af74-d92b071ce1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:14.689604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-8aa9dba8-ea82-43e6-af74-d92b071ce1a1 None None] MFA Rules not processed for user `b34d05889f3c4d469f4661061457cb95`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:40:14.692461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8aa9dba8-ea82-43e6-af74-d92b071ce1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:40:14.697502 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 736/1474] 10.222.0.33 () {58 vars in 1059 bytes} [Wed Jun 1 17:40:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:40:14.704723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908a09b-2c52-42ce-902b-da7ac3a24942 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:40:14.715605 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908a09b-2c52-42ce-902b-da7ac3a24942 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:40:14.720686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92020ecd-8f01-4eb4-b1fc-8ad0e973a11c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b34d05889f3c4d469f4661061457cb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:40:14.721661 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92020ecd-8f01-4eb4-b1fc-8ad0e973a11c service glance] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:14.722120 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92020ecd-8f01-4eb4-b1fc-8ad0e973a11c service glance] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:14.722400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92020ecd-8f01-4eb4-b1fc-8ad0e973a11c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:14.738303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92020ecd-8f01-4eb4-b1fc-8ad0e973a11c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:40:14.738303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92020ecd-8f01-4eb4-b1fc-8ad0e973a11c service glance] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:40:14.743840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 739/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:40:17.113502 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1650983-1bec-48bc-9e48-648822f77f15 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:17.114089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1650983-1bec-48bc-9e48-648822f77f15 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:17.114089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1650983-1bec-48bc-9e48-648822f77f15 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:17.115446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 737/1476] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:40:17.120733 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b3b16-489b-49cc-897b-0c889658c960 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:17.121185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b3b16-489b-49cc-897b-0c889658c960 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:17.121358 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b3b16-489b-49cc-897b-0c889658c960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:17.138867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-cb9b3b16-489b-49cc-897b-0c889658c960 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:40:17.140088 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cb9b3b16-489b-49cc-897b-0c889658c960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:40:17.147887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 740/1477] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:40:17.172219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1650983-1bec-48bc-9e48-648822f77f15 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:40:17.184597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1650983-1bec-48bc-9e48-648822f77f15 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:40:17.189239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d9343-a5ba-4bfc-be97-1ca29f704380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:40:17.189883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d9343-a5ba-4bfc-be97-1ca29f704380 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:17.190165 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d9343-a5ba-4bfc-be97-1ca29f704380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:17.190509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d9343-a5ba-4bfc-be97-1ca29f704380 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:17.191230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d9343-a5ba-4bfc-be97-1ca29f704380 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:40:17.193020 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: WARNING py.warnings [None req-071d9343-a5ba-4bfc-be97-1ca29f704380 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 17:40:17.193020 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: warnings.warn(msg) Jun 01 17:40:17.193020 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: Jun 01 17:40:17.194173 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d9343-a5ba-4bfc-be97-1ca29f704380 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:40:17.213321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 738/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Wed Jun 1 17:40:17 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:40:19.538282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c192b-ee63-4dd9-9cae-7a1ab233844b None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:19.538904 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c192b-ee63-4dd9-9cae-7a1ab233844b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:19.538904 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c192b-ee63-4dd9-9cae-7a1ab233844b None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:19.540234 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 741/1479] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:40:19.545934 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487899ae-d96a-41b2-b342-5fc495854d84 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:19.546383 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487899ae-d96a-41b2-b342-5fc495854d84 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:19.546495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487899ae-d96a-41b2-b342-5fc495854d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:19.564246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-487899ae-d96a-41b2-b342-5fc495854d84 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:40:19.565480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-487899ae-d96a-41b2-b342-5fc495854d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:40:19.573197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 739/1480] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:40:19.617598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c192b-ee63-4dd9-9cae-7a1ab233844b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:40:19.632392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c192b-ee63-4dd9-9cae-7a1ab233844b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:40:19.637731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60900a81-983a-441c-b078-a879db7d2fdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:40:19.638569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60900a81-983a-441c-b078-a879db7d2fdb service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:19.638833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60900a81-983a-441c-b078-a879db7d2fdb service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:19.639110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60900a81-983a-441c-b078-a879db7d2fdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:19.647202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60900a81-983a-441c-b078-a879db7d2fdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:40:19.648774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60900a81-983a-441c-b078-a879db7d2fdb service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:40:19.658009 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 742/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:40:22.211312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d20829-cb93-4c00-a122-ec02b86b797b None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:22.211839 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d20829-cb93-4c00-a122-ec02b86b797b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:22.211839 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d20829-cb93-4c00-a122-ec02b86b797b None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:22.213279 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 740/1482] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:40:22.219048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bece9ae-45bc-4bec-ac14-2e4f6dbefb55 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:22.219504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bece9ae-45bc-4bec-ac14-2e4f6dbefb55 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:22.219603 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bece9ae-45bc-4bec-ac14-2e4f6dbefb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:22.239257 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7bece9ae-45bc-4bec-ac14-2e4f6dbefb55 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:40:22.240491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7bece9ae-45bc-4bec-ac14-2e4f6dbefb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:40:22.248378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 743/1483] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:40:22.284865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d20829-cb93-4c00-a122-ec02b86b797b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:40:22.296031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d20829-cb93-4c00-a122-ec02b86b797b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:40:22.299543 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983a757-78aa-4fdb-ab6a-9983805c3354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:40:22.300176 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983a757-78aa-4fdb-ab6a-9983805c3354 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:22.300459 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983a757-78aa-4fdb-ab6a-9983805c3354 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:22.300736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983a757-78aa-4fdb-ab6a-9983805c3354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:22.309460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983a757-78aa-4fdb-ab6a-9983805c3354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:40:22.310905 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983a757-78aa-4fdb-ab6a-9983805c3354 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:40:22.320204 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 741/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:40:24.622270 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657f06e-93ef-4e88-bd62-f3904dfdec49 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:24.623124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657f06e-93ef-4e88-bd62-f3904dfdec49 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:24.623124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657f06e-93ef-4e88-bd62-f3904dfdec49 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:24.624864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 744/1485] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:40:24.630525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86772e-ce0a-4d8b-9d2d-6ac85300b4f1 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:24.630976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86772e-ce0a-4d8b-9d2d-6ac85300b4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:24.631087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86772e-ce0a-4d8b-9d2d-6ac85300b4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:24.649488 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-7b86772e-ce0a-4d8b-9d2d-6ac85300b4f1 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:40:24.650696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7b86772e-ce0a-4d8b-9d2d-6ac85300b4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:40:24.659194 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 742/1486] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:40:24.696777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657f06e-93ef-4e88-bd62-f3904dfdec49 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:40:24.707801 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657f06e-93ef-4e88-bd62-f3904dfdec49 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:40:24.711292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d95d2-5b77-4fac-b5dc-1282151e6f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:40:24.711926 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d95d2-5b77-4fac-b5dc-1282151e6f53 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:24.712230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d95d2-5b77-4fac-b5dc-1282151e6f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:24.712508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d95d2-5b77-4fac-b5dc-1282151e6f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:24.722512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d95d2-5b77-4fac-b5dc-1282151e6f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:40:24.723988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d95d2-5b77-4fac-b5dc-1282151e6f53 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:40:24.734368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 745/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:40:27.084096 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ea24a-abc5-4d9b-b072-d2c5e4015f69 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:27.084704 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ea24a-abc5-4d9b-b072-d2c5e4015f69 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:27.084704 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ea24a-abc5-4d9b-b072-d2c5e4015f69 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:27.086088 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 743/1488] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:40:27.091964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74619a3-d657-40bf-b002-8209e99e9409 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:27.092395 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74619a3-d657-40bf-b002-8209e99e9409 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:27.092501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74619a3-d657-40bf-b002-8209e99e9409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:27.110059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b74619a3-d657-40bf-b002-8209e99e9409 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:40:27.116502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b74619a3-d657-40bf-b002-8209e99e9409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:40:27.118917 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 746/1489] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:40:27.158930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ea24a-abc5-4d9b-b072-d2c5e4015f69 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:40:27.170002 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ea24a-abc5-4d9b-b072-d2c5e4015f69 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:40:27.173485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba018640-38e6-4a51-87bc-900272be4125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:40:27.174120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba018640-38e6-4a51-87bc-900272be4125 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:27.174404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba018640-38e6-4a51-87bc-900272be4125 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:27.174680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba018640-38e6-4a51-87bc-900272be4125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:27.183491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba018640-38e6-4a51-87bc-900272be4125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:40:27.184977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba018640-38e6-4a51-87bc-900272be4125 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:40:27.194177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 744/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:40:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:40:29.933084 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22c025-c0a2-400a-b1fc-34f4da9d7a6d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:29.933659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22c025-c0a2-400a-b1fc-34f4da9d7a6d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:29.933659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22c025-c0a2-400a-b1fc-34f4da9d7a6d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:29.935279 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 747/1491] 10.222.0.33 () {54 vars in 926 bytes} [Wed Jun 1 17:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:40:29.940748 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff70d13-d721-4311-9b20-c9ba70f4d846 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:29.941248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff70d13-d721-4311-9b20-c9ba70f4d846 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:29.941350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff70d13-d721-4311-9b20-c9ba70f4d846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:29.962984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-bff70d13-d721-4311-9b20-c9ba70f4d846 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:40:29.964526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-bff70d13-d721-4311-9b20-c9ba70f4d846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:40:29.973933 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 745/1492] 10.222.0.33 () {58 vars in 1023 bytes} [Wed Jun 1 17:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:40:30.015053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22c025-c0a2-400a-b1fc-34f4da9d7a6d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:40:30.025797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22c025-c0a2-400a-b1fc-34f4da9d7a6d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:40:30.030402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156fec7-811a-461f-b17c-03aa83e6fe29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:40:30.031046 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156fec7-811a-461f-b17c-03aa83e6fe29 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:40:30.031330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156fec7-811a-461f-b17c-03aa83e6fe29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:40:30.031606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156fec7-811a-461f-b17c-03aa83e6fe29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:40:30.040480 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156fec7-811a-461f-b17c-03aa83e6fe29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:40:30.041948 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156fec7-811a-461f-b17c-03aa83e6fe29 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:40:30.051900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 748/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:40:39.954364 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=33 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:40:40.047515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=33 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:42:27.137955 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1727b3c-ef1a-4c0d-9fbf-4dbaced8633c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:27.138584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1727b3c-ef1a-4c0d-9fbf-4dbaced8633c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:27.138584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1727b3c-ef1a-4c0d-9fbf-4dbaced8633c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:27.157131 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b1727b3c-ef1a-4c0d-9fbf-4dbaced8633c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:42:27.158331 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b1727b3c-ef1a-4c0d-9fbf-4dbaced8633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:42:27.166951 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 746/1494] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:42:27.174742 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa520ef0-f91f-4918-9db0-3bd229566c26 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:27.175375 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa520ef0-f91f-4918-9db0-3bd229566c26 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:27.175375 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa520ef0-f91f-4918-9db0-3bd229566c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:27.193513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-aa520ef0-f91f-4918-9db0-3bd229566c26 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:42:27.194702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-aa520ef0-f91f-4918-9db0-3bd229566c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:42:27.202299 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 749/1495] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:42:27.207272 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1727b3c-ef1a-4c0d-9fbf-4dbaced8633c None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:42:27.216696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1727b3c-ef1a-4c0d-9fbf-4dbaced8633c None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:42:27.221478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04bab9-52b7-447b-a22c-d7b83069e3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:42:27.222208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04bab9-52b7-447b-a22c-d7b83069e3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:27.222494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04bab9-52b7-447b-a22c-d7b83069e3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:27.222771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04bab9-52b7-447b-a22c-d7b83069e3b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:27.223513 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04bab9-52b7-447b-a22c-d7b83069e3b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:42:27.223822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04bab9-52b7-447b-a22c-d7b83069e3b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:42:27.224833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: WARNING py.warnings [None req-dc04bab9-52b7-447b-a22c-d7b83069e3b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 17:42:27.224833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: warnings.warn(msg) Jun 01 17:42:27.224833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: Jun 01 17:42:27.225742 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04bab9-52b7-447b-a22c-d7b83069e3b6 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:42:27.237000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 747/1496] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:42:27.245221 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa520ef0-f91f-4918-9db0-3bd229566c26 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:42:27.254971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa520ef0-f91f-4918-9db0-3bd229566c26 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:42:27.259426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78324e-d7ab-4b2f-ac26-52074ec8b569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:42:27.260073 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78324e-d7ab-4b2f-ac26-52074ec8b569 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:27.260355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78324e-d7ab-4b2f-ac26-52074ec8b569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:27.260650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78324e-d7ab-4b2f-ac26-52074ec8b569 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:27.261369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78324e-d7ab-4b2f-ac26-52074ec8b569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:42:27.263097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: WARNING py.warnings [None req-7c78324e-d7ab-4b2f-ac26-52074ec8b569 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 17:42:27.263097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: warnings.warn(msg) Jun 01 17:42:27.263097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: Jun 01 17:42:27.264272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78324e-d7ab-4b2f-ac26-52074ec8b569 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:42:27.380301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 750/1497] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:42:27 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:42:27.384392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04bab9-52b7-447b-a22c-d7b83069e3b6 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:42:27.395039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04bab9-52b7-447b-a22c-d7b83069e3b6 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:42:27.449541 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68a337-e36e-4d7f-936f-c028401183a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:42:27.450204 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68a337-e36e-4d7f-936f-c028401183a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:27.450486 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68a337-e36e-4d7f-936f-c028401183a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:27.450761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68a337-e36e-4d7f-936f-c028401183a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:27.451437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68a337-e36e-4d7f-936f-c028401183a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:42:27.452444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: WARNING py.warnings [None req-3d68a337-e36e-4d7f-936f-c028401183a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 17:42:27.452444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: warnings.warn(msg) Jun 01 17:42:27.452444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: Jun 01 17:42:27.453678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68a337-e36e-4d7f-936f-c028401183a2 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:42:27.538969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 748/1498] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:42:27 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:42:27.543109 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78324e-d7ab-4b2f-ac26-52074ec8b569 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:42:27.555445 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78324e-d7ab-4b2f-ac26-52074ec8b569 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:42:27.563092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7235a-38bc-4c76-83f7-f77a34fb95cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:42:27.563092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7235a-38bc-4c76-83f7-f77a34fb95cb admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:27.563092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7235a-38bc-4c76-83f7-f77a34fb95cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:27.563092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7235a-38bc-4c76-83f7-f77a34fb95cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:27.563569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7235a-38bc-4c76-83f7-f77a34fb95cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:42:27.563569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: WARNING py.warnings [None req-8fd7235a-38bc-4c76-83f7-f77a34fb95cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 17:42:27.563569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: warnings.warn(msg) Jun 01 17:42:27.563569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: Jun 01 17:42:27.564399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7235a-38bc-4c76-83f7-f77a34fb95cb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:42:27.578058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 751/1499] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:42:27.582440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68a337-e36e-4d7f-936f-c028401183a2 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:42:27.592418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68a337-e36e-4d7f-936f-c028401183a2 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:42:27.598004 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdb38d-7f01-4b8d-aa30-b0e2dc84d5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:42:27.598679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdb38d-7f01-4b8d-aa30-b0e2dc84d5bb admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:27.598969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdb38d-7f01-4b8d-aa30-b0e2dc84d5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:27.599268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdb38d-7f01-4b8d-aa30-b0e2dc84d5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:27.599979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdb38d-7f01-4b8d-aa30-b0e2dc84d5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:42:27.601041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: WARNING py.warnings [None req-8bbdb38d-7f01-4b8d-aa30-b0e2dc84d5bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 17:42:27.601041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: warnings.warn(msg) Jun 01 17:42:27.601041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: Jun 01 17:42:27.601928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdb38d-7f01-4b8d-aa30-b0e2dc84d5bb admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:42:27.615798 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 749/1500] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:42:27.620007 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7235a-38bc-4c76-83f7-f77a34fb95cb admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:42:27.630283 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7235a-38bc-4c76-83f7-f77a34fb95cb admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:42:27.634708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c303e0-9cde-4a19-930c-feb5e1723521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:42:27.635582 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c303e0-9cde-4a19-930c-feb5e1723521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:27.635863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c303e0-9cde-4a19-930c-feb5e1723521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:27.636142 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c303e0-9cde-4a19-930c-feb5e1723521 admin admin] PATH_INFO: `/v3/projects/f143a537422c46f29072a56e1e19109c/users/b2d37059e15f4e059a6810491863dd8c/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:27.650353 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c303e0-9cde-4a19-930c-feb5e1723521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f143a537422c46f29072a56e1e19109c, user_id=b2d37059e15f4e059a6810491863dd8c, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:42:27.651327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: WARNING py.warnings [None req-d9c303e0-9cde-4a19-930c-feb5e1723521 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 17:42:27.651327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: warnings.warn(msg) Jun 01 17:42:27.651327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: Jun 01 17:42:27.653280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c303e0-9cde-4a19-930c-feb5e1723521 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:42:27.721365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 752/1501] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:42:27 2022] PUT /identity/v3/projects/f143a537422c46f29072a56e1e19109c/users/b2d37059e15f4e059a6810491863dd8c/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:42:27.733552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692509f4-b138-44ce-a5df-d158219d823d None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:27.733889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692509f4-b138-44ce-a5df-d158219d823d None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:27.734174 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692509f4-b138-44ce-a5df-d158219d823d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:27.761203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-692509f4-b138-44ce-a5df-d158219d823d None None] MFA Rules not processed for user `b2d37059e15f4e059a6810491863dd8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:42:27.762393 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-692509f4-b138-44ce-a5df-d158219d823d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:42:27.824372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 750/1502] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:42:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:42:27.837785 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e8d79-fc79-4ac2-8510-99c56e414ea5 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:27.838074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e8d79-fc79-4ac2-8510-99c56e414ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:27.838353 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e8d79-fc79-4ac2-8510-99c56e414ea5 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:27.839720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 753/1503] 10.222.0.33 () {54 vars in 963 bytes} [Wed Jun 1 17:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:42:27.844724 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541fc0b-d822-4de7-bbb0-0297cbb6adbf None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:27.845049 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541fc0b-d822-4de7-bbb0-0297cbb6adbf None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:27.845334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541fc0b-d822-4de7-bbb0-0297cbb6adbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:27.863725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-e541fc0b-d822-4de7-bbb0-0297cbb6adbf None None] MFA Rules not processed for user `98d9e5912b8c4f36922cde62830fb7ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:42:27.864922 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e541fc0b-d822-4de7-bbb0-0297cbb6adbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:42:27.907324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:42:27.914938 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 751/1504] 10.222.0.33 () {58 vars in 1060 bytes} [Wed Jun 1 17:42:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:42:27.922530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e8d79-fc79-4ac2-8510-99c56e414ea5 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:42:27.934165 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e8d79-fc79-4ac2-8510-99c56e414ea5 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:42:27.937837 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f377935-1f56-488e-94d4-71f5c3002fb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:42:27.938521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f377935-1f56-488e-94d4-71f5c3002fb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:27.938802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f377935-1f56-488e-94d4-71f5c3002fb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:27.939081 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f377935-1f56-488e-94d4-71f5c3002fb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:27.948603 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f377935-1f56-488e-94d4-71f5c3002fb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:42:27.950090 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f377935-1f56-488e-94d4-71f5c3002fb2 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:42:27.958971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 754/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:42:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:42:28.004542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a877b-6ae1-4162-ba06-ed980e08d05b None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:28.004836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a877b-6ae1-4162-ba06-ed980e08d05b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:28.005153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a877b-6ae1-4162-ba06-ed980e08d05b None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:28.006451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 752/1506] 10.222.0.33 () {52 vars in 829 bytes} [Wed Jun 1 17:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:42:28.010071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f377935-1f56-488e-94d4-71f5c3002fb2 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:42:28.074300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f377935-1f56-488e-94d4-71f5c3002fb2 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:42:28.078857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a92e07-3df2-4ccd-b9f3-e9d096670be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:42:28.079735 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a92e07-3df2-4ccd-b9f3-e9d096670be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:28.080024 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a92e07-3df2-4ccd-b9f3-e9d096670be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:28.080305 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a92e07-3df2-4ccd-b9f3-e9d096670be5 admin admin] PATH_INFO: `/v3/users/b2d37059e15f4e059a6810491863dd8c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:28.081776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a92e07-3df2-4ccd-b9f3-e9d096670be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d37059e15f4e059a6810491863dd8c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:42:28.082830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: WARNING py.warnings [None req-15a92e07-3df2-4ccd-b9f3-e9d096670be5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 17:42:28.082830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: warnings.warn(msg) Jun 01 17:42:28.082830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: Jun 01 17:42:28.084031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a92e07-3df2-4ccd-b9f3-e9d096670be5 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:42:28.453116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-15a92e07-3df2-4ccd-b9f3-e9d096670be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d37059e15f4e059a6810491863dd8c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:42:28.561498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-15a92e07-3df2-4ccd-b9f3-e9d096670be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d37059e15f4e059a6810491863dd8c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:42:28.574504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-15a92e07-3df2-4ccd-b9f3-e9d096670be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d37059e15f4e059a6810491863dd8c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:42:28.575267 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-15a92e07-3df2-4ccd-b9f3-e9d096670be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d37059e15f4e059a6810491863dd8c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:42:28.592129 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:42:28.595000 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-15a92e07-3df2-4ccd-b9f3-e9d096670be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d37059e15f4e059a6810491863dd8c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:42:28.601899 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 755/1507] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:42:28 2022] DELETE /identity/v3/users/b2d37059e15f4e059a6810491863dd8c => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:42:28.606334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431e9cb-21b2-4425-be12-1b7051bafe55 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:28.606818 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431e9cb-21b2-4425-be12-1b7051bafe55 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:28.606924 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431e9cb-21b2-4425-be12-1b7051bafe55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:28.624590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-3431e9cb-21b2-4425-be12-1b7051bafe55 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:42:28.630357 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3431e9cb-21b2-4425-be12-1b7051bafe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:42:28.684643 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 753/1508] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:42:28.694870 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a92e07-3df2-4ccd-b9f3-e9d096670be5 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:42:28.696774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-15a92e07-3df2-4ccd-b9f3-e9d096670be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:42:28.754018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a92e07-3df2-4ccd-b9f3-e9d096670be5 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:42:28.757592 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d6033-7d50-4828-b9ea-184b6e502284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:42:28.758242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d6033-7d50-4828-b9ea-184b6e502284 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:28.758531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d6033-7d50-4828-b9ea-184b6e502284 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:28.758809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d6033-7d50-4828-b9ea-184b6e502284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:28.767775 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d6033-7d50-4828-b9ea-184b6e502284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:42:28.770089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d6033-7d50-4828-b9ea-184b6e502284 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:42:28.779511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 756/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:42:29.277387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431e9cb-21b2-4425-be12-1b7051bafe55 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:42:29.278814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3431e9cb-21b2-4425-be12-1b7051bafe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:42:29.292032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431e9cb-21b2-4425-be12-1b7051bafe55 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:42:29.296967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43cfe6-6579-43a0-b68d-c6d76264210f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:42:29.297915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43cfe6-6579-43a0-b68d-c6d76264210f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:42:29.298201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43cfe6-6579-43a0-b68d-c6d76264210f admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:42:29.298480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43cfe6-6579-43a0-b68d-c6d76264210f admin admin] PATH_INFO: `/v3/projects/f143a537422c46f29072a56e1e19109c` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:42:29.300095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43cfe6-6579-43a0-b68d-c6d76264210f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f143a537422c46f29072a56e1e19109c)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:42:29.301236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: WARNING py.warnings [None req-fd43cfe6-6579-43a0-b68d-c6d76264210f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 17:42:29.301236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: warnings.warn(msg) Jun 01 17:42:29.301236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: Jun 01 17:42:29.302434 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43cfe6-6579-43a0-b68d-c6d76264210f admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:42:29.421688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-fd43cfe6-6579-43a0-b68d-c6d76264210f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f143a537422c46f29072a56e1e19109c', 'request_id': 'req-fd43cfe6-6579-43a0-b68d-c6d76264210f'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:42:29.436449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-fd43cfe6-6579-43a0-b68d-c6d76264210f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f143a537422c46f29072a56e1e19109c', 'request_id': 'req-fd43cfe6-6579-43a0-b68d-c6d76264210f'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:42:29.538246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-fd43cfe6-6579-43a0-b68d-c6d76264210f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f143a537422c46f29072a56e1e19109c', 'request_id': 'req-fd43cfe6-6579-43a0-b68d-c6d76264210f'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:42:29.549848 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-fd43cfe6-6579-43a0-b68d-c6d76264210f admin admin] The token cache is being invalidate because project f143a537422c46f29072a56e1e19109c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:42:29.550133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-fd43cfe6-6579-43a0-b68d-c6d76264210f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:42:29.550868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-fd43cfe6-6579-43a0-b68d-c6d76264210f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:42:29.552469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 754/1510] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:42:29 2022] DELETE /identity/v3/projects/f143a537422c46f29072a56e1e19109c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:42:38.775319 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:42:39.546771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:44:04.014526 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82eb9d-4633-4cd2-a693-178d0f089d2b None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:04.015384 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82eb9d-4633-4cd2-a693-178d0f089d2b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:04.015384 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82eb9d-4633-4cd2-a693-178d0f089d2b None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:04.017070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 17:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:44:04.022129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e728cf0-9d9d-445a-84a7-1263d4ff9541 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:04.022844 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e728cf0-9d9d-445a-84a7-1263d4ff9541 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:04.022844 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e728cf0-9d9d-445a-84a7-1263d4ff9541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:04.041331 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-3e728cf0-9d9d-445a-84a7-1263d4ff9541 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:44:04.042548 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3e728cf0-9d9d-445a-84a7-1263d4ff9541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:44:04.100871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 17:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:44:04.270157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82eb9d-4633-4cd2-a693-178d0f089d2b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:44:04.271784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9d82eb9d-4633-4cd2-a693-178d0f089d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:44:04.346990 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82eb9d-4633-4cd2-a693-178d0f089d2b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:44:04.352379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b074de-ea22-4198-b38e-ddc49bad2ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:44:04.353056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b074de-ea22-4198-b38e-ddc49bad2ced service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:04.353349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b074de-ea22-4198-b38e-ddc49bad2ced service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:04.353635 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b074de-ea22-4198-b38e-ddc49bad2ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:04.362369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b074de-ea22-4198-b38e-ddc49bad2ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:44:04.363958 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b074de-ea22-4198-b38e-ddc49bad2ced service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:44:04.373319 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 758/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:44:05.253525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a2cf1-d9c5-4e4b-b595-0c9faff010c2 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:05.254101 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a2cf1-d9c5-4e4b-b595-0c9faff010c2 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:05.254101 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a2cf1-d9c5-4e4b-b595-0c9faff010c2 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:05.255474 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 17:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:44:05.260666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0864e2-727c-45f9-8f02-2edbaefd7584 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:05.261157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0864e2-727c-45f9-8f02-2edbaefd7584 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:05.261578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0864e2-727c-45f9-8f02-2edbaefd7584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:05.285975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0c0864e2-727c-45f9-8f02-2edbaefd7584 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:44:05.287721 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0c0864e2-727c-45f9-8f02-2edbaefd7584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:44:05.298059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 17:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:44:05.448032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a2cf1-d9c5-4e4b-b595-0c9faff010c2 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:44:05.462418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a2cf1-d9c5-4e4b-b595-0c9faff010c2 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:44:05.468010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905f241-733d-4791-9f43-baf5bf39ff82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:44:05.468660 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905f241-733d-4791-9f43-baf5bf39ff82 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:05.468967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905f241-733d-4791-9f43-baf5bf39ff82 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:05.469785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905f241-733d-4791-9f43-baf5bf39ff82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:05.478210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905f241-733d-4791-9f43-baf5bf39ff82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:44:05.479809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905f241-733d-4791-9f43-baf5bf39ff82 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:44:05.490098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 757/1516] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:44:05.577593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeda90-8f5b-4460-a793-9d6d3b7074fb None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:05.577892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeda90-8f5b-4460-a793-9d6d3b7074fb None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:05.578174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeda90-8f5b-4460-a793-9d6d3b7074fb None None] PATH_INFO: `/v3` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:05.580548 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 760/1517] 10.222.0.72 () {54 vars in 925 bytes} [Wed Jun 1 17:44:05 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:44:05.588804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b01f49-cb2e-42f6-8156-b2e4227d3621 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:05.589430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b01f49-cb2e-42f6-8156-b2e4227d3621 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:05.589910 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b01f49-cb2e-42f6-8156-b2e4227d3621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:05.612213 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-02b01f49-cb2e-42f6-8156-b2e4227d3621 None None] MFA Rules not processed for user `ae952b30dffa450e97ce4a73da8d00f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:44:05.613479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-02b01f49-cb2e-42f6-8156-b2e4227d3621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:44:05.677598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 758/1518] 10.222.0.72 () {58 vars in 1015 bytes} [Wed Jun 1 17:44:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:44:15.249934 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6325b99-b572-4074-8402-6d5efaeec70f None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:15.250528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6325b99-b572-4074-8402-6d5efaeec70f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:15.250702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6325b99-b572-4074-8402-6d5efaeec70f None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:15.252869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 761/1519] 10.222.0.33 () {54 vars in 960 bytes} [Wed Jun 1 17:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:44:15.257992 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42bd46-fc08-4b11-a44d-3330be536e0e None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:15.258421 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42bd46-fc08-4b11-a44d-3330be536e0e None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:15.258557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42bd46-fc08-4b11-a44d-3330be536e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:15.276238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-2f42bd46-fc08-4b11-a44d-3330be536e0e None None] MFA Rules not processed for user `ae952b30dffa450e97ce4a73da8d00f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:44:15.277463 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-2f42bd46-fc08-4b11-a44d-3330be536e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:44:15.279186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=37 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:44:15.286763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 759/1520] 10.222.0.33 () {58 vars in 1057 bytes} [Wed Jun 1 17:44:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:44:15.294308 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6325b99-b572-4074-8402-6d5efaeec70f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:44:15.308156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6325b99-b572-4074-8402-6d5efaeec70f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:44:15.313159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dd679-c637-480b-84ce-2aee073fb05c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:44:15.313793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dd679-c637-480b-84ce-2aee073fb05c service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:15.314080 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dd679-c637-480b-84ce-2aee073fb05c service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:15.314362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dd679-c637-480b-84ce-2aee073fb05c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:15.322599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dd679-c637-480b-84ce-2aee073fb05c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:44:15.324185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dd679-c637-480b-84ce-2aee073fb05c service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:44:15.334317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 762/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:44:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:44:16.796268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c3db1-6a33-46ca-a9dc-bf0fd4a61301 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:16.796879 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c3db1-6a33-46ca-a9dc-bf0fd4a61301 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:16.797533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c3db1-6a33-46ca-a9dc-bf0fd4a61301 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:16.799043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 17:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:44:16.803716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361b0b4-c003-48f4-aa45-4c16cf6a03af None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:16.804116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361b0b4-c003-48f4-aa45-4c16cf6a03af None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:16.804281 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361b0b4-c003-48f4-aa45-4c16cf6a03af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:16.822036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d361b0b4-c003-48f4-aa45-4c16cf6a03af None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:44:16.823230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d361b0b4-c003-48f4-aa45-4c16cf6a03af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:44:16.831310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 17:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:44:16.987610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c3db1-6a33-46ca-a9dc-bf0fd4a61301 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:44:17.002043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c3db1-6a33-46ca-a9dc-bf0fd4a61301 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:44:17.007418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86b7df-f885-4b05-95a9-24c7d02e1f96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:44:17.008056 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86b7df-f885-4b05-95a9-24c7d02e1f96 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:17.008340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86b7df-f885-4b05-95a9-24c7d02e1f96 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:17.008618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86b7df-f885-4b05-95a9-24c7d02e1f96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:17.017984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86b7df-f885-4b05-95a9-24c7d02e1f96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:44:17.019614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86b7df-f885-4b05-95a9-24c7d02e1f96 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:44:17.029226 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 761/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:44:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:44:17.897712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241f91d-3df2-418c-916c-239fff51401d None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:17.898290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241f91d-3df2-418c-916c-239fff51401d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:17.898290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241f91d-3df2-418c-916c-239fff51401d None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:17.899674 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 1 17:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:44:17.904502 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee8d03-e177-4883-a8a9-a677d93e6fce None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:17.904954 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee8d03-e177-4883-a8a9-a677d93e6fce None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:17.905112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee8d03-e177-4883-a8a9-a677d93e6fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:17.923356 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-45ee8d03-e177-4883-a8a9-a677d93e6fce None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:44:17.924548 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-45ee8d03-e177-4883-a8a9-a677d93e6fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:44:17.932252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 1 17:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:44:18.083557 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241f91d-3df2-418c-916c-239fff51401d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:44:18.098394 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241f91d-3df2-418c-916c-239fff51401d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:44:18.103807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487999a-5139-49f9-ad95-503160753c00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:44:18.104452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487999a-5139-49f9-ad95-503160753c00 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:18.104741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487999a-5139-49f9-ad95-503160753c00 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:18.105056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487999a-5139-49f9-ad95-503160753c00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:18.113667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487999a-5139-49f9-ad95-503160753c00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:44:18.115253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487999a-5139-49f9-ad95-503160753c00 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:44:18.124601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 765/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:44:22.222992 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108b194-bfe2-478a-bd0f-ce8b1ffd2fa8 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:22.223580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108b194-bfe2-478a-bd0f-ce8b1ffd2fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:22.223580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108b194-bfe2-478a-bd0f-ce8b1ffd2fa8 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:22.225036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 17:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:44:22.230676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78c024-c31a-482c-97e6-a27f106b14ff None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:22.231088 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78c024-c31a-482c-97e6-a27f106b14ff None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:22.231249 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78c024-c31a-482c-97e6-a27f106b14ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:22.249914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ab78c024-c31a-482c-97e6-a27f106b14ff None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:44:22.251161 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ab78c024-c31a-482c-97e6-a27f106b14ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:44:22.258825 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 17:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:44:22.296639 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108b194-bfe2-478a-bd0f-ce8b1ffd2fa8 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:44:22.298617 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f108b194-bfe2-478a-bd0f-ce8b1ffd2fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:44:22.356161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108b194-bfe2-478a-bd0f-ce8b1ffd2fa8 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:44:22.359837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64323871-d052-40f0-8dd4-dcd3591eabaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:44:22.360485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64323871-d052-40f0-8dd4-dcd3591eabaa service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:22.360773 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64323871-d052-40f0-8dd4-dcd3591eabaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:22.361099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64323871-d052-40f0-8dd4-dcd3591eabaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:22.369909 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64323871-d052-40f0-8dd4-dcd3591eabaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:44:22.371351 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64323871-d052-40f0-8dd4-dcd3591eabaa service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:44:22.376266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:44:22.380845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 764/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:44:24.674435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e76e-61e7-4727-8bbc-992726fb2486 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:24.675001 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e76e-61e7-4727-8bbc-992726fb2486 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:24.675001 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683e76e-61e7-4727-8bbc-992726fb2486 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:24.676362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 17:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:44:24.681694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5474f-4523-40f4-9609-67db7ce95fd1 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:24.682105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5474f-4523-40f4-9609-67db7ce95fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:24.682261 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5474f-4523-40f4-9609-67db7ce95fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:24.700431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-01d5474f-4523-40f4-9609-67db7ce95fd1 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:44:24.701667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-01d5474f-4523-40f4-9609-67db7ce95fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:44:24.709847 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 17:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:44:24.745656 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e76e-61e7-4727-8bbc-992726fb2486 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:44:24.756977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683e76e-61e7-4727-8bbc-992726fb2486 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:44:24.760467 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29feacec-65d0-4a7b-b58b-dce25bd411e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:44:24.761139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feacec-65d0-4a7b-b58b-dce25bd411e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:24.761427 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feacec-65d0-4a7b-b58b-dce25bd411e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:24.761703 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feacec-65d0-4a7b-b58b-dce25bd411e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:24.770661 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29feacec-65d0-4a7b-b58b-dce25bd411e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:44:24.772087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29feacec-65d0-4a7b-b58b-dce25bd411e1 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:44:24.781293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 768/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:44:28.644249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ff0bd-95f7-4fda-85e1-2447d3cd7e73 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:28.644832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ff0bd-95f7-4fda-85e1-2447d3cd7e73 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:28.644832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ff0bd-95f7-4fda-85e1-2447d3cd7e73 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:28.646246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 17:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:44:28.651607 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8d409-5c2d-4e2d-b016-ea09971d66cb None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:28.652028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8d409-5c2d-4e2d-b016-ea09971d66cb None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:28.652171 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8d409-5c2d-4e2d-b016-ea09971d66cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:28.670425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0cf8d409-5c2d-4e2d-b016-ea09971d66cb None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:44:28.672264 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0cf8d409-5c2d-4e2d-b016-ea09971d66cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:44:28.680071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 17:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:44:28.950432 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ff0bd-95f7-4fda-85e1-2447d3cd7e73 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:44:28.952141 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-438ff0bd-95f7-4fda-85e1-2447d3cd7e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:44:29.010937 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ff0bd-95f7-4fda-85e1-2447d3cd7e73 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:44:29.014543 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c919f3e-0825-4c16-927d-01dcac2d4713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:44:29.015801 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c919f3e-0825-4c16-927d-01dcac2d4713 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:29.016086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c919f3e-0825-4c16-927d-01dcac2d4713 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:29.016368 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c919f3e-0825-4c16-927d-01dcac2d4713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:29.025309 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c919f3e-0825-4c16-927d-01dcac2d4713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:44:29.026752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c919f3e-0825-4c16-927d-01dcac2d4713 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:44:29.037061 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 767/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:44:31.308055 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b51c6-c3bf-4a89-afd7-815a021c0a4c None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:31.308716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b51c6-c3bf-4a89-afd7-815a021c0a4c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:31.308716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b51c6-c3bf-4a89-afd7-815a021c0a4c None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:31.310014 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 1 17:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:44:31.315213 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77981c-b253-42f2-b0f3-eeb70ef2d512 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:31.315624 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77981c-b253-42f2-b0f3-eeb70ef2d512 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:31.315776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77981c-b253-42f2-b0f3-eeb70ef2d512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:31.334244 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-0b77981c-b253-42f2-b0f3-eeb70ef2d512 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:44:31.335447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0b77981c-b253-42f2-b0f3-eeb70ef2d512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:44:31.344327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 1 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:44:31.614531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b51c6-c3bf-4a89-afd7-815a021c0a4c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:44:31.616701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-290b51c6-c3bf-4a89-afd7-815a021c0a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:44:31.629761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b51c6-c3bf-4a89-afd7-815a021c0a4c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:44:31.633281 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030e6eb-6540-43e2-8b19-567f3f1806f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:44:31.633919 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030e6eb-6540-43e2-8b19-567f3f1806f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:44:31.634203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030e6eb-6540-43e2-8b19-567f3f1806f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:44:31.634489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030e6eb-6540-43e2-8b19-567f3f1806f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:44:31.643917 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030e6eb-6540-43e2-8b19-567f3f1806f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:44:31.645395 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030e6eb-6540-43e2-8b19-567f3f1806f6 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:44:31.654747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 771/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:44:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:44:41.329350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=32 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:44:41.650624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=33 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:03.073919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107ed76-5138-4ebc-9785-3b707c382f4b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.074548 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107ed76-5138-4ebc-9785-3b707c382f4b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.074548 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107ed76-5138-4ebc-9785-3b707c382f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.109023 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-e107ed76-5138-4ebc-9785-3b707c382f4b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:03.110300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e107ed76-5138-4ebc-9785-3b707c382f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:03.121179 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 769/1540] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:03.126159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c236f8d-7da4-43ce-931c-a2cdb209ee41 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.126706 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c236f8d-7da4-43ce-931c-a2cdb209ee41 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.126706 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c236f8d-7da4-43ce-931c-a2cdb209ee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.127081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5927f7-ce2c-4d63-a2f2-01446feb9523 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.127583 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5927f7-ce2c-4d63-a2f2-01446feb9523 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.127870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5927f7-ce2c-4d63-a2f2-01446feb9523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.152312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-1f5927f7-ce2c-4d63-a2f2-01446feb9523 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:03.156790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-1f5927f7-ce2c-4d63-a2f2-01446feb9523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:03.163802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-4c236f8d-7da4-43ce-931c-a2cdb209ee41 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:03.165030 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4c236f8d-7da4-43ce-931c-a2cdb209ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:03.167379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 770/1541] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:46:03.169209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dc501-1f4d-4652-8178-ee51be0d046f None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.170314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dc501-1f4d-4652-8178-ee51be0d046f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.170744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dc501-1f4d-4652-8178-ee51be0d046f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.190699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 772/1542] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:03.192502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d53bc4-a982-43ad-a7d2-9c53af145e64 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.192502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d53bc4-a982-43ad-a7d2-9c53af145e64 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.192749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d53bc4-a982-43ad-a7d2-9c53af145e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.195843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b80dc501-1f4d-4652-8178-ee51be0d046f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:03.197241 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b80dc501-1f4d-4652-8178-ee51be0d046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:03.206820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 771/1543] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:03.208730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855b2d9-4bf0-46f2-a5d0-16593aa25e48 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.209429 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855b2d9-4bf0-46f2-a5d0-16593aa25e48 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.209981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855b2d9-4bf0-46f2-a5d0-16593aa25e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.230397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-d855b2d9-4bf0-46f2-a5d0-16593aa25e48 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:03.231950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d855b2d9-4bf0-46f2-a5d0-16593aa25e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:03.240756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 772/1544] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:03.242271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00368b80-ef7b-4376-b4c1-c97a6219c661 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.242723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00368b80-ef7b-4376-b4c1-c97a6219c661 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.243148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00368b80-ef7b-4376-b4c1-c97a6219c661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.244911 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-93d53bc4-a982-43ad-a7d2-9c53af145e64 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:03.246154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-93d53bc4-a982-43ad-a7d2-9c53af145e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:03.265500 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-00368b80-ef7b-4376-b4c1-c97a6219c661 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:03.267176 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-00368b80-ef7b-4376-b4c1-c97a6219c661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:03.271338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 773/1545] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:03.272193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d53bc4-a982-43ad-a7d2-9c53af145e64 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:03.277195 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 773/1546] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:03.278876 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce09f7-4877-4b96-85d5-8614df2fd03b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.284335 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce09f7-4877-4b96-85d5-8614df2fd03b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.284335 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce09f7-4877-4b96-85d5-8614df2fd03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.286566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d53bc4-a982-43ad-a7d2-9c53af145e64 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:03.301247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-46ce09f7-4877-4b96-85d5-8614df2fd03b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:03.302874 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-46ce09f7-4877-4b96-85d5-8614df2fd03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:03.303149 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c6c13-cfdf-4126-9704-33be55b7a749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:03.303841 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c6c13-cfdf-4126-9704-33be55b7a749 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.304135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c6c13-cfdf-4126-9704-33be55b7a749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.304430 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c6c13-cfdf-4126-9704-33be55b7a749 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.305178 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c6c13-cfdf-4126-9704-33be55b7a749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:03.305689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c6c13-cfdf-4126-9704-33be55b7a749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:03.306699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: WARNING py.warnings [None req-843c6c13-cfdf-4126-9704-33be55b7a749 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 01 17:46:03.306699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: warnings.warn(msg) Jun 01 17:46:03.306699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: Jun 01 17:46:03.307606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c6c13-cfdf-4126-9704-33be55b7a749 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:03.313739 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 774/1547] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:03.314855 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce09f7-4877-4b96-85d5-8614df2fd03b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:03.325499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce09f7-4877-4b96-85d5-8614df2fd03b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:03.331896 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528e13a-beed-43c9-b48b-8dcfb56113be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:03.332804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528e13a-beed-43c9-b48b-8dcfb56113be admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.333270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528e13a-beed-43c9-b48b-8dcfb56113be admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.333717 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528e13a-beed-43c9-b48b-8dcfb56113be admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.334600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528e13a-beed-43c9-b48b-8dcfb56113be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:03.335078 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528e13a-beed-43c9-b48b-8dcfb56113be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:03.336833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528e13a-beed-43c9-b48b-8dcfb56113be admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:03.336987 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 774/1548] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:46:03.337811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c6c13-cfdf-4126-9704-33be55b7a749 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:03.352216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 775/1549] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:46:03.353413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528e13a-beed-43c9-b48b-8dcfb56113be admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:03.354349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c6c13-cfdf-4126-9704-33be55b7a749 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:03.365226 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528e13a-beed-43c9-b48b-8dcfb56113be admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:03.370775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bbccc-4424-41ec-b4d4-a33f09cc6ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:03.371907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bbccc-4424-41ec-b4d4-a33f09cc6ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.373168 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bbccc-4424-41ec-b4d4-a33f09cc6ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.373634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ba798-bd2c-4567-8f56-a60b65bcc578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:03.373781 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bbccc-4424-41ec-b4d4-a33f09cc6ef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.374322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ba798-bd2c-4567-8f56-a60b65bcc578 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.374617 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ba798-bd2c-4567-8f56-a60b65bcc578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.374906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ba798-bd2c-4567-8f56-a60b65bcc578 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.375163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67bbccc-4424-41ec-b4d4-a33f09cc6ef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:03.375614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67bbccc-4424-41ec-b4d4-a33f09cc6ef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:03.375736 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ba798-bd2c-4567-8f56-a60b65bcc578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:03.378673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ba798-bd2c-4567-8f56-a60b65bcc578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:03.378673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ba798-bd2c-4567-8f56-a60b65bcc578 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:03.380587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67bbccc-4424-41ec-b4d4-a33f09cc6ef8 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:03.403668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 776/1550] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:46:03.405571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bbccc-4424-41ec-b4d4-a33f09cc6ef8 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:03.407262 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 775/1551] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:46:03.408317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ba798-bd2c-4567-8f56-a60b65bcc578 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:03.422227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bbccc-4424-41ec-b4d4-a33f09cc6ef8 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:03.424361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ba798-bd2c-4567-8f56-a60b65bcc578 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:03.426955 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37f141-d02a-4f28-8ff5-dc628e7a990a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:03.427669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37f141-d02a-4f28-8ff5-dc628e7a990a admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.427959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37f141-d02a-4f28-8ff5-dc628e7a990a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.428237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37f141-d02a-4f28-8ff5-dc628e7a990a admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.428928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37f141-d02a-4f28-8ff5-dc628e7a990a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:03.429894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db511e-e702-46b9-a503-7cb1bc718998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:03.430029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: WARNING py.warnings [None req-aa37f141-d02a-4f28-8ff5-dc628e7a990a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 17:46:03.430029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: warnings.warn(msg) Jun 01 17:46:03.430029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: Jun 01 17:46:03.430695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db511e-e702-46b9-a503-7cb1bc718998 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.430986 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db511e-e702-46b9-a503-7cb1bc718998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.431160 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37f141-d02a-4f28-8ff5-dc628e7a990a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:03.431388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db511e-e702-46b9-a503-7cb1bc718998 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.432088 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db511e-e702-46b9-a503-7cb1bc718998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:03.434034 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db511e-e702-46b9-a503-7cb1bc718998 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:03.554680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 777/1552] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:03.556118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82b61b-fc68-4fa5-8221-0d05b39dbc16 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.556411 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82b61b-fc68-4fa5-8221-0d05b39dbc16 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.556690 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82b61b-fc68-4fa5-8221-0d05b39dbc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.576101 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-ca82b61b-fc68-4fa5-8221-0d05b39dbc16 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:03.577275 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ca82b61b-fc68-4fa5-8221-0d05b39dbc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:03.592247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 776/1553] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:03.592247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13295f4-b842-41de-8fc6-8ce35da84c87 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.592247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13295f4-b842-41de-8fc6-8ce35da84c87 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.592247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13295f4-b842-41de-8fc6-8ce35da84c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.609778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b13295f4-b842-41de-8fc6-8ce35da84c87 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:03.611082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b13295f4-b842-41de-8fc6-8ce35da84c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:03.641277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 778/1554] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:03.646372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282cb2f-729a-4a3b-ad94-4afec1cc1553 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.646667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282cb2f-729a-4a3b-ad94-4afec1cc1553 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.646949 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282cb2f-729a-4a3b-ad94-4afec1cc1553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.665521 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-9282cb2f-729a-4a3b-ad94-4afec1cc1553 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:03.666721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-9282cb2f-729a-4a3b-ad94-4afec1cc1553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:03.672077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 777/1555] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:03.672905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13295f4-b842-41de-8fc6-8ce35da84c87 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:03.681915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 779/1556] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:03.681915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282cb2f-729a-4a3b-ad94-4afec1cc1553 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:03.684182 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13295f4-b842-41de-8fc6-8ce35da84c87 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:03.688775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282cb2f-729a-4a3b-ad94-4afec1cc1553 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:03.689585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769296d5-7d82-4156-b0a2-c8601d662b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:03.690278 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769296d5-7d82-4156-b0a2-c8601d662b9f admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.690574 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769296d5-7d82-4156-b0a2-c8601d662b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.690878 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769296d5-7d82-4156-b0a2-c8601d662b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.691571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769296d5-7d82-4156-b0a2-c8601d662b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:03.693365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce907b-00b0-4836-bd3e-873851609f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:03.693528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769296d5-7d82-4156-b0a2-c8601d662b9f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:03.694014 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce907b-00b0-4836-bd3e-873851609f97 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.694298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce907b-00b0-4836-bd3e-873851609f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.694652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce907b-00b0-4836-bd3e-873851609f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.695426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce907b-00b0-4836-bd3e-873851609f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:03.697339 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce907b-00b0-4836-bd3e-873851609f97 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:03.776876 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 778/1557] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:03.776876 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ea60a-9958-4c85-8897-a016cfb72d05 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.776876 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ea60a-9958-4c85-8897-a016cfb72d05 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.776876 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ea60a-9958-4c85-8897-a016cfb72d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.792967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-101ea60a-9958-4c85-8897-a016cfb72d05 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:03.794183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-101ea60a-9958-4c85-8897-a016cfb72d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:03.808450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 780/1558] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:03.810770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce907b-00b0-4836-bd3e-873851609f97 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:03.854378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 779/1559] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:03.855452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ea60a-9958-4c85-8897-a016cfb72d05 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:03.863519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:03.865077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ea60a-9958-4c85-8897-a016cfb72d05 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:03.878475 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:03.880673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce907b-00b0-4836-bd3e-873851609f97 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:03.885611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd22f4-35d2-40e3-86f9-5d753f7d5068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:03.886282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd22f4-35d2-40e3-86f9-5d753f7d5068 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.886564 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd22f4-35d2-40e3-86f9-5d753f7d5068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.886841 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd22f4-35d2-40e3-86f9-5d753f7d5068 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.887547 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd22f4-35d2-40e3-86f9-5d753f7d5068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:03.889730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd22f4-35d2-40e3-86f9-5d753f7d5068 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:03.921978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325229d-64af-41fd-ba0a-d411cca40ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:03.922659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325229d-64af-41fd-ba0a-d411cca40ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.922943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325229d-64af-41fd-ba0a-d411cca40ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.923220 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325229d-64af-41fd-ba0a-d411cca40ebe admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.923903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325229d-64af-41fd-ba0a-d411cca40ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:03.924962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: WARNING py.warnings [None req-3325229d-64af-41fd-ba0a-d411cca40ebe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 17:46:03.924962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: warnings.warn(msg) Jun 01 17:46:03.924962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: Jun 01 17:46:03.926179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325229d-64af-41fd-ba0a-d411cca40ebe admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:03.965191 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 781/1560] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:03.967099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c465da-553d-4ef2-b2bb-3f83c6f17809 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.967393 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c465da-553d-4ef2-b2bb-3f83c6f17809 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.967667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c465da-553d-4ef2-b2bb-3f83c6f17809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:03.985355 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-71c465da-553d-4ef2-b2bb-3f83c6f17809 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:03.986557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-71c465da-553d-4ef2-b2bb-3f83c6f17809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:03.994374 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 782/1561] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:03.995546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb023a55-5389-4df1-9a8a-66ab858e9f4c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:03.995832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb023a55-5389-4df1-9a8a-66ab858e9f4c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:03.996108 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb023a55-5389-4df1-9a8a-66ab858e9f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.013779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-cb023a55-5389-4df1-9a8a-66ab858e9f4c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:04.051490 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-cb023a55-5389-4df1-9a8a-66ab858e9f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:04.051490 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 783/1562] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:04.051490 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08020af-ebaf-41e2-b326-ac7edb79381b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.051490 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08020af-ebaf-41e2-b326-ac7edb79381b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.051490 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08020af-ebaf-41e2-b326-ac7edb79381b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.051490 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-d08020af-ebaf-41e2-b326-ac7edb79381b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:04.052103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d08020af-ebaf-41e2-b326-ac7edb79381b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:04.052193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 784/1563] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:04.052966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08020af-ebaf-41e2-b326-ac7edb79381b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.064283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08020af-ebaf-41e2-b326-ac7edb79381b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.068879 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329f057-e228-4ee0-9e42-e388b781c2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.069596 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329f057-e228-4ee0-9e42-e388b781c2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.069888 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329f057-e228-4ee0-9e42-e388b781c2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.070167 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329f057-e228-4ee0-9e42-e388b781c2c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.070847 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329f057-e228-4ee0-9e42-e388b781c2c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.072770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329f057-e228-4ee0-9e42-e388b781c2c0 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.093434 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 780/1564] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:03 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:04.094997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325229d-64af-41fd-ba0a-d411cca40ebe admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.103847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325229d-64af-41fd-ba0a-d411cca40ebe admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.109572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7afec8-8389-499b-875a-168d6f21626d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.110175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7afec8-8389-499b-875a-168d6f21626d admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.110489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7afec8-8389-499b-875a-168d6f21626d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.110770 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7afec8-8389-499b-875a-168d6f21626d admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.111548 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7afec8-8389-499b-875a-168d6f21626d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.113515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7afec8-8389-499b-875a-168d6f21626d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.156046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 785/1565] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:04 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:04.157365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb7f2a-279a-4f29-b1f6-ddb380ff07aa None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.157655 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb7f2a-279a-4f29-b1f6-ddb380ff07aa None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.157944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb7f2a-279a-4f29-b1f6-ddb380ff07aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.176445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-dbfb7f2a-279a-4f29-b1f6-ddb380ff07aa None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:04.177679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-dbfb7f2a-279a-4f29-b1f6-ddb380ff07aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:04.185689 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 786/1566] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:04.186447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb7f2a-279a-4f29-b1f6-ddb380ff07aa None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.195500 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb7f2a-279a-4f29-b1f6-ddb380ff07aa None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.199949 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161a733-caa7-4b2c-b618-42848845fd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.200578 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161a733-caa7-4b2c-b618-42848845fd12 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.200875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161a733-caa7-4b2c-b618-42848845fd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.201177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161a733-caa7-4b2c-b618-42848845fd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.201897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161a733-caa7-4b2c-b618-42848845fd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.203504 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161a733-caa7-4b2c-b618-42848845fd12 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.213302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 787/1567] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:04.214066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161a733-caa7-4b2c-b618-42848845fd12 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.223916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161a733-caa7-4b2c-b618-42848845fd12 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.228391 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b9db6-b50c-4010-b9a0-9782c65b933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.229041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b9db6-b50c-4010-b9a0-9782c65b933d admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.229329 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b9db6-b50c-4010-b9a0-9782c65b933d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.229611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b9db6-b50c-4010-b9a0-9782c65b933d admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.230306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b9db6-b50c-4010-b9a0-9782c65b933d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:04.230616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b9db6-b50c-4010-b9a0-9782c65b933d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.232837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b9db6-b50c-4010-b9a0-9782c65b933d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.239134 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 781/1568] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:04 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:04.239134 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7afec8-8389-499b-875a-168d6f21626d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.252113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 788/1569] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:46:04.252113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b9db6-b50c-4010-b9a0-9782c65b933d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.252408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7afec8-8389-499b-875a-168d6f21626d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.257265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24e9a3-1c74-43e7-b01d-3b09d264d48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.257421 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b9db6-b50c-4010-b9a0-9782c65b933d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.257936 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24e9a3-1c74-43e7-b01d-3b09d264d48a admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.258234 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24e9a3-1c74-43e7-b01d-3b09d264d48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.258523 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24e9a3-1c74-43e7-b01d-3b09d264d48a admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.259352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24e9a3-1c74-43e7-b01d-3b09d264d48a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:04.259786 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24e9a3-1c74-43e7-b01d-3b09d264d48a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.261544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24e9a3-1c74-43e7-b01d-3b09d264d48a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.261881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb4c78-c472-4bd9-b938-3a31812c3d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.262527 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb4c78-c472-4bd9-b938-3a31812c3d23 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.262814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb4c78-c472-4bd9-b938-3a31812c3d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.263641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb4c78-c472-4bd9-b938-3a31812c3d23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.264546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb4c78-c472-4bd9-b938-3a31812c3d23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:04.264850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb4c78-c472-4bd9-b938-3a31812c3d23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.266457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb4c78-c472-4bd9-b938-3a31812c3d23 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.275393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 782/1570] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:46:04.276434 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24e9a3-1c74-43e7-b01d-3b09d264d48a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.286973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 789/1571] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:46:04.286973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb4c78-c472-4bd9-b938-3a31812c3d23 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.290068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb4c78-c472-4bd9-b938-3a31812c3d23 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.292602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24e9a3-1c74-43e7-b01d-3b09d264d48a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.294909 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4edf2-8770-4111-9292-45e0d2c34d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.295571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4edf2-8770-4111-9292-45e0d2c34d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.295862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4edf2-8770-4111-9292-45e0d2c34d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.296142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4edf2-8770-4111-9292-45e0d2c34d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.296868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4edf2-8770-4111-9292-45e0d2c34d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.297770 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b4e2c-edad-4656-86b1-8548f3eedfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.298427 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b4e2c-edad-4656-86b1-8548f3eedfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.298546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4edf2-8770-4111-9292-45e0d2c34d77 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.298709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b4e2c-edad-4656-86b1-8548f3eedfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.298984 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b4e2c-edad-4656-86b1-8548f3eedfe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.299703 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b4e2c-edad-4656-86b1-8548f3eedfe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.301312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b4e2c-edad-4656-86b1-8548f3eedfe1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.309157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 790/1572] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:04.310000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4edf2-8770-4111-9292-45e0d2c34d77 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.312125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 783/1573] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:04.312816 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b4e2c-edad-4656-86b1-8548f3eedfe1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.319641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4edf2-8770-4111-9292-45e0d2c34d77 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.322304 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b4e2c-edad-4656-86b1-8548f3eedfe1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.324203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8e549-f6f2-41ed-9a48-a5cfbaed229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.324853 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8e549-f6f2-41ed-9a48-a5cfbaed229e admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.325172 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8e549-f6f2-41ed-9a48-a5cfbaed229e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.325463 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8e549-f6f2-41ed-9a48-a5cfbaed229e admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.326689 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8e549-f6f2-41ed-9a48-a5cfbaed229e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:04.327000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8e549-f6f2-41ed-9a48-a5cfbaed229e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.327607 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a6f00-1f24-460c-9617-9c505e57e159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.328256 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a6f00-1f24-460c-9617-9c505e57e159 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.328545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a6f00-1f24-460c-9617-9c505e57e159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.328662 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8e549-f6f2-41ed-9a48-a5cfbaed229e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.328821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a6f00-1f24-460c-9617-9c505e57e159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.329567 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a6f00-1f24-460c-9617-9c505e57e159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.331196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a6f00-1f24-460c-9617-9c505e57e159 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.348235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 791/1574] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:46:04.348440 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 784/1575] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:04.348545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8e549-f6f2-41ed-9a48-a5cfbaed229e admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.348645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a6f00-1f24-460c-9617-9c505e57e159 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.353547 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a6f00-1f24-460c-9617-9c505e57e159 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.354078 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8e549-f6f2-41ed-9a48-a5cfbaed229e admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.358686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aba50a-1d17-49f6-8ccf-453e1c264a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.359331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aba50a-1d17-49f6-8ccf-453e1c264a90 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.359452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1afe7-22b8-4681-95db-41eee501b86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.359667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aba50a-1d17-49f6-8ccf-453e1c264a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.359893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aba50a-1d17-49f6-8ccf-453e1c264a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.360069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1afe7-22b8-4681-95db-41eee501b86e admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.360384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1afe7-22b8-4681-95db-41eee501b86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.360580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aba50a-1d17-49f6-8ccf-453e1c264a90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.360674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1afe7-22b8-4681-95db-41eee501b86e admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.361417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1afe7-22b8-4681-95db-41eee501b86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.362505 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aba50a-1d17-49f6-8ccf-453e1c264a90 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.362998 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1afe7-22b8-4681-95db-41eee501b86e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.373841 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 792/1576] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:04.374624 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1afe7-22b8-4681-95db-41eee501b86e admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.384146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1afe7-22b8-4681-95db-41eee501b86e admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.388857 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f32b7-d9ae-4446-bdcb-ddd951357dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.389525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f32b7-d9ae-4446-bdcb-ddd951357dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.395216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f32b7-d9ae-4446-bdcb-ddd951357dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.395216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f32b7-d9ae-4446-bdcb-ddd951357dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.395216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f32b7-d9ae-4446-bdcb-ddd951357dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.395216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f32b7-d9ae-4446-bdcb-ddd951357dc9 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.480269 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 785/1577] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:04 2022] POST /identity/v3/projects => generated 393 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:04.481116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aba50a-1d17-49f6-8ccf-453e1c264a90 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.493882 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 793/1578] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:04 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:04.494954 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f32b7-d9ae-4446-bdcb-ddd951357dc9 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.545831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aba50a-1d17-49f6-8ccf-453e1c264a90 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.552407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:04.557236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f32b7-d9ae-4446-bdcb-ddd951357dc9 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.562991 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dec95c-7e7c-4bc2-bce8-0c2abaae18ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.564637 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dec95c-7e7c-4bc2-bce8-0c2abaae18ea admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.564637 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dec95c-7e7c-4bc2-bce8-0c2abaae18ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.564637 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dec95c-7e7c-4bc2-bce8-0c2abaae18ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.565080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dec95c-7e7c-4bc2-bce8-0c2abaae18ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.566697 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dec95c-7e7c-4bc2-bce8-0c2abaae18ea admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.576757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 794/1579] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:04.577780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dec95c-7e7c-4bc2-bce8-0c2abaae18ea admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.585253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:04.591083 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dec95c-7e7c-4bc2-bce8-0c2abaae18ea admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.595865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871db632-e3b4-4f52-993b-784c9ea9ce1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.596417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871db632-e3b4-4f52-993b-784c9ea9ce1b admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.596701 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871db632-e3b4-4f52-993b-784c9ea9ce1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.597071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871db632-e3b4-4f52-993b-784c9ea9ce1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.597819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871db632-e3b4-4f52-993b-784c9ea9ce1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.599413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871db632-e3b4-4f52-993b-784c9ea9ce1b admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.604282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b48eb-2a1b-402c-808d-863e9da55f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.604978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b48eb-2a1b-402c-808d-863e9da55f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.605281 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b48eb-2a1b-402c-808d-863e9da55f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.605551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b48eb-2a1b-402c-808d-863e9da55f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.606248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b48eb-2a1b-402c-808d-863e9da55f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.608841 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b48eb-2a1b-402c-808d-863e9da55f03 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.609816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 795/1580] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:04.610530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871db632-e3b4-4f52-993b-784c9ea9ce1b admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.620168 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871db632-e3b4-4f52-993b-784c9ea9ce1b admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.625550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aaa4b8-e321-490d-8f25-807313adb4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.627797 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaa4b8-e321-490d-8f25-807313adb4bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.627797 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaa4b8-e321-490d-8f25-807313adb4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.627797 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaa4b8-e321-490d-8f25-807313adb4bb admin admin] PATH_INFO: `/v3/projects/8d056d4e36b845a69c089b124c1b538f/users/6f0ce995acc646d88f47c92e8458931a/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.642161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aaa4b8-e321-490d-8f25-807313adb4bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d056d4e36b845a69c089b124c1b538f, user_id=6f0ce995acc646d88f47c92e8458931a, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.643247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: WARNING py.warnings [None req-03aaa4b8-e321-490d-8f25-807313adb4bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 17:46:04.643247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: warnings.warn(msg) Jun 01 17:46:04.643247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: Jun 01 17:46:04.645264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aaa4b8-e321-490d-8f25-807313adb4bb admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.755161 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 786/1581] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:04 2022] POST /identity/v3/projects => generated 369 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:04.755992 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b48eb-2a1b-402c-808d-863e9da55f03 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.771233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 796/1582] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:04 2022] PUT /identity/v3/projects/8d056d4e36b845a69c089b124c1b538f/users/6f0ce995acc646d88f47c92e8458931a/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:04.775050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aaa4b8-e321-490d-8f25-807313adb4bb admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.818432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b48eb-2a1b-402c-808d-863e9da55f03 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.836644 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aaa4b8-e321-490d-8f25-807313adb4bb admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.842597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e592122-9608-4142-a53e-379c1c6c9e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.843299 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e592122-9608-4142-a53e-379c1c6c9e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.843700 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e592122-9608-4142-a53e-379c1c6c9e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.843984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e592122-9608-4142-a53e-379c1c6c9e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.844778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e592122-9608-4142-a53e-379c1c6c9e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.846469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e592122-9608-4142-a53e-379c1c6c9e33 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.856671 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 797/1583] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:04.881270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e592122-9608-4142-a53e-379c1c6c9e33 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:04.881270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e592122-9608-4142-a53e-379c1c6c9e33 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:04.881270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620daeee-9ba3-4018-9f82-c8fcd360c24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.881270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620daeee-9ba3-4018-9f82-c8fcd360c24b admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.881703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620daeee-9ba3-4018-9f82-c8fcd360c24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.881703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620daeee-9ba3-4018-9f82-c8fcd360c24b admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.881703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620daeee-9ba3-4018-9f82-c8fcd360c24b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.881703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620daeee-9ba3-4018-9f82-c8fcd360c24b admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.882067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63b1e8-c78f-49b8-aa90-5cbbe2c09ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:04.882067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63b1e8-c78f-49b8-aa90-5cbbe2c09ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:04.882067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63b1e8-c78f-49b8-aa90-5cbbe2c09ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:04.882067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63b1e8-c78f-49b8-aa90-5cbbe2c09ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:04.882426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63b1e8-c78f-49b8-aa90-5cbbe2c09ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:04.882426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63b1e8-c78f-49b8-aa90-5cbbe2c09ee6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:04.995956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 798/1584] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:04 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:04.995956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620daeee-9ba3-4018-9f82-c8fcd360c24b admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.003521 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620daeee-9ba3-4018-9f82-c8fcd360c24b admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.008061 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4673c2-53be-4532-8a86-805b328049bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.008719 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4673c2-53be-4532-8a86-805b328049bc admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.009092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4673c2-53be-4532-8a86-805b328049bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.009372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4673c2-53be-4532-8a86-805b328049bc admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.010047 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4673c2-53be-4532-8a86-805b328049bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.011989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4673c2-53be-4532-8a86-805b328049bc admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.018220 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 787/1585] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:04 2022] POST /identity/v3/projects => generated 405 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:05.018989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63b1e8-c78f-49b8-aa90-5cbbe2c09ee6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.076600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:05.080490 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63b1e8-c78f-49b8-aa90-5cbbe2c09ee6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.085268 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea144ff-21e0-4c74-bb8e-7eafb4bc3728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.086152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea144ff-21e0-4c74-bb8e-7eafb4bc3728 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.086438 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea144ff-21e0-4c74-bb8e-7eafb4bc3728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.086713 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea144ff-21e0-4c74-bb8e-7eafb4bc3728 admin admin] PATH_INFO: `/v3/projects/3206503b47eb4a098fb233aa8bd39332/users/7e29d3b37ec342fe91765a8b13354bf3/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.101699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea144ff-21e0-4c74-bb8e-7eafb4bc3728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3206503b47eb4a098fb233aa8bd39332, user_id=7e29d3b37ec342fe91765a8b13354bf3, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.104357 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea144ff-21e0-4c74-bb8e-7eafb4bc3728 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.115738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 799/1586] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:04 2022] POST /identity/v3/users => generated 283 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:05.116713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4673c2-53be-4532-8a86-805b328049bc admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.126417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4673c2-53be-4532-8a86-805b328049bc admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.131075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610b732-59c7-4e8f-a5a9-f8c17d5e7af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.132010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610b732-59c7-4e8f-a5a9-f8c17d5e7af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.132227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610b732-59c7-4e8f-a5a9-f8c17d5e7af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.132505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610b732-59c7-4e8f-a5a9-f8c17d5e7af1 admin admin] PATH_INFO: `/v3/projects/5510e48bc3c1405aa910de5b4f190f68/users/99c1a6461d5c47c7869f0cf45e98ef9a/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.147661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610b732-59c7-4e8f-a5a9-f8c17d5e7af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5510e48bc3c1405aa910de5b4f190f68, user_id=99c1a6461d5c47c7869f0cf45e98ef9a, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.150373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610b732-59c7-4e8f-a5a9-f8c17d5e7af1 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.235332 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 788/1587] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:05 2022] PUT /identity/v3/projects/3206503b47eb4a098fb233aa8bd39332/users/7e29d3b37ec342fe91765a8b13354bf3/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:05.236146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea144ff-21e0-4c74-bb8e-7eafb4bc3728 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.264798 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 800/1588] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:05 2022] PUT /identity/v3/projects/5510e48bc3c1405aa910de5b4f190f68/users/99c1a6461d5c47c7869f0cf45e98ef9a/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:05.266143 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d1255-7d15-4181-9f92-0bb09faf19ca None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.266439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d1255-7d15-4181-9f92-0bb09faf19ca None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.266752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d1255-7d15-4181-9f92-0bb09faf19ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.284208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b27d1255-7d15-4181-9f92-0bb09faf19ca None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:05.285507 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b27d1255-7d15-4181-9f92-0bb09faf19ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:05.297168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea144ff-21e0-4c74-bb8e-7eafb4bc3728 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.332588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:05.345828 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 801/1589] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:05.354001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d1255-7d15-4181-9f92-0bb09faf19ca None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.354675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfb575-eefe-42fc-b759-86c0806e4fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.355784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfb575-eefe-42fc-b759-86c0806e4fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.355937 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d1255-7d15-4181-9f92-0bb09faf19ca None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.356074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfb575-eefe-42fc-b759-86c0806e4fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.356358 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfb575-eefe-42fc-b759-86c0806e4fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.357859 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfb575-eefe-42fc-b759-86c0806e4fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.359865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfb575-eefe-42fc-b759-86c0806e4fe8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.360689 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ac4f6-b672-4629-87f6-c4f525861c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.361591 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ac4f6-b672-4629-87f6-c4f525861c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.361872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ac4f6-b672-4629-87f6-c4f525861c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.362142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ac4f6-b672-4629-87f6-c4f525861c4f admin admin] PATH_INFO: `/v3/projects/f426daa6be834c7e9596e5f9f73d5542/users/7ffcb10672664b33a47e3a3ee7bb9e23/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.378184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ac4f6-b672-4629-87f6-c4f525861c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f426daa6be834c7e9596e5f9f73d5542, user_id=7ffcb10672664b33a47e3a3ee7bb9e23, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.380853 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ac4f6-b672-4629-87f6-c4f525861c4f admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.444673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 789/1590] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:05 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:05.444673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfb575-eefe-42fc-b759-86c0806e4fe8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.452772 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfb575-eefe-42fc-b759-86c0806e4fe8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.453863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 802/1591] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:05 2022] PUT /identity/v3/projects/f426daa6be834c7e9596e5f9f73d5542/users/7ffcb10672664b33a47e3a3ee7bb9e23/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:05.454736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ac4f6-b672-4629-87f6-c4f525861c4f admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.521771 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fea285-f53b-4f0e-b910-089ffe9eace3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.522484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fea285-f53b-4f0e-b910-089ffe9eace3 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.522773 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fea285-f53b-4f0e-b910-089ffe9eace3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.523055 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fea285-f53b-4f0e-b910-089ffe9eace3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.523817 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fea285-f53b-4f0e-b910-089ffe9eace3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.525487 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fea285-f53b-4f0e-b910-089ffe9eace3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.529943 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ac4f6-b672-4629-87f6-c4f525861c4f admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.534584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48887433-c060-413d-834f-1d15b963be9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.535259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48887433-c060-413d-834f-1d15b963be9d admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.535544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48887433-c060-413d-834f-1d15b963be9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.535694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 790/1592] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:05.535823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48887433-c060-413d-834f-1d15b963be9d admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.536500 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fea285-f53b-4f0e-b910-089ffe9eace3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.536604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48887433-c060-413d-834f-1d15b963be9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.538721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48887433-c060-413d-834f-1d15b963be9d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.548140 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fea285-f53b-4f0e-b910-089ffe9eace3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.552782 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c20fb6-f999-4e2c-a641-5f80bdb47802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.553466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c20fb6-f999-4e2c-a641-5f80bdb47802 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.560478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c20fb6-f999-4e2c-a641-5f80bdb47802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.560478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c20fb6-f999-4e2c-a641-5f80bdb47802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.560478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c20fb6-f999-4e2c-a641-5f80bdb47802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.560478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c20fb6-f999-4e2c-a641-5f80bdb47802 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.567087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 791/1593] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:05.568286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a2ebb-cec9-4a89-8790-984986ed890c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.568578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a2ebb-cec9-4a89-8790-984986ed890c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.568858 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a2ebb-cec9-4a89-8790-984986ed890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.574389 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:05.586716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5a8a2ebb-cec9-4a89-8790-984986ed890c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:05.587910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5a8a2ebb-cec9-4a89-8790-984986ed890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:05.596130 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 792/1594] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:05.597379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c659aa9-8654-47c4-b01b-233db0d029c6 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.597669 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c659aa9-8654-47c4-b01b-233db0d029c6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.597951 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c659aa9-8654-47c4-b01b-233db0d029c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.615148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-3c659aa9-8654-47c4-b01b-233db0d029c6 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:05.616319 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3c659aa9-8654-47c4-b01b-233db0d029c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:05.624484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 793/1595] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:05.625274 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c659aa9-8654-47c4-b01b-233db0d029c6 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.633790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 803/1596] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:05 2022] POST /identity/v3/users => generated 303 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:05.634692 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48887433-c060-413d-834f-1d15b963be9d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.644644 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48887433-c060-413d-834f-1d15b963be9d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.650876 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6fb57-3eab-4004-b509-7db8672a822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.651542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6fb57-3eab-4004-b509-7db8672a822c admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.651834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6fb57-3eab-4004-b509-7db8672a822c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.652118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6fb57-3eab-4004-b509-7db8672a822c admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.652855 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6fb57-3eab-4004-b509-7db8672a822c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.655096 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6fb57-3eab-4004-b509-7db8672a822c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.665176 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 804/1597] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:05.666458 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcf8cc-10ad-4f37-8e45-f5f659b1e23e None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.666747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcf8cc-10ad-4f37-8e45-f5f659b1e23e None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.667264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcf8cc-10ad-4f37-8e45-f5f659b1e23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.681270 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c659aa9-8654-47c4-b01b-233db0d029c6 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.684753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ed2ac-72bc-4ea0-aa64-4a82eaa98d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.685980 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ed2ac-72bc-4ea0-aa64-4a82eaa98d87 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.686270 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ed2ac-72bc-4ea0-aa64-4a82eaa98d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.686555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ed2ac-72bc-4ea0-aa64-4a82eaa98d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.694952 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-62bcf8cc-10ad-4f37-8e45-f5f659b1e23e None None] MFA Rules not processed for user `7ffcb10672664b33a47e3a3ee7bb9e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:05.695809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ed2ac-72bc-4ea0-aa64-4a82eaa98d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.696132 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-62bcf8cc-10ad-4f37-8e45-f5f659b1e23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:05.697426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ed2ac-72bc-4ea0-aa64-4a82eaa98d87 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.712826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 794/1598] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:05.713842 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ed2ac-72bc-4ea0-aa64-4a82eaa98d87 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.724271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ed2ac-72bc-4ea0-aa64-4a82eaa98d87 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.730445 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9353af0-88ac-4471-899c-735b5e60217f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.731288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9353af0-88ac-4471-899c-735b5e60217f admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.732658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9353af0-88ac-4471-899c-735b5e60217f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.732973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9353af0-88ac-4471-899c-735b5e60217f admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.733731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9353af0-88ac-4471-899c-735b5e60217f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.735357 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9353af0-88ac-4471-899c-735b5e60217f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.749901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 795/1599] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:05.749901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9353af0-88ac-4471-899c-735b5e60217f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.757135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9353af0-88ac-4471-899c-735b5e60217f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.761660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6bce-3f66-4ba1-bdb7-de972b1219fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.762310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6bce-3f66-4ba1-bdb7-de972b1219fc admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.762595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6bce-3f66-4ba1-bdb7-de972b1219fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.762877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be6bce-3f66-4ba1-bdb7-de972b1219fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.764352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be6bce-3f66-4ba1-bdb7-de972b1219fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.765998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be6bce-3f66-4ba1-bdb7-de972b1219fc admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.767664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 805/1600] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:05.768577 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcf8cc-10ad-4f37-8e45-f5f659b1e23e None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.769908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-62bcf8cc-10ad-4f37-8e45-f5f659b1e23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:05.784577 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 796/1601] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:05.784741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcf8cc-10ad-4f37-8e45-f5f659b1e23e None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.784839 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6bce-3f66-4ba1-bdb7-de972b1219fc admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.786420 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a050e-3899-462f-b6b0-9a7efc58aef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.787184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a050e-3899-462f-b6b0-9a7efc58aef0 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.787383 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a050e-3899-462f-b6b0-9a7efc58aef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.787760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a050e-3899-462f-b6b0-9a7efc58aef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.793100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be6bce-3f66-4ba1-bdb7-de972b1219fc admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.798214 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a050e-3899-462f-b6b0-9a7efc58aef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.799918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a050e-3899-462f-b6b0-9a7efc58aef0 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.800044 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8906f53-e8fa-4191-807e-ca6a22079c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.800638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8906f53-e8fa-4191-807e-ca6a22079c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.800930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8906f53-e8fa-4191-807e-ca6a22079c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.801276 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8906f53-e8fa-4191-807e-ca6a22079c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.802072 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8906f53-e8fa-4191-807e-ca6a22079c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.803669 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8906f53-e8fa-4191-807e-ca6a22079c74 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.814468 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 806/1602] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:05.814468 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a050e-3899-462f-b6b0-9a7efc58aef0 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.820950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a050e-3899-462f-b6b0-9a7efc58aef0 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.824508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 797/1603] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:05.824508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8906f53-e8fa-4191-807e-ca6a22079c74 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.827125 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ba7b6-83bf-4b36-889a-5cc7fbd8adff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.827783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ba7b6-83bf-4b36-889a-5cc7fbd8adff service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.828064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ba7b6-83bf-4b36-889a-5cc7fbd8adff service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.828338 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ba7b6-83bf-4b36-889a-5cc7fbd8adff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.837080 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8906f53-e8fa-4191-807e-ca6a22079c74 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.838451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ba7b6-83bf-4b36-889a-5cc7fbd8adff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.840414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ba7b6-83bf-4b36-889a-5cc7fbd8adff service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.842633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a33fc-3756-47b5-b6b1-8d6384216771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.843442 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a33fc-3756-47b5-b6b1-8d6384216771 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.843728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a33fc-3756-47b5-b6b1-8d6384216771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.844268 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a33fc-3756-47b5-b6b1-8d6384216771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.845089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a33fc-3756-47b5-b6b1-8d6384216771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.848717 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a33fc-3756-47b5-b6b1-8d6384216771 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.852828 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 807/1604] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:05.853706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ba7b6-83bf-4b36-889a-5cc7fbd8adff service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.858907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 798/1605] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:05.859754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a33fc-3756-47b5-b6b1-8d6384216771 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:05.867690 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ba7b6-83bf-4b36-889a-5cc7fbd8adff service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.873468 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14872b4e-4b78-446a-a949-3cfa54ef0c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.874775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14872b4e-4b78-446a-a949-3cfa54ef0c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.877789 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14872b4e-4b78-446a-a949-3cfa54ef0c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.877789 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14872b4e-4b78-446a-a949-3cfa54ef0c9d admin admin] PATH_INFO: `/v3/projects/4f02f0e87ef1498a836b2e1d3bb842cf/users/6863a714f4cf4350940d638c82fbc650/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.878021 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a33fc-3756-47b5-b6b1-8d6384216771 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:05.881347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61e20c-6c66-4281-9d97-1f4c6c3b29ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:05.882247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61e20c-6c66-4281-9d97-1f4c6c3b29ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:05.882530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61e20c-6c66-4281-9d97-1f4c6c3b29ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:05.882803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61e20c-6c66-4281-9d97-1f4c6c3b29ba admin admin] PATH_INFO: `/v3/projects/4aaa73c27b284b01b6465b2103280827/users/244da1ff5fc347978e237e4eb45f7741/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:05.886904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:05.894161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14872b4e-4b78-446a-a949-3cfa54ef0c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f02f0e87ef1498a836b2e1d3bb842cf, user_id=6863a714f4cf4350940d638c82fbc650, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.897545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14872b4e-4b78-446a-a949-3cfa54ef0c9d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:05.899315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61e20c-6c66-4281-9d97-1f4c6c3b29ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aaa73c27b284b01b6465b2103280827, user_id=244da1ff5fc347978e237e4eb45f7741, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:05.902108 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61e20c-6c66-4281-9d97-1f4c6c3b29ba admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:06.017420 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 799/1606] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:05 2022] PUT /identity/v3/projects/4aaa73c27b284b01b6465b2103280827/users/244da1ff5fc347978e237e4eb45f7741/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:06.019287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9d32a-8bfd-4469-beff-6787c77fa2f5 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:06.020047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9d32a-8bfd-4469-beff-6787c77fa2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:06.020539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9d32a-8bfd-4469-beff-6787c77fa2f5 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:06.021334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 808/1607] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:05 2022] PUT /identity/v3/projects/4f02f0e87ef1498a836b2e1d3bb842cf/users/6863a714f4cf4350940d638c82fbc650/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:06.022378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14872b4e-4b78-446a-a949-3cfa54ef0c9d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:06.025424 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 800/1608] 10.222.0.33 () {54 vars in 961 bytes} [Wed Jun 1 17:46:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:46:06.025913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9d32a-8bfd-4469-beff-6787c77fa2f5 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:06.102045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14872b4e-4b78-446a-a949-3cfa54ef0c9d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:06.110751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c88a7a-872f-4a24-83bb-d1b476fdc5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:06.111506 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c88a7a-872f-4a24-83bb-d1b476fdc5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:06.112379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c88a7a-872f-4a24-83bb-d1b476fdc5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:06.112675 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c88a7a-872f-4a24-83bb-d1b476fdc5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:06.112847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9d32a-8bfd-4469-beff-6787c77fa2f5 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:06.113529 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c88a7a-872f-4a24-83bb-d1b476fdc5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:06.115573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c88a7a-872f-4a24-83bb-d1b476fdc5b0 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:06.119472 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb8601-9f2c-47c0-816b-44b25eadca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:06.120382 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb8601-9f2c-47c0-816b-44b25eadca28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:06.120965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb8601-9f2c-47c0-816b-44b25eadca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:06.123855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb8601-9f2c-47c0-816b-44b25eadca28 admin admin] PATH_INFO: `/v3/projects/62797492bc2f4fc58c771976e7c63a12/users/9cc817eba28f4c6189773b4aab7a45c4/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:06.132668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 809/1609] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:06.132668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3478c-a416-4e51-a17d-4c646d8897ef None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:06.132668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3478c-a416-4e51-a17d-4c646d8897ef None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:06.132668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3478c-a416-4e51-a17d-4c646d8897ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:06.150103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb8601-9f2c-47c0-816b-44b25eadca28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62797492bc2f4fc58c771976e7c63a12, user_id=9cc817eba28f4c6189773b4aab7a45c4, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:06.152149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-4fd3478c-a416-4e51-a17d-4c646d8897ef None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:06.153469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4fd3478c-a416-4e51-a17d-4c646d8897ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:06.155488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb8601-9f2c-47c0-816b-44b25eadca28 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:06.165139 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 810/1610] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:06.170360 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de065ce-e2fa-433c-992b-18a166d88f65 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:06.170360 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de065ce-e2fa-433c-992b-18a166d88f65 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:06.170360 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de065ce-e2fa-433c-992b-18a166d88f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:06.188433 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-5de065ce-e2fa-433c-992b-18a166d88f65 None None] MFA Rules not processed for user `5d5a5ba6aecd46e79dc7199589384a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:06.189773 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-5de065ce-e2fa-433c-992b-18a166d88f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:06.264967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 801/1611] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:06 2022] PUT /identity/v3/projects/62797492bc2f4fc58c771976e7c63a12/users/9cc817eba28f4c6189773b4aab7a45c4/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:06.264967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36c98f-6983-484b-94c5-d5ecd019d137 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:06.264967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36c98f-6983-484b-94c5-d5ecd019d137 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:06.264967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36c98f-6983-484b-94c5-d5ecd019d137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:06.268859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 811/1612] 10.222.0.33 () {58 vars in 1058 bytes} [Wed Jun 1 17:46:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:06.269849 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de065ce-e2fa-433c-992b-18a166d88f65 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:06.277568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:06.283707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de065ce-e2fa-433c-992b-18a166d88f65 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:06.296967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-df36c98f-6983-484b-94c5-d5ecd019d137 None None] MFA Rules not processed for user `244da1ff5fc347978e237e4eb45f7741`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:06.297485 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-df36c98f-6983-484b-94c5-d5ecd019d137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:06.370598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 802/1613] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:06.370598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36c98f-6983-484b-94c5-d5ecd019d137 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:06.400802 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9840b-cd73-4de3-9fe5-a1b9b3cec55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:06.401966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9840b-cd73-4de3-9fe5-a1b9b3cec55a admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:06.402257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9840b-cd73-4de3-9fe5-a1b9b3cec55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:06.402536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9840b-cd73-4de3-9fe5-a1b9b3cec55a admin admin] PATH_INFO: `/v3/projects/5319be794fde45c3a86c20248d6b2b41/users/c1a39d30e6b7401cbb8f63677f37a13c/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:06.417696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:06.422320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9840b-cd73-4de3-9fe5-a1b9b3cec55a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5319be794fde45c3a86c20248d6b2b41, user_id=c1a39d30e6b7401cbb8f63677f37a13c, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:06.426001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9840b-cd73-4de3-9fe5-a1b9b3cec55a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:06.426356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36c98f-6983-484b-94c5-d5ecd019d137 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:06.431681 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8671e-bdeb-4737-917e-58bac08700d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:06.432354 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8671e-bdeb-4737-917e-58bac08700d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:06.432667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8671e-bdeb-4737-917e-58bac08700d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:06.433251 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8671e-bdeb-4737-917e-58bac08700d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:06.446211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8671e-bdeb-4737-917e-58bac08700d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:06.447867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8671e-bdeb-4737-917e-58bac08700d1 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:06.462705 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 803/1614] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:06.464829 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5333995-5919-4c7f-aa77-f029a83faa90 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:06.465184 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5333995-5919-4c7f-aa77-f029a83faa90 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:06.465521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5333995-5919-4c7f-aa77-f029a83faa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:06.494587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c5333995-5919-4c7f-aa77-f029a83faa90 None None] MFA Rules not processed for user `9cc817eba28f4c6189773b4aab7a45c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:06.495785 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c5333995-5919-4c7f-aa77-f029a83faa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:06.521696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 812/1615] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:06 2022] PUT /identity/v3/projects/5319be794fde45c3a86c20248d6b2b41/users/c1a39d30e6b7401cbb8f63677f37a13c/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:06.522673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9840b-cd73-4de3-9fe5-a1b9b3cec55a admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:06.585033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 804/1616] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:06.586863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5333995-5919-4c7f-aa77-f029a83faa90 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:06.608927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5333995-5919-4c7f-aa77-f029a83faa90 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:06.650483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9840b-cd73-4de3-9fe5-a1b9b3cec55a admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:06.658679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533ab29-5416-4d67-9af1-1ff2aa571e00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:06.659970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533ab29-5416-4d67-9af1-1ff2aa571e00 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:06.660234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533ab29-5416-4d67-9af1-1ff2aa571e00 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:06.660511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533ab29-5416-4d67-9af1-1ff2aa571e00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:06.663052 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:06.690145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1779f5-aead-4859-8e23-c4ad14e1168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:06.701729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1779f5-aead-4859-8e23-c4ad14e1168b admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:06.702085 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1779f5-aead-4859-8e23-c4ad14e1168b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:06.702349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1779f5-aead-4859-8e23-c4ad14e1168b admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:06.703594 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1779f5-aead-4859-8e23-c4ad14e1168b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:06.705816 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1779f5-aead-4859-8e23-c4ad14e1168b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:06.756219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533ab29-5416-4d67-9af1-1ff2aa571e00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:06.758556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533ab29-5416-4d67-9af1-1ff2aa571e00 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:06.786300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 813/1617] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:06.790461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a8abc-bd71-4414-ac3d-13ec48ae021e None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:06.792069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a8abc-bd71-4414-ac3d-13ec48ae021e None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:06.792393 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a8abc-bd71-4414-ac3d-13ec48ae021e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:06.819018 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-537a8abc-bd71-4414-ac3d-13ec48ae021e None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:06.820236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-537a8abc-bd71-4414-ac3d-13ec48ae021e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:06.828398 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 805/1618] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:06 2022] POST /identity/v3/projects => generated 365 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:06.829358 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1779f5-aead-4859-8e23-c4ad14e1168b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:06.835598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 814/1619] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:06.835598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a8abc-bd71-4414-ac3d-13ec48ae021e None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:06.855361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a8abc-bd71-4414-ac3d-13ec48ae021e None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:06.961603 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1779f5-aead-4859-8e23-c4ad14e1168b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:06.975914 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2c7a9-7c5e-415c-afe4-0b0baf62fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:06.976884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0a387-00c2-4d22-a555-e660fb94b20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:06.982846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2c7a9-7c5e-415c-afe4-0b0baf62fdfd admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:06.982846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2c7a9-7c5e-415c-afe4-0b0baf62fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:06.982846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2c7a9-7c5e-415c-afe4-0b0baf62fdfd admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:06.983163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0a387-00c2-4d22-a555-e660fb94b20f admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:06.983163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0a387-00c2-4d22-a555-e660fb94b20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:06.983163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0a387-00c2-4d22-a555-e660fb94b20f admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:06.983422 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2c7a9-7c5e-415c-afe4-0b0baf62fdfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:06.983523 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0a387-00c2-4d22-a555-e660fb94b20f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:06.983613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2c7a9-7c5e-415c-afe4-0b0baf62fdfd admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:06.983701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0a387-00c2-4d22-a555-e660fb94b20f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:07.070868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 815/1620] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:06 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:07.072176 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2c7a9-7c5e-415c-afe4-0b0baf62fdfd admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:07.087494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:07.131451 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 806/1621] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:06 2022] POST /identity/v3/projects => generated 369 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:07.132828 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd4291-1539-4c2c-b549-5e95e9ab66f7 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:07.133147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd4291-1539-4c2c-b549-5e95e9ab66f7 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:07.133387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2c7a9-7c5e-415c-afe4-0b0baf62fdfd admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:07.133506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd4291-1539-4c2c-b549-5e95e9ab66f7 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:07.137073 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 807/1622] 10.222.0.33 () {54 vars in 912 bytes} [Wed Jun 1 17:46:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:46:07.137678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd4291-1539-4c2c-b549-5e95e9ab66f7 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:07.200277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e0677-2b73-456e-b57a-35e79a49ffa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:07.201633 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e0677-2b73-456e-b57a-35e79a49ffa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:07.202130 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e0677-2b73-456e-b57a-35e79a49ffa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:07.202422 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e0677-2b73-456e-b57a-35e79a49ffa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:07.275380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd4291-1539-4c2c-b549-5e95e9ab66f7 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:07.281175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4f1df-66e1-4e1f-88c5-5fcd2e5e953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:07.281861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4f1df-66e1-4e1f-88c5-5fcd2e5e953c admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:07.282148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4f1df-66e1-4e1f-88c5-5fcd2e5e953c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:07.282454 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4f1df-66e1-4e1f-88c5-5fcd2e5e953c admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:07.283166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4f1df-66e1-4e1f-88c5-5fcd2e5e953c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:07.283383 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e0677-2b73-456e-b57a-35e79a49ffa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:07.284787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf4f1df-66e1-4e1f-88c5-5fcd2e5e953c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:07.285136 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e0677-2b73-456e-b57a-35e79a49ffa4 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:07.298133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 816/1623] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:07.298599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 808/1624] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:07.299154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e0677-2b73-456e-b57a-35e79a49ffa4 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:07.308458 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98860873-7988-4537-b46f-a913aeb49806 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:07.308752 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98860873-7988-4537-b46f-a913aeb49806 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:07.309069 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98860873-7988-4537-b46f-a913aeb49806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:07.311233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e0677-2b73-456e-b57a-35e79a49ffa4 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:07.316749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33050e2f-49b9-4f15-8ad5-99c077c399d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:07.317892 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33050e2f-49b9-4f15-8ad5-99c077c399d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:07.318286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33050e2f-49b9-4f15-8ad5-99c077c399d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:07.318669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33050e2f-49b9-4f15-8ad5-99c077c399d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:07.319563 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33050e2f-49b9-4f15-8ad5-99c077c399d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:07.322031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33050e2f-49b9-4f15-8ad5-99c077c399d0 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:07.330424 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-98860873-7988-4537-b46f-a913aeb49806 None None] MFA Rules not processed for user `5d5a5ba6aecd46e79dc7199589384a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:07.331651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-98860873-7988-4537-b46f-a913aeb49806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:07.364376 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:07.401298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 809/1625] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jun 1 17:46:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:07.402250 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98860873-7988-4537-b46f-a913aeb49806 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:07.415842 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98860873-7988-4537-b46f-a913aeb49806 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:07.423733 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785a4e5-e635-4dfa-88c3-4eb16c0400ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:07.426484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785a4e5-e635-4dfa-88c3-4eb16c0400ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:07.426484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785a4e5-e635-4dfa-88c3-4eb16c0400ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:07.426484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785a4e5-e635-4dfa-88c3-4eb16c0400ac admin admin] PATH_INFO: `/v3/projects/2027f25f1eaf49f3a0b7285300b8aeb3/users/ec46c70c26274919a7b33b0136ef86df/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:07.444095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785a4e5-e635-4dfa-88c3-4eb16c0400ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2027f25f1eaf49f3a0b7285300b8aeb3, user_id=ec46c70c26274919a7b33b0136ef86df, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:07.446767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785a4e5-e635-4dfa-88c3-4eb16c0400ac admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:07.489654 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 817/1626] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:07 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:07.489654 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33050e2f-49b9-4f15-8ad5-99c077c399d0 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:07.568332 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 810/1627] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:07 2022] PUT /identity/v3/projects/2027f25f1eaf49f3a0b7285300b8aeb3/users/ec46c70c26274919a7b33b0136ef86df/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:07.569729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785a4e5-e635-4dfa-88c3-4eb16c0400ac admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:07.627214 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33050e2f-49b9-4f15-8ad5-99c077c399d0 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:07.699011 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785a4e5-e635-4dfa-88c3-4eb16c0400ac admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:07.705352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c43a9c-acb7-42fe-9c8a-12ac4ca24164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:07.706108 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c43a9c-acb7-42fe-9c8a-12ac4ca24164 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:07.706325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c43a9c-acb7-42fe-9c8a-12ac4ca24164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:07.706607 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c43a9c-acb7-42fe-9c8a-12ac4ca24164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:07.707416 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c43a9c-acb7-42fe-9c8a-12ac4ca24164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:07.709266 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c43a9c-acb7-42fe-9c8a-12ac4ca24164 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:07.719364 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95792b85-22c0-4c76-be68-b1dec2da8b7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:07.721052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95792b85-22c0-4c76-be68-b1dec2da8b7d service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:07.724406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 811/1628] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:07.724406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c43a9c-acb7-42fe-9c8a-12ac4ca24164 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:07.725780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95792b85-22c0-4c76-be68-b1dec2da8b7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:07.727792 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95792b85-22c0-4c76-be68-b1dec2da8b7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:07.733569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c43a9c-acb7-42fe-9c8a-12ac4ca24164 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:07.738764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52fc3e-5c92-44b1-950b-52a04f921150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:07.739241 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52fc3e-5c92-44b1-950b-52a04f921150 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:07.739442 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52fc3e-5c92-44b1-950b-52a04f921150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:07.739717 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52fc3e-5c92-44b1-950b-52a04f921150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:07.740594 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52fc3e-5c92-44b1-950b-52a04f921150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:07.742737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52fc3e-5c92-44b1-950b-52a04f921150 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:07.757157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 812/1629] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:07.760461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab5233-8920-4621-bd27-39cdd6479d15 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:07.762379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab5233-8920-4621-bd27-39cdd6479d15 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:07.764324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab5233-8920-4621-bd27-39cdd6479d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:07.806905 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:07.869005 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-faab5233-8920-4621-bd27-39cdd6479d15 None None] MFA Rules not processed for user `99c1a6461d5c47c7869f0cf45e98ef9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:07.870253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-faab5233-8920-4621-bd27-39cdd6479d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:07.919334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95792b85-22c0-4c76-be68-b1dec2da8b7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:07.920350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95792b85-22c0-4c76-be68-b1dec2da8b7d service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:07.942380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 818/1630] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:07.943243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95792b85-22c0-4c76-be68-b1dec2da8b7d service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:07.994984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95792b85-22c0-4c76-be68-b1dec2da8b7d service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:08.017694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45d0bc-c0ef-402e-ad7a-2892e05ee759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:08.018634 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45d0bc-c0ef-402e-ad7a-2892e05ee759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:08.018928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45d0bc-c0ef-402e-ad7a-2892e05ee759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:08.019207 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45d0bc-c0ef-402e-ad7a-2892e05ee759 admin admin] PATH_INFO: `/v3/projects/ff9ee742475441ebb4f737d503220892/users/d2b19db1f76644838a24c2e7dfc9ca85/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:08.061445 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 813/1631] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:08.061445 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab5233-8920-4621-bd27-39cdd6479d15 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:08.075954 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45d0bc-c0ef-402e-ad7a-2892e05ee759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9ee742475441ebb4f737d503220892, user_id=d2b19db1f76644838a24c2e7dfc9ca85, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:08.081090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45d0bc-c0ef-402e-ad7a-2892e05ee759 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:08.098087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab5233-8920-4621-bd27-39cdd6479d15 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:08.115413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0169bd7-4287-4e05-b2d2-1f8a29a76158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:08.116341 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169bd7-4287-4e05-b2d2-1f8a29a76158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:08.116651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169bd7-4287-4e05-b2d2-1f8a29a76158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:08.116899 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169bd7-4287-4e05-b2d2-1f8a29a76158 admin admin] PATH_INFO: `/v3/projects/2027f25f1eaf49f3a0b7285300b8aeb3/users/ec46c70c26274919a7b33b0136ef86df/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:08.126458 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0169bd7-4287-4e05-b2d2-1f8a29a76158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2027f25f1eaf49f3a0b7285300b8aeb3, user_id=ec46c70c26274919a7b33b0136ef86df, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:08.129133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0169bd7-4287-4e05-b2d2-1f8a29a76158 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:08.159850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 814/1632] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:08 2022] PUT /identity/v3/projects/2027f25f1eaf49f3a0b7285300b8aeb3/users/ec46c70c26274919a7b33b0136ef86df/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:08.159850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbe084-0866-4571-92c4-bf44bf09e774 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:08.159850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbe084-0866-4571-92c4-bf44bf09e774 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:08.159850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbe084-0866-4571-92c4-bf44bf09e774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:08.180424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 819/1633] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:07 2022] PUT /identity/v3/projects/ff9ee742475441ebb4f737d503220892/users/d2b19db1f76644838a24c2e7dfc9ca85/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:08.181941 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab94f69-7cb5-44fb-b651-0f19b66414fe None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:08.182235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab94f69-7cb5-44fb-b651-0f19b66414fe None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:08.184234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab94f69-7cb5-44fb-b651-0f19b66414fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:08.194237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-31dbe084-0866-4571-92c4-bf44bf09e774 None None] MFA Rules not processed for user `99c1a6461d5c47c7869f0cf45e98ef9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:08.195847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-31dbe084-0866-4571-92c4-bf44bf09e774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:08.205629 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:08.249837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-8ab94f69-7cb5-44fb-b651-0f19b66414fe None None] MFA Rules not processed for user `ec46c70c26274919a7b33b0136ef86df`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:08.251101 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8ab94f69-7cb5-44fb-b651-0f19b66414fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:08.324597 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 815/1634] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:08.325760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbe084-0866-4571-92c4-bf44bf09e774 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:08.410822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 820/1635] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:08.416384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b6c7b-c925-4e90-9627-cb213f5958f7 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:08.416384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b6c7b-c925-4e90-9627-cb213f5958f7 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:08.416384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b6c7b-c925-4e90-9627-cb213f5958f7 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:08.428708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 821/1636] 10.222.0.33 () {54 vars in 961 bytes} [Wed Jun 1 17:46:08 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:46:08.430118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b6c7b-c925-4e90-9627-cb213f5958f7 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:08.470633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbe084-0866-4571-92c4-bf44bf09e774 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:08.485568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f222aaf-29bb-4cf8-92bb-fd213868ba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:08.486510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f222aaf-29bb-4cf8-92bb-fd213868ba0d admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:08.487064 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f222aaf-29bb-4cf8-92bb-fd213868ba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:08.487894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f222aaf-29bb-4cf8-92bb-fd213868ba0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:08.488860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f222aaf-29bb-4cf8-92bb-fd213868ba0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:08.491064 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f222aaf-29bb-4cf8-92bb-fd213868ba0d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:08.507104 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 816/1637] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:08.508849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8703-2a79-4cb6-b4ef-9d22881bd436 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:08.509329 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8703-2a79-4cb6-b4ef-9d22881bd436 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:08.510088 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8703-2a79-4cb6-b4ef-9d22881bd436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:08.532619 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0dfe8703-2a79-4cb6-b4ef-9d22881bd436 None None] MFA Rules not processed for user `5d5a5ba6aecd46e79dc7199589384a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:08.534365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b6c7b-c925-4e90-9627-cb213f5958f7 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:08.536000 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0dfe8703-2a79-4cb6-b4ef-9d22881bd436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:08.544006 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582a8c7-4de9-424a-ae4e-aacf0eb56e0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:08.545057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582a8c7-4de9-424a-ae4e-aacf0eb56e0a service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:08.545448 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582a8c7-4de9-424a-ae4e-aacf0eb56e0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:08.545826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582a8c7-4de9-424a-ae4e-aacf0eb56e0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:08.565579 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582a8c7-4de9-424a-ae4e-aacf0eb56e0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:08.569525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582a8c7-4de9-424a-ae4e-aacf0eb56e0a service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:08.582756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:08.589853 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 822/1638] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:08.592210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582a8c7-4de9-424a-ae4e-aacf0eb56e0a service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:08.615290 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582a8c7-4de9-424a-ae4e-aacf0eb56e0a service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:08.630228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896278ae-ccae-4eda-8465-72ae564fcddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:08.635804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896278ae-ccae-4eda-8465-72ae564fcddb admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:08.635804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896278ae-ccae-4eda-8465-72ae564fcddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:08.635804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896278ae-ccae-4eda-8465-72ae564fcddb admin admin] PATH_INFO: `/v3/projects/ff9ee742475441ebb4f737d503220892/users/d2b19db1f76644838a24c2e7dfc9ca85/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:08.638992 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896278ae-ccae-4eda-8465-72ae564fcddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9ee742475441ebb4f737d503220892, user_id=d2b19db1f76644838a24c2e7dfc9ca85, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:08.645814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896278ae-ccae-4eda-8465-72ae564fcddb admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:08.684381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 823/1639] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:08 2022] PUT /identity/v3/projects/ff9ee742475441ebb4f737d503220892/users/d2b19db1f76644838a24c2e7dfc9ca85/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:08.686796 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 817/1640] 10.222.0.33 () {58 vars in 1058 bytes} [Wed Jun 1 17:46:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:08.687494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c121231-4f7b-4634-b291-85bc9dd2acfc None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:08.687917 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c121231-4f7b-4634-b291-85bc9dd2acfc None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:08.688269 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c121231-4f7b-4634-b291-85bc9dd2acfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:08.702203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe8703-2a79-4cb6-b4ef-9d22881bd436 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:08.718972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe8703-2a79-4cb6-b4ef-9d22881bd436 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:08.720650 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-9c121231-4f7b-4634-b291-85bc9dd2acfc None None] MFA Rules not processed for user `d2b19db1f76644838a24c2e7dfc9ca85`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:08.722693 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-9c121231-4f7b-4634-b291-85bc9dd2acfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:08.826765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 824/1641] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:08 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:08.872100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920dc5e-ff5f-48e7-b605-60fc167a2455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:08.873224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920dc5e-ff5f-48e7-b605-60fc167a2455 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:08.873516 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920dc5e-ff5f-48e7-b605-60fc167a2455 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:08.873797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920dc5e-ff5f-48e7-b605-60fc167a2455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:08.966875 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920dc5e-ff5f-48e7-b605-60fc167a2455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:08.970745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920dc5e-ff5f-48e7-b605-60fc167a2455 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:08.976153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c121231-4f7b-4634-b291-85bc9dd2acfc None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:08.986923 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 818/1642] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:46:09.061448 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c121231-4f7b-4634-b291-85bc9dd2acfc None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:09.066737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadf250-e626-48f3-a312-575f2ecd784a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:09.067570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadf250-e626-48f3-a312-575f2ecd784a service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:09.068081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadf250-e626-48f3-a312-575f2ecd784a service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:09.068930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadf250-e626-48f3-a312-575f2ecd784a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:09.081906 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadf250-e626-48f3-a312-575f2ecd784a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:09.085202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadf250-e626-48f3-a312-575f2ecd784a service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:09.099412 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 825/1643] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:08 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:46:09.519543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920dc5e-ff5f-48e7-b605-60fc167a2455 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:09.519543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920dc5e-ff5f-48e7-b605-60fc167a2455 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:09.519543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69366bf-719c-404e-96ba-caded335f0b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:09.519543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69366bf-719c-404e-96ba-caded335f0b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:09.524352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69366bf-719c-404e-96ba-caded335f0b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:09.524352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69366bf-719c-404e-96ba-caded335f0b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:09.524752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ade22-d06c-46e4-a4e4-1f06d0157fbf None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:09.524752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ade22-d06c-46e4-a4e4-1f06d0157fbf None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:09.524752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ade22-d06c-46e4-a4e4-1f06d0157fbf None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:09.524752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 826/1644] 10.222.0.33 () {54 vars in 912 bytes} [Wed Jun 1 17:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:46:09.525549 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:09.525964 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd9a3e-8abe-4490-b49d-5dd2a6ffa0fd None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:09.525964 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd9a3e-8abe-4490-b49d-5dd2a6ffa0fd None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:09.525964 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd9a3e-8abe-4490-b49d-5dd2a6ffa0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:09.525964 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-21dd9a3e-8abe-4490-b49d-5dd2a6ffa0fd None None] MFA Rules not processed for user `5d5a5ba6aecd46e79dc7199589384a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:09.525964 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-21dd9a3e-8abe-4490-b49d-5dd2a6ffa0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:09.526356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69366bf-719c-404e-96ba-caded335f0b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:09.526356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69366bf-719c-404e-96ba-caded335f0b4 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:09.526498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 827/1645] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jun 1 17:46:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:46:09.526498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd9a3e-8abe-4490-b49d-5dd2a6ffa0fd None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:09.526498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd9a3e-8abe-4490-b49d-5dd2a6ffa0fd None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:09.526498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0cb62-f8fa-42b1-9ba5-a977e77debf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:09.526780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0cb62-f8fa-42b1-9ba5-a977e77debf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:09.526780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0cb62-f8fa-42b1-9ba5-a977e77debf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:09.526780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0cb62-f8fa-42b1-9ba5-a977e77debf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:09.526973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 819/1646] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:09.526973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69366bf-719c-404e-96ba-caded335f0b4 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:09.526973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d69366bf-719c-404e-96ba-caded335f0b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:09.603222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0cb62-f8fa-42b1-9ba5-a977e77debf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:09.605608 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0cb62-f8fa-42b1-9ba5-a977e77debf9 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:09.629424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 828/1647] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:09.634440 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69366bf-719c-404e-96ba-caded335f0b4 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:09.647566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406905fe-51a3-415b-b8ef-35d5773e1a00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b34d05889f3c4d469f4661061457cb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:09.648252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406905fe-51a3-415b-b8ef-35d5773e1a00 service glance] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:09.648544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406905fe-51a3-415b-b8ef-35d5773e1a00 service glance] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:09.648828 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406905fe-51a3-415b-b8ef-35d5773e1a00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:09.692654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406905fe-51a3-415b-b8ef-35d5773e1a00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:09.698506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406905fe-51a3-415b-b8ef-35d5773e1a00 service glance] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:09.745457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 820/1648] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:10.363039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdefda-e794-45a2-aefc-4cd155f3acb9 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:10.363580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdefda-e794-45a2-aefc-4cd155f3acb9 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:10.364567 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdefda-e794-45a2-aefc-4cd155f3acb9 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:10.367238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 829/1649] 10.222.0.33 () {54 vars in 912 bytes} [Wed Jun 1 17:46:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:46:10.375541 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c256de1-131d-48b5-86a6-a88bedcf2af2 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:10.375835 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c256de1-131d-48b5-86a6-a88bedcf2af2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:10.376111 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c256de1-131d-48b5-86a6-a88bedcf2af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:10.419247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:10.488312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:10.513751 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-9c256de1-131d-48b5-86a6-a88bedcf2af2 None None] MFA Rules not processed for user `4254398f2aac42f7b54f29294a73bfda`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:10.513751 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9c256de1-131d-48b5-86a6-a88bedcf2af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:10.618091 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 821/1650] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jun 1 17:46:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:10.663848 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdefda-e794-45a2-aefc-4cd155f3acb9 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:10.683120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdefda-e794-45a2-aefc-4cd155f3acb9 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:10.690016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95ae07-3305-47da-a9d3-d9568c063ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:10.690736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95ae07-3305-47da-a9d3-d9568c063ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:10.691141 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95ae07-3305-47da-a9d3-d9568c063ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:10.691423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95ae07-3305-47da-a9d3-d9568c063ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:10.702260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95ae07-3305-47da-a9d3-d9568c063ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:10.703736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95ae07-3305-47da-a9d3-d9568c063ba5 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:10.729940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 830/1651] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:10.999148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557162f-be72-41a9-82f1-c4bd258957b5 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:10.999452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557162f-be72-41a9-82f1-c4bd258957b5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:10.999744 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557162f-be72-41a9-82f1-c4bd258957b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:11.050092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7557162f-be72-41a9-82f1-c4bd258957b5 None None] MFA Rules not processed for user `c1a39d30e6b7401cbb8f63677f37a13c`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:11.053715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7557162f-be72-41a9-82f1-c4bd258957b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:11.197424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95ae07-3305-47da-a9d3-d9568c063ba5 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:11.199508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 822/1652] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:11.296781 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95ae07-3305-47da-a9d3-d9568c063ba5 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:11.306159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60c9c7-6cfe-4a6e-a4b5-709919cdd243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:11.306859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60c9c7-6cfe-4a6e-a4b5-709919cdd243 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:11.307142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60c9c7-6cfe-4a6e-a4b5-709919cdd243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:11.307417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60c9c7-6cfe-4a6e-a4b5-709919cdd243 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:11.308168 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60c9c7-6cfe-4a6e-a4b5-709919cdd243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:11.311327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60c9c7-6cfe-4a6e-a4b5-709919cdd243 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:11.470611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 831/1653] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:11 2022] POST /identity/v3/projects => generated 401 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:46:11.474689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557162f-be72-41a9-82f1-c4bd258957b5 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:11.502830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557162f-be72-41a9-82f1-c4bd258957b5 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:11.736609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797900fc-3ba8-4edc-9f70-6cfe31daf04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:11.739351 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797900fc-3ba8-4edc-9f70-6cfe31daf04c admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:11.739786 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797900fc-3ba8-4edc-9f70-6cfe31daf04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:11.740774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797900fc-3ba8-4edc-9f70-6cfe31daf04c admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:11.741690 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797900fc-3ba8-4edc-9f70-6cfe31daf04c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:11.745069 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797900fc-3ba8-4edc-9f70-6cfe31daf04c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:11.852321 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 823/1654] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:11 2022] POST /identity/v3/users => generated 307 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:11.852995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60c9c7-6cfe-4a6e-a4b5-709919cdd243 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:11.896446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60c9c7-6cfe-4a6e-a4b5-709919cdd243 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:11.906259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4690b-d90a-42c9-a8da-e733d82b73e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:11.907817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4690b-d90a-42c9-a8da-e733d82b73e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:11.908250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4690b-d90a-42c9-a8da-e733d82b73e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:11.908670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4690b-d90a-42c9-a8da-e733d82b73e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:11.910914 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4690b-d90a-42c9-a8da-e733d82b73e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:11.920572 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4690b-d90a-42c9-a8da-e733d82b73e7 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:11.952311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 832/1655] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:11.954150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797900fc-3ba8-4edc-9f70-6cfe31daf04c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:11.975897 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797900fc-3ba8-4edc-9f70-6cfe31daf04c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:11.981819 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e21673-51a6-4fc7-bfb6-d586aa50edc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:11.983025 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e21673-51a6-4fc7-bfb6-d586aa50edc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:11.983483 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e21673-51a6-4fc7-bfb6-d586aa50edc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:11.983909 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e21673-51a6-4fc7-bfb6-d586aa50edc8 admin admin] PATH_INFO: `/v3/projects/d347f8ec163b4e25ae7a175ac8ca5771/users/7f1764524a9a4dd5b2de017c81ab7179/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:12.012725 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e21673-51a6-4fc7-bfb6-d586aa50edc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d347f8ec163b4e25ae7a175ac8ca5771, user_id=7f1764524a9a4dd5b2de017c81ab7179, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:12.021325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e21673-51a6-4fc7-bfb6-d586aa50edc8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:12.147554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 824/1656] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:11 2022] PUT /identity/v3/projects/d347f8ec163b4e25ae7a175ac8ca5771/users/7f1764524a9a4dd5b2de017c81ab7179/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:12.151660 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4690b-d90a-42c9-a8da-e733d82b73e7 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:12.171317 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4690b-d90a-42c9-a8da-e733d82b73e7 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:12.366581 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27797c9-087f-4463-a22e-8fdc8b26f988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:12.373746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27797c9-087f-4463-a22e-8fdc8b26f988 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:12.373746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27797c9-087f-4463-a22e-8fdc8b26f988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:12.373746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27797c9-087f-4463-a22e-8fdc8b26f988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:12.373746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27797c9-087f-4463-a22e-8fdc8b26f988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:12.373746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27797c9-087f-4463-a22e-8fdc8b26f988 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:12.390262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 833/1657] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:46:12.396509 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e21673-51a6-4fc7-bfb6-d586aa50edc8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:12.411240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e21673-51a6-4fc7-bfb6-d586aa50edc8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:12.427639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be3915-8a69-4290-829b-67b1e64c22ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:12.428561 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be3915-8a69-4290-829b-67b1e64c22ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:12.429109 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be3915-8a69-4290-829b-67b1e64c22ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:12.429396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be3915-8a69-4290-829b-67b1e64c22ff admin admin] PATH_INFO: `/v3/projects/d347f8ec163b4e25ae7a175ac8ca5771/users/7f1764524a9a4dd5b2de017c81ab7179/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:12.435748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be3915-8a69-4290-829b-67b1e64c22ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d347f8ec163b4e25ae7a175ac8ca5771, user_id=7f1764524a9a4dd5b2de017c81ab7179, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:12.438823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be3915-8a69-4290-829b-67b1e64c22ff admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:12.442116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:12.457018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 825/1658] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:12 2022] PUT /identity/v3/projects/d347f8ec163b4e25ae7a175ac8ca5771/users/7f1764524a9a4dd5b2de017c81ab7179/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:13.087045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9273d-c76c-47df-9dc9-fb45a6915023 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:13.088040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9273d-c76c-47df-9dc9-fb45a6915023 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:13.088517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9273d-c76c-47df-9dc9-fb45a6915023 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:13.091300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 834/1659] 10.222.0.33 () {54 vars in 960 bytes} [Wed Jun 1 17:46:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:46:13.102281 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f3046-1110-44b1-b3fd-272ae4d39e6d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:13.103274 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f3046-1110-44b1-b3fd-272ae4d39e6d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:13.103713 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f3046-1110-44b1-b3fd-272ae4d39e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:13.158634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ca3f3046-1110-44b1-b3fd-272ae4d39e6d None None] MFA Rules not processed for user `ae952b30dffa450e97ce4a73da8d00f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:13.160015 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ca3f3046-1110-44b1-b3fd-272ae4d39e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:13.454837 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 826/1660] 10.222.0.33 () {58 vars in 1057 bytes} [Wed Jun 1 17:46:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:13.471534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9273d-c76c-47df-9dc9-fb45a6915023 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:13.516146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9273d-c76c-47df-9dc9-fb45a6915023 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:13.523301 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d0db5-cdb3-4964-af2c-b7d6e5dbabaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:13.525312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d0db5-cdb3-4964-af2c-b7d6e5dbabaa service placement] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:13.526558 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d0db5-cdb3-4964-af2c-b7d6e5dbabaa service placement] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:13.527053 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d0db5-cdb3-4964-af2c-b7d6e5dbabaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:13.530319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-9c4d0db5-cdb3-4964-af2c-b7d6e5dbabaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:13.565432 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d0db5-cdb3-4964-af2c-b7d6e5dbabaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:13.567770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d0db5-cdb3-4964-af2c-b7d6e5dbabaa service placement] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:13.595907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 835/1661] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:14.367123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f3046-1110-44b1-b3fd-272ae4d39e6d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:14.475366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f3046-1110-44b1-b3fd-272ae4d39e6d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:14.505252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa3808-41dd-421c-8301-591b601bbd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:14.507605 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa3808-41dd-421c-8301-591b601bbd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:14.508897 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa3808-41dd-421c-8301-591b601bbd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:14.509575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa3808-41dd-421c-8301-591b601bbd25 admin admin] PATH_INFO: `/v3/users/7ffcb10672664b33a47e3a3ee7bb9e23` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:14.513942 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa3808-41dd-421c-8301-591b601bbd25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ffcb10672664b33a47e3a3ee7bb9e23)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:14.516384 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa3808-41dd-421c-8301-591b601bbd25 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:14.778170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7baa3808-41dd-421c-8301-591b601bbd25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ffcb10672664b33a47e3a3ee7bb9e23'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:14.885551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7baa3808-41dd-421c-8301-591b601bbd25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ffcb10672664b33a47e3a3ee7bb9e23'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:14.912502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7baa3808-41dd-421c-8301-591b601bbd25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ffcb10672664b33a47e3a3ee7bb9e23'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:14.920712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7baa3808-41dd-421c-8301-591b601bbd25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ffcb10672664b33a47e3a3ee7bb9e23'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:14.948732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7baa3808-41dd-421c-8301-591b601bbd25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ffcb10672664b33a47e3a3ee7bb9e23'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:14.968250 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 827/1662] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:46:14 2022] DELETE /identity/v3/users/7ffcb10672664b33a47e3a3ee7bb9e23 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:14.971380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973226ad-e626-46bf-b713-1ed45df96e6a None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:14.974741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973226ad-e626-46bf-b713-1ed45df96e6a None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:14.974741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973226ad-e626-46bf-b713-1ed45df96e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:15.013723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-973226ad-e626-46bf-b713-1ed45df96e6a None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:15.018111 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-973226ad-e626-46bf-b713-1ed45df96e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:15.032531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:15.205274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 836/1663] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:15.236809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa3808-41dd-421c-8301-591b601bbd25 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:15.238349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7baa3808-41dd-421c-8301-591b601bbd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:15.260159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:15.382370 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa3808-41dd-421c-8301-591b601bbd25 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:15.396322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1406de0-5286-4bb9-9bf8-220dcbb0b9ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:15.397050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1406de0-5286-4bb9-9bf8-220dcbb0b9ef service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:15.397341 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1406de0-5286-4bb9-9bf8-220dcbb0b9ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:15.397619 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1406de0-5286-4bb9-9bf8-220dcbb0b9ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:15.424134 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1406de0-5286-4bb9-9bf8-220dcbb0b9ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:15.429129 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1406de0-5286-4bb9-9bf8-220dcbb0b9ef service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:15.458939 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 828/1664] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:16.743788 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b615c4-6f12-43ce-a756-532bc08d361f None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:16.744278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b615c4-6f12-43ce-a756-532bc08d361f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:16.744399 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b615c4-6f12-43ce-a756-532bc08d361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:16.821301 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-96b615c4-6f12-43ce-a756-532bc08d361f None None] MFA Rules not processed for user `7f1764524a9a4dd5b2de017c81ab7179`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:16.830751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-96b615c4-6f12-43ce-a756-532bc08d361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:17.015630 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 837/1665] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:16 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:17.291445 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1406de0-5286-4bb9-9bf8-220dcbb0b9ef service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:17.293618 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d1406de0-5286-4bb9-9bf8-220dcbb0b9ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:17.318913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1406de0-5286-4bb9-9bf8-220dcbb0b9ef service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:17.336475 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176e5dc-b69e-479d-a46a-d7d4b56aabdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:17.337710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176e5dc-b69e-479d-a46a-d7d4b56aabdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:17.338275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176e5dc-b69e-479d-a46a-d7d4b56aabdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:17.339503 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176e5dc-b69e-479d-a46a-d7d4b56aabdc admin admin] PATH_INFO: `/v3/users/9cc817eba28f4c6189773b4aab7a45c4` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:17.343242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176e5dc-b69e-479d-a46a-d7d4b56aabdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc817eba28f4c6189773b4aab7a45c4)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:17.346115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176e5dc-b69e-479d-a46a-d7d4b56aabdc admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:17.476903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b615c4-6f12-43ce-a756-532bc08d361f None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:17.482227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-96b615c4-6f12-43ce-a756-532bc08d361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:17.510208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b615c4-6f12-43ce-a756-532bc08d361f None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:17.522352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d7a67-d165-450c-a6ef-b3bb0cfc20f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:17.523452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d7a67-d165-450c-a6ef-b3bb0cfc20f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:17.523912 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d7a67-d165-450c-a6ef-b3bb0cfc20f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:17.524338 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d7a67-d165-450c-a6ef-b3bb0cfc20f6 admin admin] PATH_INFO: `/v3/projects/f426daa6be834c7e9596e5f9f73d5542` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:17.527796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d7a67-d165-450c-a6ef-b3bb0cfc20f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f426daa6be834c7e9596e5f9f73d5542)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:17.530525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d7a67-d165-450c-a6ef-b3bb0cfc20f6 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:17.624103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f176e5dc-b69e-479d-a46a-d7d4b56aabdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc817eba28f4c6189773b4aab7a45c4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:17.697993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f176e5dc-b69e-479d-a46a-d7d4b56aabdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc817eba28f4c6189773b4aab7a45c4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:17.709768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f176e5dc-b69e-479d-a46a-d7d4b56aabdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc817eba28f4c6189773b4aab7a45c4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:17.711408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f176e5dc-b69e-479d-a46a-d7d4b56aabdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc817eba28f4c6189773b4aab7a45c4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:17.735407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-109d7a67-d165-450c-a6ef-b3bb0cfc20f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f426daa6be834c7e9596e5f9f73d5542', 'request_id': 'req-109d7a67-d165-450c-a6ef-b3bb0cfc20f6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:17.740020 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f176e5dc-b69e-479d-a46a-d7d4b56aabdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc817eba28f4c6189773b4aab7a45c4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:17.747614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-109d7a67-d165-450c-a6ef-b3bb0cfc20f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f426daa6be834c7e9596e5f9f73d5542', 'request_id': 'req-109d7a67-d165-450c-a6ef-b3bb0cfc20f6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:17.756110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 829/1666] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:46:17 2022] DELETE /identity/v3/users/9cc817eba28f4c6189773b4aab7a45c4 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:17.758394 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b1e80-58f0-4b84-817d-9112b79f5c1b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:17.758686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b1e80-58f0-4b84-817d-9112b79f5c1b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:17.758981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b1e80-58f0-4b84-817d-9112b79f5c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:17.815952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-dd1b1e80-58f0-4b84-817d-9112b79f5c1b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:17.821754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-dd1b1e80-58f0-4b84-817d-9112b79f5c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:17.823406 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-109d7a67-d165-450c-a6ef-b3bb0cfc20f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f426daa6be834c7e9596e5f9f73d5542', 'request_id': 'req-109d7a67-d165-450c-a6ef-b3bb0cfc20f6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:17.842749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-109d7a67-d165-450c-a6ef-b3bb0cfc20f6 admin admin] The token cache is being invalidate because project f426daa6be834c7e9596e5f9f73d5542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:46:17.842962 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-109d7a67-d165-450c-a6ef-b3bb0cfc20f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:17.847160 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-109d7a67-d165-450c-a6ef-b3bb0cfc20f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:17.851613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 838/1667] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:46:17 2022] DELETE /identity/v3/projects/f426daa6be834c7e9596e5f9f73d5542 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:17.859685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32149d71-bd10-4c4b-81f7-c21d8870c7af None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:17.861336 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32149d71-bd10-4c4b-81f7-c21d8870c7af None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:17.865833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32149d71-bd10-4c4b-81f7-c21d8870c7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:17.915439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-32149d71-bd10-4c4b-81f7-c21d8870c7af None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:17.916975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-32149d71-bd10-4c4b-81f7-c21d8870c7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:17.959653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:18.023476 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 830/1668] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:18.031992 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11166d71-aafa-4afc-b2d2-3f14e2ebdcfe None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:18.033259 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11166d71-aafa-4afc-b2d2-3f14e2ebdcfe None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:18.033621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11166d71-aafa-4afc-b2d2-3f14e2ebdcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:18.097605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 839/1669] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:18.099648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32149d71-bd10-4c4b-81f7-c21d8870c7af None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:18.101455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-32149d71-bd10-4c4b-81f7-c21d8870c7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:18.106832 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-11166d71-aafa-4afc-b2d2-3f14e2ebdcfe None None] MFA Rules not processed for user `6f0ce995acc646d88f47c92e8458931a`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:18.108038 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-11166d71-aafa-4afc-b2d2-3f14e2ebdcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:18.149737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:18.317474 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32149d71-bd10-4c4b-81f7-c21d8870c7af None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:18.330271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d6cc6-1ff3-45c7-a3ed-5ad6be10b4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:18.331104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d6cc6-1ff3-45c7-a3ed-5ad6be10b4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:18.331382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d6cc6-1ff3-45c7-a3ed-5ad6be10b4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:18.331659 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d6cc6-1ff3-45c7-a3ed-5ad6be10b4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:18.362215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 831/1670] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:18.366493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1be15-d168-4866-92e1-a4e865e98804 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:18.366966 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1be15-d168-4866-92e1-a4e865e98804 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:18.369434 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1be15-d168-4866-92e1-a4e865e98804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:18.380111 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d6cc6-1ff3-45c7-a3ed-5ad6be10b4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:18.381929 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d6cc6-1ff3-45c7-a3ed-5ad6be10b4c2 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:18.410977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 840/1671] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:18.424196 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d6cc6-1ff3-45c7-a3ed-5ad6be10b4c2 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:18.430058 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-131d6cc6-1ff3-45c7-a3ed-5ad6be10b4c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:18.449394 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-00a1be15-d168-4866-92e1-a4e865e98804 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:18.456599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-00a1be15-d168-4866-92e1-a4e865e98804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:18.493455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 832/1672] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:18.496792 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1be15-d168-4866-92e1-a4e865e98804 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:18.536246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1be15-d168-4866-92e1-a4e865e98804 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:18.550417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6f235-3928-4ea2-b919-e0a0e80fa85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:18.552303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6f235-3928-4ea2-b919-e0a0e80fa85c admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:18.554937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6f235-3928-4ea2-b919-e0a0e80fa85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:18.555426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6f235-3928-4ea2-b919-e0a0e80fa85c admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:18.556352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6f235-3928-4ea2-b919-e0a0e80fa85c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:18.559315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6f235-3928-4ea2-b919-e0a0e80fa85c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:18.561502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6f235-3928-4ea2-b919-e0a0e80fa85c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:18.617267 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 833/1673] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:46:18.620172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6f235-3928-4ea2-b919-e0a0e80fa85c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:18.652676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6f235-3928-4ea2-b919-e0a0e80fa85c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:18.680577 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca226d-f7ad-473d-8cc6-b638c9a463ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:18.681294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca226d-f7ad-473d-8cc6-b638c9a463ad admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:18.683537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca226d-f7ad-473d-8cc6-b638c9a463ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:18.683848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca226d-f7ad-473d-8cc6-b638c9a463ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:18.684614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca226d-f7ad-473d-8cc6-b638c9a463ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:18.688075 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca226d-f7ad-473d-8cc6-b638c9a463ad admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:18.779223 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d6cc6-1ff3-45c7-a3ed-5ad6be10b4c2 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:18.799580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678567c2-a967-4cc5-a9c2-88975f6c7f72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:18.800276 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678567c2-a967-4cc5-a9c2-88975f6c7f72 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:18.800562 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678567c2-a967-4cc5-a9c2-88975f6c7f72 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:18.806697 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678567c2-a967-4cc5-a9c2-88975f6c7f72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:18.830362 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678567c2-a967-4cc5-a9c2-88975f6c7f72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:18.833456 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678567c2-a967-4cc5-a9c2-88975f6c7f72 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:18.870360 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 841/1674] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:18.891475 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 834/1675] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:18 2022] POST /identity/v3/projects => generated 367 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:46:18.894420 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678567c2-a967-4cc5-a9c2-88975f6c7f72 service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:18.909512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678567c2-a967-4cc5-a9c2-88975f6c7f72 service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:19.096415 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9571d3-1ecc-44f8-9862-e2742cd7abf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:19.097149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9571d3-1ecc-44f8-9862-e2742cd7abf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:19.098108 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9571d3-1ecc-44f8-9862-e2742cd7abf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:19.098397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9571d3-1ecc-44f8-9862-e2742cd7abf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:19.099242 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9571d3-1ecc-44f8-9862-e2742cd7abf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:19.102707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9571d3-1ecc-44f8-9862-e2742cd7abf8 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:19.220333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 842/1676] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:18 2022] POST /identity/v3/users => generated 284 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:19.224601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca226d-f7ad-473d-8cc6-b638c9a463ad admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:19.249834 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca226d-f7ad-473d-8cc6-b638c9a463ad admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:19.258267 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0cfe3-6074-46f2-b045-98b5f8c8389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:19.259350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0cfe3-6074-46f2-b045-98b5f8c8389c admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:19.259849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0cfe3-6074-46f2-b045-98b5f8c8389c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:19.260326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0cfe3-6074-46f2-b045-98b5f8c8389c admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:19.261322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0cfe3-6074-46f2-b045-98b5f8c8389c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:19.263792 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0cfe3-6074-46f2-b045-98b5f8c8389c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:19.291499 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 835/1677] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:19.292517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9571d3-1ecc-44f8-9862-e2742cd7abf8 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:19.305217 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9571d3-1ecc-44f8-9862-e2742cd7abf8 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:19.319225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c07a1-a48e-4ba5-a652-c4899c065d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:19.320499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c07a1-a48e-4ba5-a652-c4899c065d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:19.320499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c07a1-a48e-4ba5-a652-c4899c065d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:19.320657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c07a1-a48e-4ba5-a652-c4899c065d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:19.321305 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c07a1-a48e-4ba5-a652-c4899c065d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:19.323000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c07a1-a48e-4ba5-a652-c4899c065d74 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:19.357105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 843/1678] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:46:19.358858 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0cfe3-6074-46f2-b045-98b5f8c8389c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:19.380874 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0cfe3-6074-46f2-b045-98b5f8c8389c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:19.394754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524f4dd-0582-42c9-9292-ba13c4ad74c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:19.395732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524f4dd-0582-42c9-9292-ba13c4ad74c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:19.395998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524f4dd-0582-42c9-9292-ba13c4ad74c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:19.396292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524f4dd-0582-42c9-9292-ba13c4ad74c5 admin admin] PATH_INFO: `/v3/projects/6a2c566980d84710b879c2fbc053793f/users/3c0c8541ed94493bb2e31c7fd2c9d5e2/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:19.433961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524f4dd-0582-42c9-9292-ba13c4ad74c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2c566980d84710b879c2fbc053793f, user_id=3c0c8541ed94493bb2e31c7fd2c9d5e2, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:19.441960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524f4dd-0582-42c9-9292-ba13c4ad74c5 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:19.526404 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 836/1679] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:19 2022] PUT /identity/v3/projects/6a2c566980d84710b879c2fbc053793f/users/3c0c8541ed94493bb2e31c7fd2c9d5e2/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:19.537384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c96db-e7a2-4d82-8977-d0b8b5eae7ef None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:19.537803 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c96db-e7a2-4d82-8977-d0b8b5eae7ef None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:19.538151 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c96db-e7a2-4d82-8977-d0b8b5eae7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:19.583759 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b23c96db-e7a2-4d82-8977-d0b8b5eae7ef None None] MFA Rules not processed for user `3c0c8541ed94493bb2e31c7fd2c9d5e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:19.587087 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b23c96db-e7a2-4d82-8977-d0b8b5eae7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:19.598288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20083f28-e26d-4c80-bb86-707cf3fa7d72 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:19.598920 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20083f28-e26d-4c80-bb86-707cf3fa7d72 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:19.599576 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20083f28-e26d-4c80-bb86-707cf3fa7d72 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:19.608151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 837/1680] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jun 1 17:46:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:46:19.617112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5209-cfb2-444d-886c-2924deb56d4f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:19.617620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5209-cfb2-444d-886c-2924deb56d4f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:19.618507 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c5209-cfb2-444d-886c-2924deb56d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:19.683279 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2b8c5209-cfb2-444d-886c-2924deb56d4f None None] MFA Rules not processed for user `ae952b30dffa450e97ce4a73da8d00f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:19.686874 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2b8c5209-cfb2-444d-886c-2924deb56d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:19.836057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 844/1681] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:19.844729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c96db-e7a2-4d82-8977-d0b8b5eae7ef None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:19.847305 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:19.848823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b23c96db-e7a2-4d82-8977-d0b8b5eae7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:19.877926 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 838/1682] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jun 1 17:46:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:19.933113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c96db-e7a2-4d82-8977-d0b8b5eae7ef None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:19.939951 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d1a8b-9ba6-48cf-af6d-1f6ec80a6c09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:19.940896 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d1a8b-9ba6-48cf-af6d-1f6ec80a6c09 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:19.941301 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d1a8b-9ba6-48cf-af6d-1f6ec80a6c09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:19.941719 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d1a8b-9ba6-48cf-af6d-1f6ec80a6c09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:19.949494 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c5209-cfb2-444d-886c-2924deb56d4f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:19.952174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2b8c5209-cfb2-444d-886c-2924deb56d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:19.974833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c5209-cfb2-444d-886c-2924deb56d4f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:19.983378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d1a8b-9ba6-48cf-af6d-1f6ec80a6c09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:19.983378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d1a8b-9ba6-48cf-af6d-1f6ec80a6c09 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:20.000895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266441a-d1ee-4884-8f0d-7087d5883e27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:20.001713 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266441a-d1ee-4884-8f0d-7087d5883e27 service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:20.001997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266441a-d1ee-4884-8f0d-7087d5883e27 service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:20.002276 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266441a-d1ee-4884-8f0d-7087d5883e27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:20.032646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 845/1683] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:19 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:20.034434 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266441a-d1ee-4884-8f0d-7087d5883e27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:20.036052 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266441a-d1ee-4884-8f0d-7087d5883e27 service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:20.072414 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 839/1684] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:20.913286 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6810f-116e-41c0-a4ea-4556894f1957 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:20.913724 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6810f-116e-41c0-a4ea-4556894f1957 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:20.913794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6810f-116e-41c0-a4ea-4556894f1957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:20.962405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-4cb6810f-116e-41c0-a4ea-4556894f1957 None None] MFA Rules not processed for user `7e29d3b37ec342fe91765a8b13354bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:20.963613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4cb6810f-116e-41c0-a4ea-4556894f1957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:21.027877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:21.054343 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 846/1685] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:21.075861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266441a-d1ee-4884-8f0d-7087d5883e27 service placement] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:21.100504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:21.183069 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266441a-d1ee-4884-8f0d-7087d5883e27 service placement] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:21.193227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4c276-14ec-43d0-81bb-7338cffc438e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:21.194282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4c276-14ec-43d0-81bb-7338cffc438e service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:21.194762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4c276-14ec-43d0-81bb-7338cffc438e service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:21.195261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4c276-14ec-43d0-81bb-7338cffc438e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:21.209070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4c276-14ec-43d0-81bb-7338cffc438e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:21.211919 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4c276-14ec-43d0-81bb-7338cffc438e service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:21.224017 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 840/1686] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:21.251850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6810f-116e-41c0-a4ea-4556894f1957 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:21.255496 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4cb6810f-116e-41c0-a4ea-4556894f1957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:21.269079 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4c276-14ec-43d0-81bb-7338cffc438e service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:21.271631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-76b4c276-14ec-43d0-81bb-7338cffc438e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:21.416874 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6810f-116e-41c0-a4ea-4556894f1957 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:21.422831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a0f5d-9850-4c2d-bb2b-e350ee94c125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:21.424625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a0f5d-9850-4c2d-bb2b-e350ee94c125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:21.425741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a0f5d-9850-4c2d-bb2b-e350ee94c125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:21.426314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a0f5d-9850-4c2d-bb2b-e350ee94c125 admin admin] PATH_INFO: `/v3/users/c1a39d30e6b7401cbb8f63677f37a13c` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:21.426586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4c276-14ec-43d0-81bb-7338cffc438e service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:21.428480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a0f5d-9850-4c2d-bb2b-e350ee94c125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a39d30e6b7401cbb8f63677f37a13c)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:21.430592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: WARNING py.warnings [None req-f21a0f5d-9850-4c2d-bb2b-e350ee94c125 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 17:46:21.430592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: warnings.warn(msg) Jun 01 17:46:21.430592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: Jun 01 17:46:21.432319 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:21.432619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a0f5d-9850-4c2d-bb2b-e350ee94c125 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:21.433520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:21.433851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:21.434229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] PATH_INFO: `/v3/projects/62797492bc2f4fc58c771976e7c63a12` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:21.437190 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62797492bc2f4fc58c771976e7c63a12)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:21.438766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: WARNING py.warnings [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 01 17:46:21.438766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: warnings.warn(msg) Jun 01 17:46:21.438766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: Jun 01 17:46:21.441577 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:21.720233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f21a0f5d-9850-4c2d-bb2b-e350ee94c125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a39d30e6b7401cbb8f63677f37a13c'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:21.724340 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62797492bc2f4fc58c771976e7c63a12', 'request_id': 'req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:21.745382 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62797492bc2f4fc58c771976e7c63a12', 'request_id': 'req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:21.825845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f21a0f5d-9850-4c2d-bb2b-e350ee94c125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a39d30e6b7401cbb8f63677f37a13c'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:21.856890 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f21a0f5d-9850-4c2d-bb2b-e350ee94c125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a39d30e6b7401cbb8f63677f37a13c'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:21.857998 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f21a0f5d-9850-4c2d-bb2b-e350ee94c125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a39d30e6b7401cbb8f63677f37a13c'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:21.895169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f21a0f5d-9850-4c2d-bb2b-e350ee94c125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a39d30e6b7401cbb8f63677f37a13c'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:21.908563 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 847/1687] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:46:21 2022] DELETE /identity/v3/users/c1a39d30e6b7401cbb8f63677f37a13c => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:21.922236 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62797492bc2f4fc58c771976e7c63a12', 'request_id': 'req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:21.952717 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] The token cache is being invalidate because project 62797492bc2f4fc58c771976e7c63a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:46:21.956265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:21.957301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:21.962022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 841/1688] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:46:21 2022] DELETE /identity/v3/projects/62797492bc2f4fc58c771976e7c63a12 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:46:21.966809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a0f5d-9850-4c2d-bb2b-e350ee94c125 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:21.968240 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f21a0f5d-9850-4c2d-bb2b-e350ee94c125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:22.092661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a0f5d-9850-4c2d-bb2b-e350ee94c125 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:22.098984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253123b2-15ba-4375-a542-4bb058ce6585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:22.100204 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253123b2-15ba-4375-a542-4bb058ce6585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:22.100667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253123b2-15ba-4375-a542-4bb058ce6585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:22.107842 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253123b2-15ba-4375-a542-4bb058ce6585 admin admin] PATH_INFO: `/v3/users/d2b19db1f76644838a24c2e7dfc9ca85` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:22.110525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253123b2-15ba-4375-a542-4bb058ce6585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b19db1f76644838a24c2e7dfc9ca85)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:22.115554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253123b2-15ba-4375-a542-4bb058ce6585 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:22.134672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:22.559874 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-253123b2-15ba-4375-a542-4bb058ce6585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b19db1f76644838a24c2e7dfc9ca85'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:22.721241 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-253123b2-15ba-4375-a542-4bb058ce6585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b19db1f76644838a24c2e7dfc9ca85'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:22.734662 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-253123b2-15ba-4375-a542-4bb058ce6585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b19db1f76644838a24c2e7dfc9ca85'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:22.735674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-253123b2-15ba-4375-a542-4bb058ce6585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b19db1f76644838a24c2e7dfc9ca85'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:22.766893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-253123b2-15ba-4375-a542-4bb058ce6585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b19db1f76644838a24c2e7dfc9ca85'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:22.783790 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:22.786305 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:22.791970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 848/1689] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:46:21 2022] DELETE /identity/v3/users/d2b19db1f76644838a24c2e7dfc9ca85 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:22.849181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a48181-f0be-4ee7-a900-dab7c967c9db None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:22.849181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a48181-f0be-4ee7-a900-dab7c967c9db None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:22.849181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a48181-f0be-4ee7-a900-dab7c967c9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:22.883879 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:22.910927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-a5a48181-f0be-4ee7-a900-dab7c967c9db None None] MFA Rules not processed for user `6863a714f4cf4350940d638c82fbc650`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:22.915969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a5a48181-f0be-4ee7-a900-dab7c967c9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:22.956849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3118b-6d7c-4519-99ae-7f74df7a6a99 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:23.138230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfa717-e69e-42c9-afe1-62893f0a25f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:23.139217 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfa717-e69e-42c9-afe1-62893f0a25f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:23.139497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfa717-e69e-42c9-afe1-62893f0a25f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:23.139771 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfa717-e69e-42c9-afe1-62893f0a25f0 admin admin] PATH_INFO: `/v3/projects/5319be794fde45c3a86c20248d6b2b41` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:23.141837 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfa717-e69e-42c9-afe1-62893f0a25f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5319be794fde45c3a86c20248d6b2b41)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:23.145275 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 849/1690] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:23.146274 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfa717-e69e-42c9-afe1-62893f0a25f0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:23.156213 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8055f8f-7d8c-4c5c-836b-38f012a60f96 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:23.156504 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8055f8f-7d8c-4c5c-836b-38f012a60f96 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:23.156785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8055f8f-7d8c-4c5c-836b-38f012a60f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:23.189787 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-a8055f8f-7d8c-4c5c-836b-38f012a60f96 None None] MFA Rules not processed for user `6863a714f4cf4350940d638c82fbc650`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:23.191214 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a8055f8f-7d8c-4c5c-836b-38f012a60f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:23.209047 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 850/1691] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:46:23.222101 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8055f8f-7d8c-4c5c-836b-38f012a60f96 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:23.223191 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a8055f8f-7d8c-4c5c-836b-38f012a60f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:23.359861 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8055f8f-7d8c-4c5c-836b-38f012a60f96 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:23.381510 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efb91d-9511-446a-b463-ff9d3697e7c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:23.382418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efb91d-9511-446a-b463-ff9d3697e7c2 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:23.384669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efb91d-9511-446a-b463-ff9d3697e7c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:23.385094 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efb91d-9511-446a-b463-ff9d3697e7c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:23.404397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efb91d-9511-446a-b463-ff9d3697e7c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:23.407468 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efb91d-9511-446a-b463-ff9d3697e7c2 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:23.436462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 851/1692] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:23.444832 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-11cfa717-e69e-42c9-afe1-62893f0a25f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5319be794fde45c3a86c20248d6b2b41', 'request_id': 'req-11cfa717-e69e-42c9-afe1-62893f0a25f0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:23.472613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-11cfa717-e69e-42c9-afe1-62893f0a25f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5319be794fde45c3a86c20248d6b2b41', 'request_id': 'req-11cfa717-e69e-42c9-afe1-62893f0a25f0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:23.648579 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-11cfa717-e69e-42c9-afe1-62893f0a25f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5319be794fde45c3a86c20248d6b2b41', 'request_id': 'req-11cfa717-e69e-42c9-afe1-62893f0a25f0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:23.690716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-11cfa717-e69e-42c9-afe1-62893f0a25f0 admin admin] The token cache is being invalidate because project 5319be794fde45c3a86c20248d6b2b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:46:23.691179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-11cfa717-e69e-42c9-afe1-62893f0a25f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:23.693284 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-11cfa717-e69e-42c9-afe1-62893f0a25f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:23.697790 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 842/1693] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:46:22 2022] DELETE /identity/v3/projects/5319be794fde45c3a86c20248d6b2b41 => generated 0 bytes in 914 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:23.702445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efb91d-9511-446a-b463-ff9d3697e7c2 service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:23.704102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-75efb91d-9511-446a-b463-ff9d3697e7c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:23.724353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efb91d-9511-446a-b463-ff9d3697e7c2 service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:23.764378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfa717-e69e-42c9-afe1-62893f0a25f0 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:23.766036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-11cfa717-e69e-42c9-afe1-62893f0a25f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:23.901180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecead23d-1085-45e7-93a6-394673c8bc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:23.907528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecead23d-1085-45e7-93a6-394673c8bc66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:23.910340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecead23d-1085-45e7-93a6-394673c8bc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:23.923946 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecead23d-1085-45e7-93a6-394673c8bc66 admin admin] PATH_INFO: `/v3/users/7f1764524a9a4dd5b2de017c81ab7179` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:23.938109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecead23d-1085-45e7-93a6-394673c8bc66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1764524a9a4dd5b2de017c81ab7179)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:23.940263 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecead23d-1085-45e7-93a6-394673c8bc66 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:24.002366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfa717-e69e-42c9-afe1-62893f0a25f0 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:24.028784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d234f8-29e1-4fa4-b857-9465131335f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:24.030180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d234f8-29e1-4fa4-b857-9465131335f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:24.030672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d234f8-29e1-4fa4-b857-9465131335f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:24.031171 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d234f8-29e1-4fa4-b857-9465131335f7 admin admin] PATH_INFO: `/v3/projects/ff9ee742475441ebb4f737d503220892` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:24.033468 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d234f8-29e1-4fa4-b857-9465131335f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff9ee742475441ebb4f737d503220892)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:24.035647 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d234f8-29e1-4fa4-b857-9465131335f7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:24.411016 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d3d234f8-29e1-4fa4-b857-9465131335f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff9ee742475441ebb4f737d503220892', 'request_id': 'req-d3d234f8-29e1-4fa4-b857-9465131335f7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:24.411097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ecead23d-1085-45e7-93a6-394673c8bc66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1764524a9a4dd5b2de017c81ab7179'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:24.426599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d3d234f8-29e1-4fa4-b857-9465131335f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff9ee742475441ebb4f737d503220892', 'request_id': 'req-d3d234f8-29e1-4fa4-b857-9465131335f7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:24.493468 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ecead23d-1085-45e7-93a6-394673c8bc66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1764524a9a4dd5b2de017c81ab7179'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:24.525927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ecead23d-1085-45e7-93a6-394673c8bc66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1764524a9a4dd5b2de017c81ab7179'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:24.527581 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ecead23d-1085-45e7-93a6-394673c8bc66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1764524a9a4dd5b2de017c81ab7179'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:24.547308 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d3d234f8-29e1-4fa4-b857-9465131335f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff9ee742475441ebb4f737d503220892', 'request_id': 'req-d3d234f8-29e1-4fa4-b857-9465131335f7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:24.567539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d3d234f8-29e1-4fa4-b857-9465131335f7 admin admin] The token cache is being invalidate because project ff9ee742475441ebb4f737d503220892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:46:24.567838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d3d234f8-29e1-4fa4-b857-9465131335f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:24.580012 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d3d234f8-29e1-4fa4-b857-9465131335f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:24.581856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 843/1694] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:46:23 2022] DELETE /identity/v3/projects/ff9ee742475441ebb4f737d503220892 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:24.596138 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fb0f3-bdc7-4e25-9fb2-d1a0192da6a3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:24.596425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fb0f3-bdc7-4e25-9fb2-d1a0192da6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:24.599688 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fb0f3-bdc7-4e25-9fb2-d1a0192da6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:24.607746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ecead23d-1085-45e7-93a6-394673c8bc66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1764524a9a4dd5b2de017c81ab7179'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:24.645026 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 852/1695] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:46:23 2022] DELETE /identity/v3/users/7f1764524a9a4dd5b2de017c81ab7179 => generated 0 bytes in 943 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:24.647148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a97d4b-93de-4ec6-99c2-d27559aa9059 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:24.649128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a97d4b-93de-4ec6-99c2-d27559aa9059 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:24.652910 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a97d4b-93de-4ec6-99c2-d27559aa9059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:24.664791 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a97fb0f3-bdc7-4e25-9fb2-d1a0192da6a3 None None] MFA Rules not processed for user `253f9ffb48dd4eaab87aae5316fb5394`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:24.667378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a97fb0f3-bdc7-4e25-9fb2-d1a0192da6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:24.736591 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:24.747973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-91a97d4b-93de-4ec6-99c2-d27559aa9059 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:24.758193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-91a97d4b-93de-4ec6-99c2-d27559aa9059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:24.831798 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 844/1696] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jun 1 17:46:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:24.916691 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 853/1697] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:24.925162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3351c-bc7e-4548-a103-f75fd171fa2a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:24.925845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3351c-bc7e-4548-a103-f75fd171fa2a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:24.930220 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3351c-bc7e-4548-a103-f75fd171fa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:24.971389 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8fb3351c-bc7e-4548-a103-f75fd171fa2a None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:24.975105 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8fb3351c-bc7e-4548-a103-f75fd171fa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:24.995973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 845/1698] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:25.001065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a97d4b-93de-4ec6-99c2-d27559aa9059 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:25.016012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a97d4b-93de-4ec6-99c2-d27559aa9059 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:25.033979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550abd97-b4ad-4e6c-b145-221491ea8166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:25.033979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550abd97-b4ad-4e6c-b145-221491ea8166 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:25.033979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550abd97-b4ad-4e6c-b145-221491ea8166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:25.033979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550abd97-b4ad-4e6c-b145-221491ea8166 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:25.034265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550abd97-b4ad-4e6c-b145-221491ea8166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:25.034265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550abd97-b4ad-4e6c-b145-221491ea8166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:25.034382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550abd97-b4ad-4e6c-b145-221491ea8166 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:25.067764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 854/1699] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:46:25.068827 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3351c-bc7e-4548-a103-f75fd171fa2a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:25.085436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3351c-bc7e-4548-a103-f75fd171fa2a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:25.090465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550abd97-b4ad-4e6c-b145-221491ea8166 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:25.092986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-550abd97-b4ad-4e6c-b145-221491ea8166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:25.106985 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b4712-74a4-4aa5-9990-f999709383e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:25.108096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b4712-74a4-4aa5-9990-f999709383e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:25.108644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b4712-74a4-4aa5-9990-f999709383e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:25.109332 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b4712-74a4-4aa5-9990-f999709383e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:25.110216 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b4712-74a4-4aa5-9990-f999709383e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:25.116416 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b4712-74a4-4aa5-9990-f999709383e5 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:25.139765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550abd97-b4ad-4e6c-b145-221491ea8166 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:25.158827 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601beeb-0b2a-42e4-9b8f-def4aed9d871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:25.159498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601beeb-0b2a-42e4-9b8f-def4aed9d871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:25.159936 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601beeb-0b2a-42e4-9b8f-def4aed9d871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:25.160652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601beeb-0b2a-42e4-9b8f-def4aed9d871 admin admin] PATH_INFO: `/v3/projects/d347f8ec163b4e25ae7a175ac8ca5771` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:25.164769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601beeb-0b2a-42e4-9b8f-def4aed9d871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d347f8ec163b4e25ae7a175ac8ca5771)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:25.169970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601beeb-0b2a-42e4-9b8f-def4aed9d871 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:25.298579 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 846/1700] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:25 2022] POST /identity/v3/projects => generated 373 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:25.299792 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b4712-74a4-4aa5-9990-f999709383e5 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:25.390332 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6601beeb-0b2a-42e4-9b8f-def4aed9d871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd347f8ec163b4e25ae7a175ac8ca5771', 'request_id': 'req-6601beeb-0b2a-42e4-9b8f-def4aed9d871'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:25.406502 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6601beeb-0b2a-42e4-9b8f-def4aed9d871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd347f8ec163b4e25ae7a175ac8ca5771', 'request_id': 'req-6601beeb-0b2a-42e4-9b8f-def4aed9d871'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:25.478928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6601beeb-0b2a-42e4-9b8f-def4aed9d871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd347f8ec163b4e25ae7a175ac8ca5771', 'request_id': 'req-6601beeb-0b2a-42e4-9b8f-def4aed9d871'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:25.490196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:25.499311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6601beeb-0b2a-42e4-9b8f-def4aed9d871 admin admin] The token cache is being invalidate because project d347f8ec163b4e25ae7a175ac8ca5771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:46:25.499717 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6601beeb-0b2a-42e4-9b8f-def4aed9d871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:25.500666 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6601beeb-0b2a-42e4-9b8f-def4aed9d871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:25.516271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 855/1701] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:46:25 2022] DELETE /identity/v3/projects/d347f8ec163b4e25ae7a175ac8ca5771 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:46:25.517494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601beeb-0b2a-42e4-9b8f-def4aed9d871 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:25.521794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6601beeb-0b2a-42e4-9b8f-def4aed9d871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:25.546105 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b4712-74a4-4aa5-9990-f999709383e5 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:25.631177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601beeb-0b2a-42e4-9b8f-def4aed9d871 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:25.656236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e95f73-06c8-48cb-803b-ef7dea7fd728 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f43a4bb5a18445b8836f4613cd5e14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:25.657260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e95f73-06c8-48cb-803b-ef7dea7fd728 service swift] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:25.657831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e95f73-06c8-48cb-803b-ef7dea7fd728 service swift] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:25.662085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e95f73-06c8-48cb-803b-ef7dea7fd728 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:25.665977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-46e95f73-06c8-48cb-803b-ef7dea7fd728 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:25.696304 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e8245-64a7-4e0c-9eb5-be7dd78c95be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:25.698473 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e8245-64a7-4e0c-9eb5-be7dd78c95be admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:25.698989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e8245-64a7-4e0c-9eb5-be7dd78c95be admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:25.699460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e8245-64a7-4e0c-9eb5-be7dd78c95be admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:25.700537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e8245-64a7-4e0c-9eb5-be7dd78c95be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:25.703921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e8245-64a7-4e0c-9eb5-be7dd78c95be admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:25.777696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e95f73-06c8-48cb-803b-ef7dea7fd728 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:25.786283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e95f73-06c8-48cb-803b-ef7dea7fd728 service swift] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:25.796124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 856/1702] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jun 1 17:46:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 17:46:25.818642 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae8d13-472c-4e24-b592-dce3ebeb8c96 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:25.819535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae8d13-472c-4e24-b592-dce3ebeb8c96 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:25.819535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae8d13-472c-4e24-b592-dce3ebeb8c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:25.837038 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 847/1703] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:25 2022] POST /identity/v3/users => generated 287 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:25.842554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e8245-64a7-4e0c-9eb5-be7dd78c95be admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:25.844761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c88e8245-64a7-4e0c-9eb5-be7dd78c95be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:25.882394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-1dae8d13-472c-4e24-b592-dce3ebeb8c96 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:25.887356 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-1dae8d13-472c-4e24-b592-dce3ebeb8c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:25.893596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e8245-64a7-4e0c-9eb5-be7dd78c95be admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:25.905483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 857/1704] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:25.911559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab817db-d7b7-4b0c-a5a8-4eea6af22879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:25.915126 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab817db-d7b7-4b0c-a5a8-4eea6af22879 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:25.916781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab817db-d7b7-4b0c-a5a8-4eea6af22879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:25.917285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab817db-d7b7-4b0c-a5a8-4eea6af22879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:25.925543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab817db-d7b7-4b0c-a5a8-4eea6af22879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:25.925543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab817db-d7b7-4b0c-a5a8-4eea6af22879 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:25.938486 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758388ce-ed6a-47f3-bdee-8a226d7c1693 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:25.938984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758388ce-ed6a-47f3-bdee-8a226d7c1693 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:25.939257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758388ce-ed6a-47f3-bdee-8a226d7c1693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:25.975157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 848/1705] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:46:25.979232 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab817db-d7b7-4b0c-a5a8-4eea6af22879 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:26.016716 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-758388ce-ed6a-47f3-bdee-8a226d7c1693 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:26.018374 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-758388ce-ed6a-47f3-bdee-8a226d7c1693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:26.020263 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab817db-d7b7-4b0c-a5a8-4eea6af22879 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:26.050867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb503b-5264-468e-b9d7-788d09390b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:26.053338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb503b-5264-468e-b9d7-788d09390b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:26.053338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb503b-5264-468e-b9d7-788d09390b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:26.053338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb503b-5264-468e-b9d7-788d09390b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:26.053338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb503b-5264-468e-b9d7-788d09390b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:26.054608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb503b-5264-468e-b9d7-788d09390b0d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:26.060978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 858/1706] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:26.062233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758388ce-ed6a-47f3-bdee-8a226d7c1693 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:26.087168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 849/1707] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:26.105152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb503b-5264-468e-b9d7-788d09390b0d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:26.108212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758388ce-ed6a-47f3-bdee-8a226d7c1693 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:26.122774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb503b-5264-468e-b9d7-788d09390b0d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:26.133770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735ce16-b5a2-443f-9498-9d655d03f40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:26.140926 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548afe15-04c6-4885-a049-26988898a232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:26.142024 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548afe15-04c6-4885-a049-26988898a232 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:26.142344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548afe15-04c6-4885-a049-26988898a232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:26.142878 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548afe15-04c6-4885-a049-26988898a232 admin admin] PATH_INFO: `/v3/projects/b991a2dc922d4f8baa539b1ab418492d/users/4695ce568c8c43e9a8d960ce76dc7ab2/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:26.143831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735ce16-b5a2-443f-9498-9d655d03f40e admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:26.144250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735ce16-b5a2-443f-9498-9d655d03f40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:26.162262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735ce16-b5a2-443f-9498-9d655d03f40e admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:26.163144 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735ce16-b5a2-443f-9498-9d655d03f40e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:26.163462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735ce16-b5a2-443f-9498-9d655d03f40e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:26.169728 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735ce16-b5a2-443f-9498-9d655d03f40e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:26.191155 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548afe15-04c6-4885-a049-26988898a232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b991a2dc922d4f8baa539b1ab418492d, user_id=4695ce568c8c43e9a8d960ce76dc7ab2, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:26.194136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548afe15-04c6-4885-a049-26988898a232 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:26.199105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 859/1708] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:46:26.203453 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735ce16-b5a2-443f-9498-9d655d03f40e admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:26.227927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735ce16-b5a2-443f-9498-9d655d03f40e admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:26.267133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027059b-192c-48eb-83d8-15eb54595082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:26.268017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027059b-192c-48eb-83d8-15eb54595082 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:26.268358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027059b-192c-48eb-83d8-15eb54595082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:26.268674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027059b-192c-48eb-83d8-15eb54595082 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:26.269479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027059b-192c-48eb-83d8-15eb54595082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:26.271490 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027059b-192c-48eb-83d8-15eb54595082 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:26.297218 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 850/1709] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:26 2022] PUT /identity/v3/projects/b991a2dc922d4f8baa539b1ab418492d/users/4695ce568c8c43e9a8d960ce76dc7ab2/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:26.302567 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678f9ca-551a-4191-bebd-680015decc65 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:26.303461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678f9ca-551a-4191-bebd-680015decc65 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:26.303461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678f9ca-551a-4191-bebd-680015decc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:26.377030 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7678f9ca-551a-4191-bebd-680015decc65 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:26.378414 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7678f9ca-551a-4191-bebd-680015decc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:26.455560 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 860/1710] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:26 2022] POST /identity/v3/projects => generated 357 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:46:26.459708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027059b-192c-48eb-83d8-15eb54595082 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:26.607719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 851/1711] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:26.619063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678f9ca-551a-4191-bebd-680015decc65 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:26.620721 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7678f9ca-551a-4191-bebd-680015decc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:26.707207 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027059b-192c-48eb-83d8-15eb54595082 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:26.725355 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb742b63-2d7e-4b72-82ee-cea8a34ead58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:26.731897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb742b63-2d7e-4b72-82ee-cea8a34ead58 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:26.731897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb742b63-2d7e-4b72-82ee-cea8a34ead58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:26.731897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb742b63-2d7e-4b72-82ee-cea8a34ead58 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:26.731897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb742b63-2d7e-4b72-82ee-cea8a34ead58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:26.737270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb742b63-2d7e-4b72-82ee-cea8a34ead58 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:26.803977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678f9ca-551a-4191-bebd-680015decc65 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:26.910231 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 861/1712] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:26 2022] POST /identity/v3/users => generated 279 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:46:26.912444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa5f30-f3c6-4c87-a1db-6a0fa7f7e939 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:26.912848 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa5f30-f3c6-4c87-a1db-6a0fa7f7e939 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:26.913284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa5f30-f3c6-4c87-a1db-6a0fa7f7e939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:26.943865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23620d5f-649c-4301-ae74-b7a50ae47492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:26.957421 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23620d5f-649c-4301-ae74-b7a50ae47492 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:26.957570 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23620d5f-649c-4301-ae74-b7a50ae47492 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:26.957875 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23620d5f-649c-4301-ae74-b7a50ae47492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:26.966893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-49fa5f30-f3c6-4c87-a1db-6a0fa7f7e939 None None] MFA Rules not processed for user `6f0ce995acc646d88f47c92e8458931a`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:26.971054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-49fa5f30-f3c6-4c87-a1db-6a0fa7f7e939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:26.978715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23620d5f-649c-4301-ae74-b7a50ae47492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:26.980242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23620d5f-649c-4301-ae74-b7a50ae47492 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:27.012565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 852/1713] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:46:27.012565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23620d5f-649c-4301-ae74-b7a50ae47492 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:27.034011 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23620d5f-649c-4301-ae74-b7a50ae47492 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:27.064979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965398d4-baa4-465f-955f-3c78c0c21573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:27.065717 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965398d4-baa4-465f-955f-3c78c0c21573 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:27.065954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965398d4-baa4-465f-955f-3c78c0c21573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:27.066460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965398d4-baa4-465f-955f-3c78c0c21573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:27.067201 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965398d4-baa4-465f-955f-3c78c0c21573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:27.068912 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965398d4-baa4-465f-955f-3c78c0c21573 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:27.107774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 853/1714] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:27.110148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965398d4-baa4-465f-955f-3c78c0c21573 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:27.142834 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965398d4-baa4-465f-955f-3c78c0c21573 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:27.195371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969d367-e452-488a-beba-875de2573932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:27.207765 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969d367-e452-488a-beba-875de2573932 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:27.209457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969d367-e452-488a-beba-875de2573932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:27.209931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969d367-e452-488a-beba-875de2573932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:27.210979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969d367-e452-488a-beba-875de2573932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:27.215154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969d367-e452-488a-beba-875de2573932 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:27.236128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 862/1715] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:27.243489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 854/1716] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:27.248742 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa5f30-f3c6-4c87-a1db-6a0fa7f7e939 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:27.265201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa5f30-f3c6-4c87-a1db-6a0fa7f7e939 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:27.270658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d251-664e-493d-814b-d49a71b50fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:27.277664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d251-664e-493d-814b-d49a71b50fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:27.277926 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d251-664e-493d-814b-d49a71b50fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:27.278456 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d251-664e-493d-814b-d49a71b50fb5 admin admin] PATH_INFO: `/v3/projects/2445f1798a23484380a55085d5ff276e/users/7d622e7ba2e74459bce0db0ee260e1f7/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:27.315424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06d251-664e-493d-814b-d49a71b50fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2445f1798a23484380a55085d5ff276e, user_id=7d622e7ba2e74459bce0db0ee260e1f7, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:27.407447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06d251-664e-493d-814b-d49a71b50fb5 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:28.015966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 863/1717] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:27 2022] PUT /identity/v3/projects/2445f1798a23484380a55085d5ff276e/users/7d622e7ba2e74459bce0db0ee260e1f7/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:28.018556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad586f-137f-4098-b066-91af6262a93c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:28.018918 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad586f-137f-4098-b066-91af6262a93c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:28.019298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad586f-137f-4098-b066-91af6262a93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:28.072507 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-aaad586f-137f-4098-b066-91af6262a93c None None] MFA Rules not processed for user `7d622e7ba2e74459bce0db0ee260e1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:28.075098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-aaad586f-137f-4098-b066-91af6262a93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:28.198865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:28.255241 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 855/1718] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:28 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:28.256841 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d251-664e-493d-814b-d49a71b50fb5 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:28.370399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868a9e9-46b8-4082-a86f-e4f63e27cf90 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:28.370702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868a9e9-46b8-4082-a86f-e4f63e27cf90 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:28.371099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868a9e9-46b8-4082-a86f-e4f63e27cf90 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:28.373572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 856/1719] 10.222.0.33 () {54 vars in 912 bytes} [Wed Jun 1 17:46:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:46:28.404742 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c61a7d-fe98-436c-a44e-588dd8c89ddb None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:28.405034 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c61a7d-fe98-436c-a44e-588dd8c89ddb None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:28.405218 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c61a7d-fe98-436c-a44e-588dd8c89ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:28.460508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-76c61a7d-fe98-436c-a44e-588dd8c89ddb None None] MFA Rules not processed for user `4254398f2aac42f7b54f29294a73bfda`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:28.461893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-76c61a7d-fe98-436c-a44e-588dd8c89ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:28.638805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d251-664e-493d-814b-d49a71b50fb5 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:28.668317 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20440e5a-4279-49a3-9df4-aafaae25e3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:28.669640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20440e5a-4279-49a3-9df4-aafaae25e3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:28.670104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20440e5a-4279-49a3-9df4-aafaae25e3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:28.670553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20440e5a-4279-49a3-9df4-aafaae25e3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:28.671616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20440e5a-4279-49a3-9df4-aafaae25e3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:28.674693 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20440e5a-4279-49a3-9df4-aafaae25e3b9 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:28.683989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 857/1720] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jun 1 17:46:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:46:28.725070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c61a7d-fe98-436c-a44e-588dd8c89ddb None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:28.737566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c61a7d-fe98-436c-a44e-588dd8c89ddb None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:28.750011 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f27ff-54a5-44a9-a8ee-71933affdb8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:28.750704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f27ff-54a5-44a9-a8ee-71933affdb8b service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:28.750990 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f27ff-54a5-44a9-a8ee-71933affdb8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:28.751273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f27ff-54a5-44a9-a8ee-71933affdb8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:28.782055 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f27ff-54a5-44a9-a8ee-71933affdb8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:28.783696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f27ff-54a5-44a9-a8ee-71933affdb8b service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:28.803765 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 858/1721] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:46:28.825949 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 864/1722] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:28 2022] POST /identity/v3/projects => generated 357 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:28.830364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f27ff-54a5-44a9-a8ee-71933affdb8b service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:28.851065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f27ff-54a5-44a9-a8ee-71933affdb8b service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:29.004323 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db675-2b41-474d-8929-a62667523487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:29.005331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db675-2b41-474d-8929-a62667523487 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:29.005792 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db675-2b41-474d-8929-a62667523487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:29.006221 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db675-2b41-474d-8929-a62667523487 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:29.007104 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1db675-2b41-474d-8929-a62667523487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:29.009116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1db675-2b41-474d-8929-a62667523487 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:29.159916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d01faf-5c5c-4a8d-94cc-fe57ab3fde43 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:29.160804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d01faf-5c5c-4a8d-94cc-fe57ab3fde43 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:29.161292 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d01faf-5c5c-4a8d-94cc-fe57ab3fde43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:29.183786 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 859/1723] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:28 2022] POST /identity/v3/users => generated 285 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:46:29.185570 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db675-2b41-474d-8929-a62667523487 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:29.213460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-e3d01faf-5c5c-4a8d-94cc-fe57ab3fde43 None None] MFA Rules not processed for user `4254398f2aac42f7b54f29294a73bfda`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:29.214990 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e3d01faf-5c5c-4a8d-94cc-fe57ab3fde43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:29.222919 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db675-2b41-474d-8929-a62667523487 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:29.239468 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b7e41-66f4-4742-95cf-903c4dc02aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:29.240175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b7e41-66f4-4742-95cf-903c4dc02aff admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:29.240464 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b7e41-66f4-4742-95cf-903c4dc02aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:29.240747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b7e41-66f4-4742-95cf-903c4dc02aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:29.241528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b7e41-66f4-4742-95cf-903c4dc02aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:29.243169 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b7e41-66f4-4742-95cf-903c4dc02aff admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:29.269826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 860/1724] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:29.281905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305809b-2bc2-41cc-8d9b-416caaf282b8 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:29.282199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305809b-2bc2-41cc-8d9b-416caaf282b8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:29.282490 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305809b-2bc2-41cc-8d9b-416caaf282b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:29.362660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1305809b-2bc2-41cc-8d9b-416caaf282b8 None None] MFA Rules not processed for user `6863a714f4cf4350940d638c82fbc650`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:29.366192 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1305809b-2bc2-41cc-8d9b-416caaf282b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:29.374788 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 865/1725] 10.222.0.72 () {58 vars in 1015 bytes} [Wed Jun 1 17:46:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:46:29.375669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d01faf-5c5c-4a8d-94cc-fe57ab3fde43 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:29.394649 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:29.402227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d01faf-5c5c-4a8d-94cc-fe57ab3fde43 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:29.408244 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08b898-d37d-46aa-a805-7d39311f2d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:29.409197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08b898-d37d-46aa-a805-7d39311f2d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:29.409487 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08b898-d37d-46aa-a805-7d39311f2d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:29.409769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08b898-d37d-46aa-a805-7d39311f2d02 admin admin] PATH_INFO: `/v3/projects/172ddd531f1749a68bcccfd863a333b3/users/861fc85d9ddb41a786d0faa1d803aa03/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:29.444217 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08b898-d37d-46aa-a805-7d39311f2d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=172ddd531f1749a68bcccfd863a333b3, user_id=861fc85d9ddb41a786d0faa1d803aa03, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:29.447029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08b898-d37d-46aa-a805-7d39311f2d02 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:29.551856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 866/1726] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:29 2022] PUT /identity/v3/projects/172ddd531f1749a68bcccfd863a333b3/users/861fc85d9ddb41a786d0faa1d803aa03/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:29.555885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08b898-d37d-46aa-a805-7d39311f2d02 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:29.568755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 861/1727] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:29.571746 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305809b-2bc2-41cc-8d9b-416caaf282b8 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:29.578991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1305809b-2bc2-41cc-8d9b-416caaf282b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:29.610292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305809b-2bc2-41cc-8d9b-416caaf282b8 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:29.787766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08b898-d37d-46aa-a805-7d39311f2d02 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:29.802314 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62baf0b3-9fb4-4794-bca8-a0b0c1ec0a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:29.802885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62baf0b3-9fb4-4794-bca8-a0b0c1ec0a12 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:29.803217 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62baf0b3-9fb4-4794-bca8-a0b0c1ec0a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:29.803495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec5acf-338b-4a5b-94c2-2d9f31c47709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:29.803610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62baf0b3-9fb4-4794-bca8-a0b0c1ec0a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:29.804202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec5acf-338b-4a5b-94c2-2d9f31c47709 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:29.804576 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec5acf-338b-4a5b-94c2-2d9f31c47709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:29.804768 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec5acf-338b-4a5b-94c2-2d9f31c47709 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:29.812024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec5acf-338b-4a5b-94c2-2d9f31c47709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:29.813693 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec5acf-338b-4a5b-94c2-2d9f31c47709 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:29.842924 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62baf0b3-9fb4-4794-bca8-a0b0c1ec0a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:29.844474 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62baf0b3-9fb4-4794-bca8-a0b0c1ec0a12 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:29.882120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 867/1728] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:29.882120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec5acf-338b-4a5b-94c2-2d9f31c47709 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:29.884110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 862/1729] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:29.907538 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec5acf-338b-4a5b-94c2-2d9f31c47709 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:29.921597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24cd49-fff7-4f30-828a-5ff093e344dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:29.923474 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24cd49-fff7-4f30-828a-5ff093e344dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:29.923827 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24cd49-fff7-4f30-828a-5ff093e344dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:29.924123 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24cd49-fff7-4f30-828a-5ff093e344dd admin admin] PATH_INFO: `/v3/projects/172ddd531f1749a68bcccfd863a333b3/users/861fc85d9ddb41a786d0faa1d803aa03/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:29.933036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24cd49-fff7-4f30-828a-5ff093e344dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=172ddd531f1749a68bcccfd863a333b3, user_id=861fc85d9ddb41a786d0faa1d803aa03, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:29.938281 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24cd49-fff7-4f30-828a-5ff093e344dd admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:29.965169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 868/1730] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:29 2022] PUT /identity/v3/projects/172ddd531f1749a68bcccfd863a333b3/users/861fc85d9ddb41a786d0faa1d803aa03/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:29.977217 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1314d-727e-4ae8-9ac6-780822473290 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:29.977434 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1314d-727e-4ae8-9ac6-780822473290 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:29.977732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1314d-727e-4ae8-9ac6-780822473290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:30.014067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8af1314d-727e-4ae8-9ac6-780822473290 None None] MFA Rules not processed for user `861fc85d9ddb41a786d0faa1d803aa03`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:30.015513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8af1314d-727e-4ae8-9ac6-780822473290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:30.337567 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 863/1731] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:29 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:30.366088 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24cd49-fff7-4f30-828a-5ff093e344dd admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:30.368458 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-be24cd49-fff7-4f30-828a-5ff093e344dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:30.583130 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24cd49-fff7-4f30-828a-5ff093e344dd admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:30.602992 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a957da-453b-4eec-becb-baf63f95dda5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:30.608598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a957da-453b-4eec-becb-baf63f95dda5 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:30.609200 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a957da-453b-4eec-becb-baf63f95dda5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:30.609685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a957da-453b-4eec-becb-baf63f95dda5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:30.654078 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a957da-453b-4eec-becb-baf63f95dda5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:30.655574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a957da-453b-4eec-becb-baf63f95dda5 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:30.688681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 869/1732] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:30 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:31.124366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1314d-727e-4ae8-9ac6-780822473290 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:31.126059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8af1314d-727e-4ae8-9ac6-780822473290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:31.152033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1314d-727e-4ae8-9ac6-780822473290 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:31.157372 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813eaf0-4371-4297-b587-208c5f8bb46e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:31.158015 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813eaf0-4371-4297-b587-208c5f8bb46e service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:31.158498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813eaf0-4371-4297-b587-208c5f8bb46e service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:31.158973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813eaf0-4371-4297-b587-208c5f8bb46e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:31.199323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a957da-453b-4eec-becb-baf63f95dda5 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:31.200722 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-88a957da-453b-4eec-becb-baf63f95dda5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:31.308266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:31.445928 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813eaf0-4371-4297-b587-208c5f8bb46e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:31.447402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813eaf0-4371-4297-b587-208c5f8bb46e service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:31.480738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a957da-453b-4eec-becb-baf63f95dda5 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:31.482671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 864/1733] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:31 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:31.492761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98742def-717b-47ef-a96c-6db45b9b10df None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:31.493106 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98742def-717b-47ef-a96c-6db45b9b10df None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:31.493393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98742def-717b-47ef-a96c-6db45b9b10df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:31.505289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff41bb-0f2a-41ff-9092-c3d16c816938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:31.506678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff41bb-0f2a-41ff-9092-c3d16c816938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:31.510118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff41bb-0f2a-41ff-9092-c3d16c816938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:31.516437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff41bb-0f2a-41ff-9092-c3d16c816938 admin admin] PATH_INFO: `/v3/users/244da1ff5fc347978e237e4eb45f7741` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:31.516437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff41bb-0f2a-41ff-9092-c3d16c816938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=244da1ff5fc347978e237e4eb45f7741)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:31.523919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff41bb-0f2a-41ff-9092-c3d16c816938 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:31.575154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-98742def-717b-47ef-a96c-6db45b9b10df None None] MFA Rules not processed for user `7e29d3b37ec342fe91765a8b13354bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:31.576486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-98742def-717b-47ef-a96c-6db45b9b10df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:31.781015 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 865/1734] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:31.784917 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0b0dd-840d-4e51-8656-0c229d6bd756 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:31.794627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0b0dd-840d-4e51-8656-0c229d6bd756 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:31.795373 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0b0dd-840d-4e51-8656-0c229d6bd756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:31.861589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:31.896488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8dd0b0dd-840d-4e51-8656-0c229d6bd756 None None] MFA Rules not processed for user `4695ce568c8c43e9a8d960ce76dc7ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:31.896585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e1ff41bb-0f2a-41ff-9092-c3d16c816938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244da1ff5fc347978e237e4eb45f7741'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:31.905097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8dd0b0dd-840d-4e51-8656-0c229d6bd756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:31.998897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e1ff41bb-0f2a-41ff-9092-c3d16c816938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244da1ff5fc347978e237e4eb45f7741'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:32.015469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e1ff41bb-0f2a-41ff-9092-c3d16c816938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244da1ff5fc347978e237e4eb45f7741'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:32.018485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e1ff41bb-0f2a-41ff-9092-c3d16c816938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244da1ff5fc347978e237e4eb45f7741'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:32.086140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e1ff41bb-0f2a-41ff-9092-c3d16c816938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244da1ff5fc347978e237e4eb45f7741'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:32.102366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 870/1735] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:46:31 2022] DELETE /identity/v3/users/244da1ff5fc347978e237e4eb45f7741 => generated 0 bytes in 903 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:32.109844 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8b3ea-8c30-4b0f-bd01-518330ce2e71 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:32.110709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8b3ea-8c30-4b0f-bd01-518330ce2e71 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:32.112490 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8b3ea-8c30-4b0f-bd01-518330ce2e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:32.173136 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-8cd8b3ea-8c30-4b0f-bd01-518330ce2e71 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:32.184109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8cd8b3ea-8c30-4b0f-bd01-518330ce2e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:32.194929 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 866/1736] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:32.197585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0b0dd-840d-4e51-8656-0c229d6bd756 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:32.199599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8dd0b0dd-840d-4e51-8656-0c229d6bd756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:32.231941 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0b0dd-840d-4e51-8656-0c229d6bd756 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:32.377009 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 871/1737] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:32.381520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9b5d-11e8-465a-833e-4cdc1c9e16d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:32.382976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9b5d-11e8-465a-833e-4cdc1c9e16d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:32.383205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9b5d-11e8-465a-833e-4cdc1c9e16d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:32.383478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc9b5d-11e8-465a-833e-4cdc1c9e16d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:32.384356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc9b5d-11e8-465a-833e-4cdc1c9e16d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:32.389166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc9b5d-11e8-465a-833e-4cdc1c9e16d7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:32.418699 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8b3ea-8c30-4b0f-bd01-518330ce2e71 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:32.421943 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8cd8b3ea-8c30-4b0f-bd01-518330ce2e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:32.542055 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8b3ea-8c30-4b0f-bd01-518330ce2e71 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:32.563469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 867/1738] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:32 2022] POST /identity/v3/projects => generated 373 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:32.566859 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9b5d-11e8-465a-833e-4cdc1c9e16d7 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:32.574862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520cbe6-d8cd-4e98-bfa4-2c94c718359a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:32.577413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520cbe6-d8cd-4e98-bfa4-2c94c718359a service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:32.579166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520cbe6-d8cd-4e98-bfa4-2c94c718359a service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:32.579629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520cbe6-d8cd-4e98-bfa4-2c94c718359a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:32.617564 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520cbe6-d8cd-4e98-bfa4-2c94c718359a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:32.618643 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520cbe6-d8cd-4e98-bfa4-2c94c718359a service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:32.662126 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 872/1739] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:32.794222 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc9b5d-11e8-465a-833e-4cdc1c9e16d7 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:32.813652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fd7ca-ae04-4c4f-8d50-bf1cdd22d69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:32.814639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fd7ca-ae04-4c4f-8d50-bf1cdd22d69b admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:32.814936 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fd7ca-ae04-4c4f-8d50-bf1cdd22d69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:32.815222 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fd7ca-ae04-4c4f-8d50-bf1cdd22d69b admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:32.815986 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fd7ca-ae04-4c4f-8d50-bf1cdd22d69b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:32.819058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fd7ca-ae04-4c4f-8d50-bf1cdd22d69b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:32.930513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 868/1740] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:32 2022] POST /identity/v3/users => generated 293 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:32.931732 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520cbe6-d8cd-4e98-bfa4-2c94c718359a service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:32.947045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520cbe6-d8cd-4e98-bfa4-2c94c718359a service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:32.957936 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734897ee-8f0d-4e26-ac0b-dc75993c7c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:32.957936 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734897ee-8f0d-4e26-ac0b-dc75993c7c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:32.957936 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734897ee-8f0d-4e26-ac0b-dc75993c7c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:32.958341 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734897ee-8f0d-4e26-ac0b-dc75993c7c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:32.959546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734897ee-8f0d-4e26-ac0b-dc75993c7c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:32.974688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734897ee-8f0d-4e26-ac0b-dc75993c7c80 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:33.001168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fd7ca-ae04-4c4f-8d50-bf1cdd22d69b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:33.013046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 873/1741] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:46:33.014726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fd7ca-ae04-4c4f-8d50-bf1cdd22d69b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:33.047353 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03e804-393a-4a60-8eda-016c3350180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:33.049131 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03e804-393a-4a60-8eda-016c3350180e admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:33.049692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03e804-393a-4a60-8eda-016c3350180e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:33.050534 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03e804-393a-4a60-8eda-016c3350180e admin admin] PATH_INFO: `/v3/projects/c1cf86d7ddaf4eb8b2f8fa4c543da903/users/ba0f642c46594140b4dd7c270250d271/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:33.110557 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03e804-393a-4a60-8eda-016c3350180e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1cf86d7ddaf4eb8b2f8fa4c543da903, user_id=ba0f642c46594140b4dd7c270250d271, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:33.116651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03e804-393a-4a60-8eda-016c3350180e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:33.255874 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7680e3-9088-4bc0-a94f-73736d09bc73 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:33.256831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7680e3-9088-4bc0-a94f-73736d09bc73 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:33.259097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7680e3-9088-4bc0-a94f-73736d09bc73 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:33.262949 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 874/1742] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jun 1 17:46:33 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:46:33.275977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 869/1743] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:32 2022] PUT /identity/v3/projects/c1cf86d7ddaf4eb8b2f8fa4c543da903/users/ba0f642c46594140b4dd7c270250d271/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:33.281742 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7680e3-9088-4bc0-a94f-73736d09bc73 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:33.287831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae97ac-7403-450e-970a-02acafd439ec None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:33.288431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae97ac-7403-450e-970a-02acafd439ec None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:33.288927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae97ac-7403-450e-970a-02acafd439ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:33.308290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:33.315176 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-acae97ac-7403-450e-970a-02acafd439ec None None] MFA Rules not processed for user `5d5a5ba6aecd46e79dc7199589384a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:33.316821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-acae97ac-7403-450e-970a-02acafd439ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:33.433104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:33.445321 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 870/1744] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jun 1 17:46:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:33.586330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7680e3-9088-4bc0-a94f-73736d09bc73 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:33.603227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb2bca-31f6-4a7f-9376-29c126d5947c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:33.617120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb2bca-31f6-4a7f-9376-29c126d5947c admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:33.617120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb2bca-31f6-4a7f-9376-29c126d5947c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:33.617120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb2bca-31f6-4a7f-9376-29c126d5947c admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:33.617120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb2bca-31f6-4a7f-9376-29c126d5947c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:33.617120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb2bca-31f6-4a7f-9376-29c126d5947c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:33.652614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 875/1745] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:33.655256 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae97ac-7403-450e-970a-02acafd439ec None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:33.670631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae97ac-7403-450e-970a-02acafd439ec None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:33.676511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ed4eb-a958-454e-8151-9eb2e8022877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:33.677584 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ed4eb-a958-454e-8151-9eb2e8022877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:33.677884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ed4eb-a958-454e-8151-9eb2e8022877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:33.678219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ed4eb-a958-454e-8151-9eb2e8022877 admin admin] PATH_INFO: `/v3/projects/c1cf86d7ddaf4eb8b2f8fa4c543da903/users/ba0f642c46594140b4dd7c270250d271/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:33.682615 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ed4eb-a958-454e-8151-9eb2e8022877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1cf86d7ddaf4eb8b2f8fa4c543da903, user_id=ba0f642c46594140b4dd7c270250d271, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:33.685527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ed4eb-a958-454e-8151-9eb2e8022877 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:33.705289 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 871/1746] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:33 2022] PUT /identity/v3/projects/c1cf86d7ddaf4eb8b2f8fa4c543da903/users/ba0f642c46594140b4dd7c270250d271/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:46:33.977166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb2bca-31f6-4a7f-9376-29c126d5947c admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:33.986320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-01eb2bca-31f6-4a7f-9376-29c126d5947c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:34.008634 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb2bca-31f6-4a7f-9376-29c126d5947c admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:34.079187 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:34.156718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b41e9-44e5-4e7e-a26d-4f5b6b51e660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:34.157644 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b41e9-44e5-4e7e-a26d-4f5b6b51e660 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:34.158157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b41e9-44e5-4e7e-a26d-4f5b6b51e660 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:34.158384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b41e9-44e5-4e7e-a26d-4f5b6b51e660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:34.170967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b41e9-44e5-4e7e-a26d-4f5b6b51e660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:34.174311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b41e9-44e5-4e7e-a26d-4f5b6b51e660 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:34.189080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 876/1747] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:34.255995 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ed4eb-a958-454e-8151-9eb2e8022877 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:34.258417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-126ed4eb-a958-454e-8151-9eb2e8022877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:34.530474 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ed4eb-a958-454e-8151-9eb2e8022877 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:34.542186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590530af-9220-4a82-aac5-0b302bcfaf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:34.546362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590530af-9220-4a82-aac5-0b302bcfaf8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:34.546863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590530af-9220-4a82-aac5-0b302bcfaf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:34.547723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590530af-9220-4a82-aac5-0b302bcfaf8e admin admin] PATH_INFO: `/v3/projects/4aaa73c27b284b01b6465b2103280827` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:34.552270 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590530af-9220-4a82-aac5-0b302bcfaf8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aaa73c27b284b01b6465b2103280827)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:34.558777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590530af-9220-4a82-aac5-0b302bcfaf8e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:34.896028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-590530af-9220-4a82-aac5-0b302bcfaf8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aaa73c27b284b01b6465b2103280827', 'request_id': 'req-590530af-9220-4a82-aac5-0b302bcfaf8e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:34.907750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-590530af-9220-4a82-aac5-0b302bcfaf8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aaa73c27b284b01b6465b2103280827', 'request_id': 'req-590530af-9220-4a82-aac5-0b302bcfaf8e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:34.961767 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:35.016425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-590530af-9220-4a82-aac5-0b302bcfaf8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aaa73c27b284b01b6465b2103280827', 'request_id': 'req-590530af-9220-4a82-aac5-0b302bcfaf8e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:35.034977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-590530af-9220-4a82-aac5-0b302bcfaf8e admin admin] The token cache is being invalidate because project 4aaa73c27b284b01b6465b2103280827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:46:35.037293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-590530af-9220-4a82-aac5-0b302bcfaf8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:35.040613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-590530af-9220-4a82-aac5-0b302bcfaf8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:35.042568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 872/1748] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:46:34 2022] DELETE /identity/v3/projects/4aaa73c27b284b01b6465b2103280827 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:35.047319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b41e9-44e5-4e7e-a26d-4f5b6b51e660 service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:35.073488 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b41e9-44e5-4e7e-a26d-4f5b6b51e660 service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:35.272273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcc54d-8d33-40f0-b701-595f0b0d5e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:35.273234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcc54d-8d33-40f0-b701-595f0b0d5e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:35.273518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcc54d-8d33-40f0-b701-595f0b0d5e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:35.273798 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcc54d-8d33-40f0-b701-595f0b0d5e04 admin admin] PATH_INFO: `/v3/users/ec46c70c26274919a7b33b0136ef86df` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:35.275285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcc54d-8d33-40f0-b701-595f0b0d5e04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec46c70c26274919a7b33b0136ef86df)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:35.277829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcc54d-8d33-40f0-b701-595f0b0d5e04 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:35.548912 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9fbcc54d-8d33-40f0-b701-595f0b0d5e04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec46c70c26274919a7b33b0136ef86df'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:35.615947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:35.693596 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9fbcc54d-8d33-40f0-b701-595f0b0d5e04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec46c70c26274919a7b33b0136ef86df'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:35.702276 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9fbcc54d-8d33-40f0-b701-595f0b0d5e04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec46c70c26274919a7b33b0136ef86df'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:35.703198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9fbcc54d-8d33-40f0-b701-595f0b0d5e04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec46c70c26274919a7b33b0136ef86df'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:35.719545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9fbcc54d-8d33-40f0-b701-595f0b0d5e04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec46c70c26274919a7b33b0136ef86df'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:35.727285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 877/1749] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:46:35 2022] DELETE /identity/v3/users/ec46c70c26274919a7b33b0136ef86df => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:36.459527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:36.515348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:36.593402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590530af-9220-4a82-aac5-0b302bcfaf8e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:36.595450 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-590530af-9220-4a82-aac5-0b302bcfaf8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:36.616582 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590530af-9220-4a82-aac5-0b302bcfaf8e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:36.708190 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2328d-e2aa-4476-9bf1-a1de8596dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:36.709606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2328d-e2aa-4476-9bf1-a1de8596dbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:36.710092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2328d-e2aa-4476-9bf1-a1de8596dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:36.710585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2328d-e2aa-4476-9bf1-a1de8596dbeb admin admin] PATH_INFO: `/v3/projects/2027f25f1eaf49f3a0b7285300b8aeb3` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:36.712178 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2328d-e2aa-4476-9bf1-a1de8596dbeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2027f25f1eaf49f3a0b7285300b8aeb3)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:36.715099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2328d-e2aa-4476-9bf1-a1de8596dbeb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:36.863126 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-79c2328d-e2aa-4476-9bf1-a1de8596dbeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2027f25f1eaf49f3a0b7285300b8aeb3', 'request_id': 'req-79c2328d-e2aa-4476-9bf1-a1de8596dbeb'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:36.879655 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-79c2328d-e2aa-4476-9bf1-a1de8596dbeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2027f25f1eaf49f3a0b7285300b8aeb3', 'request_id': 'req-79c2328d-e2aa-4476-9bf1-a1de8596dbeb'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:36.936423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-79c2328d-e2aa-4476-9bf1-a1de8596dbeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2027f25f1eaf49f3a0b7285300b8aeb3', 'request_id': 'req-79c2328d-e2aa-4476-9bf1-a1de8596dbeb'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:36.948726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-79c2328d-e2aa-4476-9bf1-a1de8596dbeb admin admin] The token cache is being invalidate because project 2027f25f1eaf49f3a0b7285300b8aeb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:46:36.949221 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-79c2328d-e2aa-4476-9bf1-a1de8596dbeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:36.952085 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-79c2328d-e2aa-4476-9bf1-a1de8596dbeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:36.954338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 873/1750] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:46:36 2022] DELETE /identity/v3/projects/2027f25f1eaf49f3a0b7285300b8aeb3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:36.959505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfe0fe-7bfb-4fc4-9147-9a9e59bff3d6 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:36.959863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfe0fe-7bfb-4fc4-9147-9a9e59bff3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:36.960090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfe0fe-7bfb-4fc4-9147-9a9e59bff3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:36.982242 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-8ecfe0fe-7bfb-4fc4-9147-9a9e59bff3d6 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:36.983491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8ecfe0fe-7bfb-4fc4-9147-9a9e59bff3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:37.053753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783159ed-141e-40eb-8bc2-a6063530df95 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:37.054065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783159ed-141e-40eb-8bc2-a6063530df95 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:37.054325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783159ed-141e-40eb-8bc2-a6063530df95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:37.087698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 878/1751] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:37.095639 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcffeb-e42f-45fd-9b57-71c2b08566fd None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:37.096023 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcffeb-e42f-45fd-9b57-71c2b08566fd None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:37.096485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcffeb-e42f-45fd-9b57-71c2b08566fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:37.098569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-783159ed-141e-40eb-8bc2-a6063530df95 None None] MFA Rules not processed for user `ba0f642c46594140b4dd7c270250d271`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:37.099891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-783159ed-141e-40eb-8bc2-a6063530df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:37.119585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-84bcffeb-e42f-45fd-9b57-71c2b08566fd None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:37.122357 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-84bcffeb-e42f-45fd-9b57-71c2b08566fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:37.136844 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 879/1752] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:37.138813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcffeb-e42f-45fd-9b57-71c2b08566fd None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:37.150627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcffeb-e42f-45fd-9b57-71c2b08566fd None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:37.156630 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbdae3-38b9-4f11-89e7-0ed4d3f7c02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:37.157490 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbdae3-38b9-4f11-89e7-0ed4d3f7c02b admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:37.157782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbdae3-38b9-4f11-89e7-0ed4d3f7c02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:37.158068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbdae3-38b9-4f11-89e7-0ed4d3f7c02b admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:37.158955 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbdae3-38b9-4f11-89e7-0ed4d3f7c02b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:37.159277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbdae3-38b9-4f11-89e7-0ed4d3f7c02b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:37.161410 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbdae3-38b9-4f11-89e7-0ed4d3f7c02b admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:37.179984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 880/1753] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:46:37.180997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbdae3-38b9-4f11-89e7-0ed4d3f7c02b admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:37.193091 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbdae3-38b9-4f11-89e7-0ed4d3f7c02b admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:37.198696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3680b18-a49c-4ca3-9467-7d3b904e2ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:37.199380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680b18-a49c-4ca3-9467-7d3b904e2ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:37.199669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680b18-a49c-4ca3-9467-7d3b904e2ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:37.200789 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680b18-a49c-4ca3-9467-7d3b904e2ca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:37.201671 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3680b18-a49c-4ca3-9467-7d3b904e2ca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:37.203701 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3680b18-a49c-4ca3-9467-7d3b904e2ca9 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:37.276623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 874/1754] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:37.292877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783159ed-141e-40eb-8bc2-a6063530df95 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:37.298419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-783159ed-141e-40eb-8bc2-a6063530df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:37.359252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 881/1755] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:37 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:37.360571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3680b18-a49c-4ca3-9467-7d3b904e2ca9 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:37.432330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783159ed-141e-40eb-8bc2-a6063530df95 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:37.463104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3680b18-a49c-4ca3-9467-7d3b904e2ca9 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:37.469871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cba5a-98b6-4415-8c1d-fc41788ca940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:37.470599 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cba5a-98b6-4415-8c1d-fc41788ca940 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:37.471152 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cba5a-98b6-4415-8c1d-fc41788ca940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:37.471306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cba5a-98b6-4415-8c1d-fc41788ca940 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:37.476894 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cba5a-98b6-4415-8c1d-fc41788ca940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:37.476894 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cba5a-98b6-4415-8c1d-fc41788ca940 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:37.511862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03f975-ddd4-4333-9d7a-606082bd84e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:37.513252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03f975-ddd4-4333-9d7a-606082bd84e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:37.513897 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03f975-ddd4-4333-9d7a-606082bd84e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:37.514304 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03f975-ddd4-4333-9d7a-606082bd84e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:37.516537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-dc03f975-ddd4-4333-9d7a-606082bd84e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:37.584196 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 882/1756] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:37 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:37.594817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cba5a-98b6-4415-8c1d-fc41788ca940 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:37.609337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03f975-ddd4-4333-9d7a-606082bd84e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:37.611360 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03f975-ddd4-4333-9d7a-606082bd84e2 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:37.612211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cba5a-98b6-4415-8c1d-fc41788ca940 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:37.624037 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 875/1757] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:37.630256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3b8e2-07b5-462c-9023-a7555c9219d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:37.630256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3b8e2-07b5-462c-9023-a7555c9219d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:37.630256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3b8e2-07b5-462c-9023-a7555c9219d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:37.630256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3b8e2-07b5-462c-9023-a7555c9219d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:37.630792 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3b8e2-07b5-462c-9023-a7555c9219d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:37.630792 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3b8e2-07b5-462c-9023-a7555c9219d6 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:37.643663 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 883/1758] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:46:37.648029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03f975-ddd4-4333-9d7a-606082bd84e2 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:37.660833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03f975-ddd4-4333-9d7a-606082bd84e2 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:37.667384 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0b947-3e35-42bf-8f4d-fac071a47257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:37.668379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0b947-3e35-42bf-8f4d-fac071a47257 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:37.669299 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0b947-3e35-42bf-8f4d-fac071a47257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:37.669619 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0b947-3e35-42bf-8f4d-fac071a47257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:37.671162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0b947-3e35-42bf-8f4d-fac071a47257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:37.673066 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0b947-3e35-42bf-8f4d-fac071a47257 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:37.688805 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 876/1759] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:37.693525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3b8e2-07b5-462c-9023-a7555c9219d6 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:37.712305 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3b8e2-07b5-462c-9023-a7555c9219d6 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:37.726483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706237a-3778-43af-9b46-0a4af6912b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:37.726483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706237a-3778-43af-9b46-0a4af6912b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:37.726483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706237a-3778-43af-9b46-0a4af6912b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:37.726483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706237a-3778-43af-9b46-0a4af6912b2f admin admin] PATH_INFO: `/v3/projects/ee913dafe28e4142859a898e5aa10a4c/users/1de8d64de60d46caba6a1df86be63de4/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:37.780546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706237a-3778-43af-9b46-0a4af6912b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee913dafe28e4142859a898e5aa10a4c, user_id=1de8d64de60d46caba6a1df86be63de4, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:37.783315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706237a-3778-43af-9b46-0a4af6912b2f admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:37.906112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 884/1760] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:37 2022] PUT /identity/v3/projects/ee913dafe28e4142859a898e5aa10a4c/users/1de8d64de60d46caba6a1df86be63de4/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:37.908793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a554d2-5694-4509-8159-bcf293a49c48 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:37.909248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a554d2-5694-4509-8159-bcf293a49c48 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:37.909473 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a554d2-5694-4509-8159-bcf293a49c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:37.944494 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-91a554d2-5694-4509-8159-bcf293a49c48 None None] MFA Rules not processed for user `1de8d64de60d46caba6a1df86be63de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:37.946087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-91a554d2-5694-4509-8159-bcf293a49c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:38.030585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 877/1761] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:38.035572 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706237a-3778-43af-9b46-0a4af6912b2f admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:38.093621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:38.121169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706237a-3778-43af-9b46-0a4af6912b2f admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:38.126451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea8a51-0ecd-4b09-8029-48af71f7c9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:38.127131 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea8a51-0ecd-4b09-8029-48af71f7c9fd admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:38.127425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea8a51-0ecd-4b09-8029-48af71f7c9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:38.127702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea8a51-0ecd-4b09-8029-48af71f7c9fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:38.128481 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea8a51-0ecd-4b09-8029-48af71f7c9fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:38.130597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea8a51-0ecd-4b09-8029-48af71f7c9fd admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:38.671615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 885/1762] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:38 2022] POST /identity/v3/projects => generated 365 bytes in 637 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:46:38.681003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a554d2-5694-4509-8159-bcf293a49c48 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:38.716117 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a554d2-5694-4509-8159-bcf293a49c48 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:38.846222 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed63b71-519b-40b2-b9f0-03f3aefd3b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:38.847096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed63b71-519b-40b2-b9f0-03f3aefd3b37 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:38.847368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed63b71-519b-40b2-b9f0-03f3aefd3b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:38.847690 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed63b71-519b-40b2-b9f0-03f3aefd3b37 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:38.848883 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed63b71-519b-40b2-b9f0-03f3aefd3b37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:38.852736 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed63b71-519b-40b2-b9f0-03f3aefd3b37 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:38.973881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 878/1763] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:38 2022] POST /identity/v3/users => generated 289 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:38.980734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea8a51-0ecd-4b09-8029-48af71f7c9fd admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:38.996619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea8a51-0ecd-4b09-8029-48af71f7c9fd admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:39.003115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e2af1-f5c1-42a2-a5c3-c9c84567f7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:39.003963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e2af1-f5c1-42a2-a5c3-c9c84567f7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:39.004395 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e2af1-f5c1-42a2-a5c3-c9c84567f7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:39.004895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e2af1-f5c1-42a2-a5c3-c9c84567f7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:39.005915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e2af1-f5c1-42a2-a5c3-c9c84567f7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:39.007659 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e2af1-f5c1-42a2-a5c3-c9c84567f7f3 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:39.021208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 886/1764] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:39.025435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed63b71-519b-40b2-b9f0-03f3aefd3b37 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:39.037961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed63b71-519b-40b2-b9f0-03f3aefd3b37 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:39.043920 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231d22f-ae12-483e-8940-90d29d7d2047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:39.044978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231d22f-ae12-483e-8940-90d29d7d2047 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:39.062591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231d22f-ae12-483e-8940-90d29d7d2047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:39.062591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231d22f-ae12-483e-8940-90d29d7d2047 admin admin] PATH_INFO: `/v3/projects/888d806a52984426a6523469ea422941/users/0f4136465ea54cffae78a03433d4b466/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:39.062591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231d22f-ae12-483e-8940-90d29d7d2047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=888d806a52984426a6523469ea422941, user_id=0f4136465ea54cffae78a03433d4b466, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:39.064352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231d22f-ae12-483e-8940-90d29d7d2047 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:39.220871 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 879/1765] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:39 2022] PUT /identity/v3/projects/888d806a52984426a6523469ea422941/users/0f4136465ea54cffae78a03433d4b466/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:46:39.223130 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e2af1-f5c1-42a2-a5c3-c9c84567f7f3 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:39.236732 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e2af1-f5c1-42a2-a5c3-c9c84567f7f3 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:39.325876 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740a820-d086-47de-bb1c-4d6ebee35eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:39.326574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740a820-d086-47de-bb1c-4d6ebee35eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:39.326850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740a820-d086-47de-bb1c-4d6ebee35eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:39.327273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740a820-d086-47de-bb1c-4d6ebee35eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:39.328155 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740a820-d086-47de-bb1c-4d6ebee35eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:39.330053 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740a820-d086-47de-bb1c-4d6ebee35eb0 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:39.343405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 887/1766] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:39.347551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231d22f-ae12-483e-8940-90d29d7d2047 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:39.366880 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231d22f-ae12-483e-8940-90d29d7d2047 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:39.371857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adada0f6-4447-41c2-925c-28ed20c806a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:39.373175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adada0f6-4447-41c2-925c-28ed20c806a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:39.373469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adada0f6-4447-41c2-925c-28ed20c806a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:39.373815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adada0f6-4447-41c2-925c-28ed20c806a1 admin admin] PATH_INFO: `/v3/projects/888d806a52984426a6523469ea422941/users/0f4136465ea54cffae78a03433d4b466/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:39.375856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adada0f6-4447-41c2-925c-28ed20c806a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=888d806a52984426a6523469ea422941, user_id=0f4136465ea54cffae78a03433d4b466, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:39.378556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adada0f6-4447-41c2-925c-28ed20c806a1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:39.410035 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 880/1767] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:39 2022] PUT /identity/v3/projects/888d806a52984426a6523469ea422941/users/0f4136465ea54cffae78a03433d4b466/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:39.413219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577961f-6af6-4a1b-a2e4-00623af7d883 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:39.413991 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577961f-6af6-4a1b-a2e4-00623af7d883 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:39.414489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577961f-6af6-4a1b-a2e4-00623af7d883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:39.446285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-8577961f-6af6-4a1b-a2e4-00623af7d883 None None] MFA Rules not processed for user `0f4136465ea54cffae78a03433d4b466`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:39.447520 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8577961f-6af6-4a1b-a2e4-00623af7d883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:39.534069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 888/1768] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:39.545563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adada0f6-4447-41c2-925c-28ed20c806a1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:39.547493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-adada0f6-4447-41c2-925c-28ed20c806a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:39.577739 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:39.611312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adada0f6-4447-41c2-925c-28ed20c806a1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:39.615297 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0cd58-8ce4-4452-a09f-3b166204061e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:39.615959 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0cd58-8ce4-4452-a09f-3b166204061e service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:39.616253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0cd58-8ce4-4452-a09f-3b166204061e service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:39.616531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0cd58-8ce4-4452-a09f-3b166204061e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:39.626192 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0cd58-8ce4-4452-a09f-3b166204061e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:39.627827 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0cd58-8ce4-4452-a09f-3b166204061e service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:39.638340 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 881/1769] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:39.912102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577961f-6af6-4a1b-a2e4-00623af7d883 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:39.922043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577961f-6af6-4a1b-a2e4-00623af7d883 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:39.925918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096733a-4df9-491f-8f27-77cf27ed0892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:39.926678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096733a-4df9-491f-8f27-77cf27ed0892 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:39.927057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096733a-4df9-491f-8f27-77cf27ed0892 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:39.927428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096733a-4df9-491f-8f27-77cf27ed0892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:39.989628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096733a-4df9-491f-8f27-77cf27ed0892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:39.991342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096733a-4df9-491f-8f27-77cf27ed0892 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:40.002147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 889/1770] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:40.360901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:40.937596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:41.413195 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0cd58-8ce4-4452-a09f-3b166204061e service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:41.427569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0cd58-8ce4-4452-a09f-3b166204061e service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:41.433012 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbff2b-fce4-4f6c-81ca-f1bcdaeb2b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:41.433904 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbff2b-fce4-4f6c-81ca-f1bcdaeb2b8c service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:41.434426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbff2b-fce4-4f6c-81ca-f1bcdaeb2b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:41.434886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbff2b-fce4-4f6c-81ca-f1bcdaeb2b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:41.435153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096733a-4df9-491f-8f27-77cf27ed0892 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:41.436734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-9096733a-4df9-491f-8f27-77cf27ed0892 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:41.518924 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096733a-4df9-491f-8f27-77cf27ed0892 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:41.525127 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e55b84-f544-4d90-8c29-940858c8c658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:41.526114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e55b84-f544-4d90-8c29-940858c8c658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:41.526404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e55b84-f544-4d90-8c29-940858c8c658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:41.526682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e55b84-f544-4d90-8c29-940858c8c658 admin admin] PATH_INFO: `/v3/users/3c0c8541ed94493bb2e31c7fd2c9d5e2` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:41.528228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e55b84-f544-4d90-8c29-940858c8c658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0c8541ed94493bb2e31c7fd2c9d5e2)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:41.530232 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e55b84-f544-4d90-8c29-940858c8c658 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:41.531602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbff2b-fce4-4f6c-81ca-f1bcdaeb2b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:41.533175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbff2b-fce4-4f6c-81ca-f1bcdaeb2b8c service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:41.544270 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 882/1771] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:41.764736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-63e55b84-f544-4d90-8c29-940858c8c658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0c8541ed94493bb2e31c7fd2c9d5e2'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:41.861877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-63e55b84-f544-4d90-8c29-940858c8c658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0c8541ed94493bb2e31c7fd2c9d5e2'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:41.884600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-63e55b84-f544-4d90-8c29-940858c8c658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0c8541ed94493bb2e31c7fd2c9d5e2'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:41.885662 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-63e55b84-f544-4d90-8c29-940858c8c658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0c8541ed94493bb2e31c7fd2c9d5e2'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:41.901506 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-63e55b84-f544-4d90-8c29-940858c8c658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0c8541ed94493bb2e31c7fd2c9d5e2'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:41.909806 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 890/1772] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:46:41 2022] DELETE /identity/v3/users/3c0c8541ed94493bb2e31c7fd2c9d5e2 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:46:41.914231 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ebada-e8f9-4e63-9043-1a0d472b9b5e None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:41.914528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ebada-e8f9-4e63-9043-1a0d472b9b5e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:41.914811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ebada-e8f9-4e63-9043-1a0d472b9b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:41.933485 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-bf1ebada-e8f9-4e63-9043-1a0d472b9b5e None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:41.935303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-bf1ebada-e8f9-4e63-9043-1a0d472b9b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:42.008498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 883/1773] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:42.026733 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e55b84-f544-4d90-8c29-940858c8c658 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:42.026733 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-63e55b84-f544-4d90-8c29-940858c8c658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:42.086321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e55b84-f544-4d90-8c29-940858c8c658 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:42.091002 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd2be3-6376-4a91-877a-2b3412fd8d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:42.091751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd2be3-6376-4a91-877a-2b3412fd8d25 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:42.092032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd2be3-6376-4a91-877a-2b3412fd8d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:42.092313 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd2be3-6376-4a91-877a-2b3412fd8d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:42.101691 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd2be3-6376-4a91-877a-2b3412fd8d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:42.103122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd2be3-6376-4a91-877a-2b3412fd8d25 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:42.112592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 891/1774] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:42.433180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:42.777696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:42.933224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ebada-e8f9-4e63-9043-1a0d472b9b5e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:42.934714 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-bf1ebada-e8f9-4e63-9043-1a0d472b9b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:42.952162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ebada-e8f9-4e63-9043-1a0d472b9b5e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:42.958473 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aec053-de51-4c73-a792-9b94b2830b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:42.964541 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aec053-de51-4c73-a792-9b94b2830b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:42.964541 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aec053-de51-4c73-a792-9b94b2830b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:42.964541 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aec053-de51-4c73-a792-9b94b2830b63 admin admin] PATH_INFO: `/v3/projects/6a2c566980d84710b879c2fbc053793f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:42.964541 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aec053-de51-4c73-a792-9b94b2830b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a2c566980d84710b879c2fbc053793f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:42.964541 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aec053-de51-4c73-a792-9b94b2830b63 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:43.210989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-61aec053-de51-4c73-a792-9b94b2830b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2c566980d84710b879c2fbc053793f', 'request_id': 'req-61aec053-de51-4c73-a792-9b94b2830b63'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:43.219825 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-61aec053-de51-4c73-a792-9b94b2830b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2c566980d84710b879c2fbc053793f', 'request_id': 'req-61aec053-de51-4c73-a792-9b94b2830b63'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:43.320684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-61aec053-de51-4c73-a792-9b94b2830b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2c566980d84710b879c2fbc053793f', 'request_id': 'req-61aec053-de51-4c73-a792-9b94b2830b63'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:43.341639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-61aec053-de51-4c73-a792-9b94b2830b63 admin admin] The token cache is being invalidate because project 6a2c566980d84710b879c2fbc053793f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:46:43.341639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-61aec053-de51-4c73-a792-9b94b2830b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:43.341639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-61aec053-de51-4c73-a792-9b94b2830b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:43.341639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 884/1775] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:46:42 2022] DELETE /identity/v3/projects/6a2c566980d84710b879c2fbc053793f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:43.342239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70275808-0766-4d20-8212-ea9aa217765f None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:43.342674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70275808-0766-4d20-8212-ea9aa217765f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:43.342820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70275808-0766-4d20-8212-ea9aa217765f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:43.372534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-70275808-0766-4d20-8212-ea9aa217765f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:43.373995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-70275808-0766-4d20-8212-ea9aa217765f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:43.444534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 892/1776] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:43.453918 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca2b7b-4101-45f1-af40-a7d7fdefb29c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:43.454252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca2b7b-4101-45f1-af40-a7d7fdefb29c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:43.454544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca2b7b-4101-45f1-af40-a7d7fdefb29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:43.473689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-91ca2b7b-4101-45f1-af40-a7d7fdefb29c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:43.474916 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-91ca2b7b-4101-45f1-af40-a7d7fdefb29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:43.487124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 885/1777] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:43.491493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70275808-0766-4d20-8212-ea9aa217765f None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:43.502134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70275808-0766-4d20-8212-ea9aa217765f None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:43.506966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f937990-2925-447b-b5b4-17c134f3449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:43.508973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f937990-2925-447b-b5b4-17c134f3449d admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:43.509250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f937990-2925-447b-b5b4-17c134f3449d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:43.509532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f937990-2925-447b-b5b4-17c134f3449d admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:43.510264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f937990-2925-447b-b5b4-17c134f3449d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:43.510577 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f937990-2925-447b-b5b4-17c134f3449d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:43.512221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f937990-2925-447b-b5b4-17c134f3449d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:43.524355 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 893/1778] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:46:43.528715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca2b7b-4101-45f1-af40-a7d7fdefb29c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:43.537928 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca2b7b-4101-45f1-af40-a7d7fdefb29c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:43.542455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed82ff-7d3e-473c-8f25-5abee2b6f681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:43.543140 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed82ff-7d3e-473c-8f25-5abee2b6f681 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:43.543969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed82ff-7d3e-473c-8f25-5abee2b6f681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:43.544238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed82ff-7d3e-473c-8f25-5abee2b6f681 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:43.553006 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed82ff-7d3e-473c-8f25-5abee2b6f681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:43.553006 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed82ff-7d3e-473c-8f25-5abee2b6f681 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:43.722985 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 886/1779] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:43 2022] POST /identity/v3/projects => generated 403 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:43.723656 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f937990-2925-447b-b5b4-17c134f3449d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:43.814429 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f937990-2925-447b-b5b4-17c134f3449d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:43.817565 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a70c6-20db-4362-b2b1-3700dc2aa53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:43.818322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a70c6-20db-4362-b2b1-3700dc2aa53f admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:43.818607 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a70c6-20db-4362-b2b1-3700dc2aa53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:43.818888 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a70c6-20db-4362-b2b1-3700dc2aa53f admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:43.819583 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a70c6-20db-4362-b2b1-3700dc2aa53f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:43.821684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a70c6-20db-4362-b2b1-3700dc2aa53f admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:44.793199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed82ff-7d3e-473c-8f25-5abee2b6f681 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:44.795118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 894/1780] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:43 2022] POST /identity/v3/users => generated 302 bytes in 1072 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:46:44.805449 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed82ff-7d3e-473c-8f25-5abee2b6f681 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:44.811583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7ff68-a9a1-4eaa-b302-a4039b3b9fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:44.812268 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7ff68-a9a1-4eaa-b302-a4039b3b9fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:44.812558 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7ff68-a9a1-4eaa-b302-a4039b3b9fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:44.812828 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7ff68-a9a1-4eaa-b302-a4039b3b9fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:44.813726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7ff68-a9a1-4eaa-b302-a4039b3b9fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:44.815575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7ff68-a9a1-4eaa-b302-a4039b3b9fd6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:44.827895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 887/1781] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:44.831870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a70c6-20db-4362-b2b1-3700dc2aa53f admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:44.843218 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a70c6-20db-4362-b2b1-3700dc2aa53f admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:44.848883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5e273-71f3-4571-9c91-e7a384f75d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:44.850034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5e273-71f3-4571-9c91-e7a384f75d8e admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:44.850202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5e273-71f3-4571-9c91-e7a384f75d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:44.850572 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5e273-71f3-4571-9c91-e7a384f75d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:44.851149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5e273-71f3-4571-9c91-e7a384f75d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:44.853215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5e273-71f3-4571-9c91-e7a384f75d8e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:44.867061 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 895/1782] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:46:44.871028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7ff68-a9a1-4eaa-b302-a4039b3b9fd6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:44.891936 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7ff68-a9a1-4eaa-b302-a4039b3b9fd6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:44.903151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff38b2-586a-4cb5-9c7f-ab991d3feee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:44.905248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff38b2-586a-4cb5-9c7f-ab991d3feee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:44.906998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff38b2-586a-4cb5-9c7f-ab991d3feee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:44.909114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff38b2-586a-4cb5-9c7f-ab991d3feee3 admin admin] PATH_INFO: `/v3/projects/90b19d1db92b4e3084873e4a4fd22ae0/users/005fbd36c07241e69cce69879642354a/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:44.947715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff38b2-586a-4cb5-9c7f-ab991d3feee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b19d1db92b4e3084873e4a4fd22ae0, user_id=005fbd36c07241e69cce69879642354a, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:44.954461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff38b2-586a-4cb5-9c7f-ab991d3feee3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:45.023363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:45.035864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 888/1783] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:44 2022] PUT /identity/v3/projects/90b19d1db92b4e3084873e4a4fd22ae0/users/005fbd36c07241e69cce69879642354a/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:45.047676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badfbab-7cc9-4716-bad6-4ec0569da6ec None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:45.048054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badfbab-7cc9-4716-bad6-4ec0569da6ec None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:45.048394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badfbab-7cc9-4716-bad6-4ec0569da6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:45.100559 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-8badfbab-7cc9-4716-bad6-4ec0569da6ec None None] MFA Rules not processed for user `005fbd36c07241e69cce69879642354a`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:45.106410 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8badfbab-7cc9-4716-bad6-4ec0569da6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:45.319590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 896/1784] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:45.323076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff38b2-586a-4cb5-9c7f-ab991d3feee3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:45.374707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badfbab-7cc9-4716-bad6-4ec0569da6ec None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:45.376312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8badfbab-7cc9-4716-bad6-4ec0569da6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:45.474711 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:45.559972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badfbab-7cc9-4716-bad6-4ec0569da6ec None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:45.581503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e56876-4a01-4c3b-b5f7-584b475f72be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:45.583476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e56876-4a01-4c3b-b5f7-584b475f72be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:45.584552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e56876-4a01-4c3b-b5f7-584b475f72be admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:45.585106 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e56876-4a01-4c3b-b5f7-584b475f72be admin admin] PATH_INFO: `/v3/users/1de8d64de60d46caba6a1df86be63de4` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:45.586806 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e56876-4a01-4c3b-b5f7-584b475f72be admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de8d64de60d46caba6a1df86be63de4)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:45.592066 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff38b2-586a-4cb5-9c7f-ab991d3feee3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:45.599142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e56876-4a01-4c3b-b5f7-584b475f72be admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:45.624339 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fcaf2-6e78-4834-88b9-f4aeb94f0566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:45.626463 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fcaf2-6e78-4834-88b9-f4aeb94f0566 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:45.628860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fcaf2-6e78-4834-88b9-f4aeb94f0566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:45.629280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fcaf2-6e78-4834-88b9-f4aeb94f0566 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:45.630106 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fcaf2-6e78-4834-88b9-f4aeb94f0566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:45.634437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fcaf2-6e78-4834-88b9-f4aeb94f0566 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:45.751857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 889/1785] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:45 2022] POST /identity/v3/projects => generated 405 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:45.755696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fcaf2-6e78-4834-88b9-f4aeb94f0566 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:45.834577 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c3e56876-4a01-4c3b-b5f7-584b475f72be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de8d64de60d46caba6a1df86be63de4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:45.875193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fcaf2-6e78-4834-88b9-f4aeb94f0566 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:45.881271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24875ea-a528-4073-a9ba-9e49941b0733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:45.882170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24875ea-a528-4073-a9ba-9e49941b0733 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:45.882636 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24875ea-a528-4073-a9ba-9e49941b0733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:45.883063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24875ea-a528-4073-a9ba-9e49941b0733 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:45.883975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24875ea-a528-4073-a9ba-9e49941b0733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:45.886168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24875ea-a528-4073-a9ba-9e49941b0733 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:45.900830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c3e56876-4a01-4c3b-b5f7-584b475f72be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de8d64de60d46caba6a1df86be63de4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:45.910297 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c3e56876-4a01-4c3b-b5f7-584b475f72be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de8d64de60d46caba6a1df86be63de4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:45.911142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c3e56876-4a01-4c3b-b5f7-584b475f72be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de8d64de60d46caba6a1df86be63de4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:45.943811 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c3e56876-4a01-4c3b-b5f7-584b475f72be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de8d64de60d46caba6a1df86be63de4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:45.951532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 897/1786] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:46:45 2022] DELETE /identity/v3/users/1de8d64de60d46caba6a1df86be63de4 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:45.956253 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f67c0d-96d1-4c92-90ab-a71c206ba0c5 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:45.956869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f67c0d-96d1-4c92-90ab-a71c206ba0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:45.957388 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f67c0d-96d1-4c92-90ab-a71c206ba0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:45.979329 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-05f67c0d-96d1-4c92-90ab-a71c206ba0c5 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:45.981372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-05f67c0d-96d1-4c92-90ab-a71c206ba0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:45.987870 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 890/1787] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:45 2022] POST /identity/v3/users => generated 309 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:46:45.988854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24875ea-a528-4073-a9ba-9e49941b0733 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:45.994397 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c24875ea-a528-4073-a9ba-9e49941b0733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:46.023833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24875ea-a528-4073-a9ba-9e49941b0733 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:46.129977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 898/1788] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:46.141484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6796e1-963a-4b0d-b5a2-d4596ec0e497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:46.143021 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6796e1-963a-4b0d-b5a2-d4596ec0e497 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:46.143320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6796e1-963a-4b0d-b5a2-d4596ec0e497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:46.143606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6796e1-963a-4b0d-b5a2-d4596ec0e497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:46.144359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6796e1-963a-4b0d-b5a2-d4596ec0e497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:46.146943 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f67c0d-96d1-4c92-90ab-a71c206ba0c5 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:46.148363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-05f67c0d-96d1-4c92-90ab-a71c206ba0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:46.150018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6796e1-963a-4b0d-b5a2-d4596ec0e497 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:46.167081 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 891/1789] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:46.168274 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6796e1-963a-4b0d-b5a2-d4596ec0e497 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:46.192487 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6796e1-963a-4b0d-b5a2-d4596ec0e497 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:46.205527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad69b2-4263-4d0e-a58a-ff9b9af7c54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:46.206068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad69b2-4263-4d0e-a58a-ff9b9af7c54d admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:46.206355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad69b2-4263-4d0e-a58a-ff9b9af7c54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:46.206634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad69b2-4263-4d0e-a58a-ff9b9af7c54d admin admin] PATH_INFO: `/v3/projects/46ed73eba36443c09fb377d6aaada2d6/users/b0a82776b8bd4150a09d2b07df770123/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:46.235112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f67c0d-96d1-4c92-90ab-a71c206ba0c5 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:46.239624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad69b2-4263-4d0e-a58a-ff9b9af7c54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ed73eba36443c09fb377d6aaada2d6, user_id=b0a82776b8bd4150a09d2b07df770123, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:46.245398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138ba3a-c11e-42fe-b34e-a3afd7323af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:46.245398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138ba3a-c11e-42fe-b34e-a3afd7323af1 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:46.245599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad69b2-4263-4d0e-a58a-ff9b9af7c54d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:46.245672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138ba3a-c11e-42fe-b34e-a3afd7323af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:46.245672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138ba3a-c11e-42fe-b34e-a3afd7323af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:46.272115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138ba3a-c11e-42fe-b34e-a3afd7323af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:46.274593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138ba3a-c11e-42fe-b34e-a3afd7323af1 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:46.290784 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 899/1790] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:46.343714 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 892/1791] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:46 2022] PUT /identity/v3/projects/46ed73eba36443c09fb377d6aaada2d6/users/b0a82776b8bd4150a09d2b07df770123/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:46.348060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138ba3a-c11e-42fe-b34e-a3afd7323af1 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:46.362393 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138ba3a-c11e-42fe-b34e-a3afd7323af1 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:46.368037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:46.439796 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa2c6f-86b4-4bf6-ad26-b376d61248ef None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:46.440091 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa2c6f-86b4-4bf6-ad26-b376d61248ef None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:46.440489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa2c6f-86b4-4bf6-ad26-b376d61248ef None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:46.443098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 893/1792] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jun 1 17:46:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:46:46.486939 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a03f85-c844-47c6-8128-de8963532ffd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:46.487234 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a03f85-c844-47c6-8128-de8963532ffd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:46.487495 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a03f85-c844-47c6-8128-de8963532ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:46.493425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3c5e9-f171-4712-aa16-7e413cfeb119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:46.495973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3c5e9-f171-4712-aa16-7e413cfeb119 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:46.496200 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3c5e9-f171-4712-aa16-7e413cfeb119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:46.497256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3c5e9-f171-4712-aa16-7e413cfeb119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:46.498140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3c5e9-f171-4712-aa16-7e413cfeb119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:46.499793 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3c5e9-f171-4712-aa16-7e413cfeb119 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:46.536044 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-02a03f85-c844-47c6-8128-de8963532ffd None None] MFA Rules not processed for user `5d5a5ba6aecd46e79dc7199589384a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:46.536044 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-02a03f85-c844-47c6-8128-de8963532ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:46.537016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 900/1793] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:46.537016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3c5e9-f171-4712-aa16-7e413cfeb119 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:46.550867 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3c5e9-f171-4712-aa16-7e413cfeb119 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:46.573429 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c096cf-936b-4647-9a4a-b1761e0cad89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:46.574092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c096cf-936b-4647-9a4a-b1761e0cad89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:46.574320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c096cf-936b-4647-9a4a-b1761e0cad89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:46.574633 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c096cf-936b-4647-9a4a-b1761e0cad89 admin admin] PATH_INFO: `/v3/projects/46ed73eba36443c09fb377d6aaada2d6/users/b0a82776b8bd4150a09d2b07df770123/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:46.579778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c096cf-936b-4647-9a4a-b1761e0cad89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ed73eba36443c09fb377d6aaada2d6, user_id=b0a82776b8bd4150a09d2b07df770123, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:46.589425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c096cf-936b-4647-9a4a-b1761e0cad89 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:46.633941 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 901/1794] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:46 2022] PUT /identity/v3/projects/46ed73eba36443c09fb377d6aaada2d6/users/b0a82776b8bd4150a09d2b07df770123/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:46.636419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c85cb-8b0b-4084-9d00-a9b988b98b05 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:46.636716 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c85cb-8b0b-4084-9d00-a9b988b98b05 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:46.637967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c85cb-8b0b-4084-9d00-a9b988b98b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:46.718124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 894/1795] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jun 1 17:46:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:46.718329 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-f71c85cb-8b0b-4084-9d00-a9b988b98b05 None None] MFA Rules not processed for user `b0a82776b8bd4150a09d2b07df770123`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:46.719652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f71c85cb-8b0b-4084-9d00-a9b988b98b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:46.887653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 902/1796] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:46 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:46:47.008511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a03f85-c844-47c6-8128-de8963532ffd None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:47.011294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-02a03f85-c844-47c6-8128-de8963532ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:47.034118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c85cb-8b0b-4084-9d00-a9b988b98b05 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:47.035580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f71c85cb-8b0b-4084-9d00-a9b988b98b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:47.193408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a03f85-c844-47c6-8128-de8963532ffd None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:47.234766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c85cb-8b0b-4084-9d00-a9b988b98b05 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:47.242221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284c834-87f0-4909-b7cd-50740b94c82d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:47.242936 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284c834-87f0-4909-b7cd-50740b94c82d service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:47.243254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284c834-87f0-4909-b7cd-50740b94c82d service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:47.243511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284c834-87f0-4909-b7cd-50740b94c82d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:47.259509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284c834-87f0-4909-b7cd-50740b94c82d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:47.261600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284c834-87f0-4909-b7cd-50740b94c82d service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:47.278708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 903/1797] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:46:47.279604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284c834-87f0-4909-b7cd-50740b94c82d service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:47.282511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f284c834-87f0-4909-b7cd-50740b94c82d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:47.290442 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a48acb-e53f-4581-9c50-c880cc166f57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:47.291413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a48acb-e53f-4581-9c50-c880cc166f57 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:47.291806 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a48acb-e53f-4581-9c50-c880cc166f57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:47.292597 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a48acb-e53f-4581-9c50-c880cc166f57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:47.312482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a48acb-e53f-4581-9c50-c880cc166f57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:47.314517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a48acb-e53f-4581-9c50-c880cc166f57 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:47.328330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 895/1798] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:47 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:47.415326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284c834-87f0-4909-b7cd-50740b94c82d service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:47.421468 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ba05d-1999-4904-b432-36fc77d50a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:47.422673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ba05d-1999-4904-b432-36fc77d50a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:47.427312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ba05d-1999-4904-b432-36fc77d50a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:47.427312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ba05d-1999-4904-b432-36fc77d50a32 admin admin] PATH_INFO: `/v3/projects/ee913dafe28e4142859a898e5aa10a4c` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:47.427312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ba05d-1999-4904-b432-36fc77d50a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee913dafe28e4142859a898e5aa10a4c)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:47.427743 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ba05d-1999-4904-b432-36fc77d50a32 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:47.504300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef894b59-9da9-42a5-9a17-5bdb3d9452fa None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:47.504599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef894b59-9da9-42a5-9a17-5bdb3d9452fa None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:47.504796 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef894b59-9da9-42a5-9a17-5bdb3d9452fa None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:47.506566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 896/1799] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jun 1 17:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:46:47.520773 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de7fef-00b9-4f49-afd4-cd0fc3cedfce None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:47.521216 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de7fef-00b9-4f49-afd4-cd0fc3cedfce None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:47.521790 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de7fef-00b9-4f49-afd4-cd0fc3cedfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:47.546193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f4de7fef-00b9-4f49-afd4-cd0fc3cedfce None None] MFA Rules not processed for user `5d5a5ba6aecd46e79dc7199589384a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:47.547587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f4de7fef-00b9-4f49-afd4-cd0fc3cedfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:47.557858 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 897/1800] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jun 1 17:46:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:47.571678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de7fef-00b9-4f49-afd4-cd0fc3cedfce None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:47.573508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f4de7fef-00b9-4f49-afd4-cd0fc3cedfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:47.592096 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-993ba05d-1999-4904-b432-36fc77d50a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee913dafe28e4142859a898e5aa10a4c', 'request_id': 'req-993ba05d-1999-4904-b432-36fc77d50a32'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:47.603585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-993ba05d-1999-4904-b432-36fc77d50a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee913dafe28e4142859a898e5aa10a4c', 'request_id': 'req-993ba05d-1999-4904-b432-36fc77d50a32'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:47.605406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de7fef-00b9-4f49-afd4-cd0fc3cedfce None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:47.686063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-993ba05d-1999-4904-b432-36fc77d50a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee913dafe28e4142859a898e5aa10a4c', 'request_id': 'req-993ba05d-1999-4904-b432-36fc77d50a32'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:47.699501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-993ba05d-1999-4904-b432-36fc77d50a32 admin admin] The token cache is being invalidate because project ee913dafe28e4142859a898e5aa10a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:46:47.699803 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-993ba05d-1999-4904-b432-36fc77d50a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:47.700658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-993ba05d-1999-4904-b432-36fc77d50a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:47.702481 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 904/1801] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:46:47 2022] DELETE /identity/v3/projects/ee913dafe28e4142859a898e5aa10a4c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:47.703060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ba05d-1999-4904-b432-36fc77d50a32 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:47.704403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-993ba05d-1999-4904-b432-36fc77d50a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:47.713390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7ba80-5a1c-4048-adab-567376ed8b98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:47.714309 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7ba80-5a1c-4048-adab-567376ed8b98 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:47.714598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7ba80-5a1c-4048-adab-567376ed8b98 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:47.714878 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7ba80-5a1c-4048-adab-567376ed8b98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:47.717714 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-dde7ba80-5a1c-4048-adab-567376ed8b98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:47.730447 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7ba80-5a1c-4048-adab-567376ed8b98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:47.733101 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7ba80-5a1c-4048-adab-567376ed8b98 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:47.747942 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 898/1802] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:46:47.754222 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7ba80-5a1c-4048-adab-567376ed8b98 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:47.766796 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-dde7ba80-5a1c-4048-adab-567376ed8b98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:47.789916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ba05d-1999-4904-b432-36fc77d50a32 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:47.796426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8ab00-6434-4014-b69d-7fc78c3cae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:47.801277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8ab00-6434-4014-b69d-7fc78c3cae2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:47.801277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8ab00-6434-4014-b69d-7fc78c3cae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:47.801277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8ab00-6434-4014-b69d-7fc78c3cae2f admin admin] PATH_INFO: `/v3/users/005fbd36c07241e69cce69879642354a` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:47.801277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8ab00-6434-4014-b69d-7fc78c3cae2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=005fbd36c07241e69cce69879642354a)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:47.802174 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8ab00-6434-4014-b69d-7fc78c3cae2f admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:47.864372 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7ba80-5a1c-4048-adab-567376ed8b98 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:47.865769 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f174768-5b48-4b43-b4c2-9ee027ae7ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:47.866671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f174768-5b48-4b43-b4c2-9ee027ae7ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:47.866961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f174768-5b48-4b43-b4c2-9ee027ae7ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:47.867244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f174768-5b48-4b43-b4c2-9ee027ae7ef3 admin admin] PATH_INFO: `/v3/users/0f4136465ea54cffae78a03433d4b466` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:47.868471 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f174768-5b48-4b43-b4c2-9ee027ae7ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4136465ea54cffae78a03433d4b466)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:47.870465 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f174768-5b48-4b43-b4c2-9ee027ae7ef3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:48.075786 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-60c8ab00-6434-4014-b69d-7fc78c3cae2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '005fbd36c07241e69cce69879642354a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:48.099046 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0f174768-5b48-4b43-b4c2-9ee027ae7ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4136465ea54cffae78a03433d4b466'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:48.183494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-60c8ab00-6434-4014-b69d-7fc78c3cae2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '005fbd36c07241e69cce69879642354a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:48.193792 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-60c8ab00-6434-4014-b69d-7fc78c3cae2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '005fbd36c07241e69cce69879642354a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:48.194541 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-60c8ab00-6434-4014-b69d-7fc78c3cae2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '005fbd36c07241e69cce69879642354a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:48.209834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-60c8ab00-6434-4014-b69d-7fc78c3cae2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '005fbd36c07241e69cce69879642354a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:48.217186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 905/1803] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:46:47 2022] DELETE /identity/v3/users/005fbd36c07241e69cce69879642354a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:48.221279 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a2c40-758d-471a-8070-0091b633abc3 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:48.221567 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a2c40-758d-471a-8070-0091b633abc3 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:48.221844 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a2c40-758d-471a-8070-0091b633abc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:48.240828 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-931a2c40-758d-471a-8070-0091b633abc3 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:48.242202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-931a2c40-758d-471a-8070-0091b633abc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:48.307532 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0f174768-5b48-4b43-b4c2-9ee027ae7ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4136465ea54cffae78a03433d4b466'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:48.320058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0f174768-5b48-4b43-b4c2-9ee027ae7ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4136465ea54cffae78a03433d4b466'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:48.325475 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0f174768-5b48-4b43-b4c2-9ee027ae7ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4136465ea54cffae78a03433d4b466'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:48.343155 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 906/1804] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:46:48.351580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-0f174768-5b48-4b43-b4c2-9ee027ae7ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4136465ea54cffae78a03433d4b466'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:48.361764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a2c40-758d-471a-8070-0091b633abc3 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:48.362524 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 899/1805] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:46:47 2022] DELETE /identity/v3/users/0f4136465ea54cffae78a03433d4b466 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:48.365921 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-931a2c40-758d-471a-8070-0091b633abc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:48.509775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a2c40-758d-471a-8070-0091b633abc3 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:48.627720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca804a-bc86-4fc5-bd5e-143ec0eddf3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:48.628408 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca804a-bc86-4fc5-bd5e-143ec0eddf3b service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:48.628696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca804a-bc86-4fc5-bd5e-143ec0eddf3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:48.629030 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca804a-bc86-4fc5-bd5e-143ec0eddf3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:48.633603 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-48ca804a-bc86-4fc5-bd5e-143ec0eddf3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:48.768477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:48.814595 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca804a-bc86-4fc5-bd5e-143ec0eddf3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:48.818923 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca804a-bc86-4fc5-bd5e-143ec0eddf3b service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:48.832127 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 907/1806] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:50.417733 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f174768-5b48-4b43-b4c2-9ee027ae7ef3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:50.419513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0f174768-5b48-4b43-b4c2-9ee027ae7ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:50.439368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f174768-5b48-4b43-b4c2-9ee027ae7ef3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:50.447933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:50.450691 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:50.451058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:50.451473 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92 admin admin] PATH_INFO: `/v3/projects/90b19d1db92b4e3084873e4a4fd22ae0` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:50.453359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b19d1db92b4e3084873e4a4fd22ae0)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:50.457112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:50.458438 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca804a-bc86-4fc5-bd5e-143ec0eddf3b service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:50.460425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-48ca804a-bc86-4fc5-bd5e-143ec0eddf3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:50.479626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca804a-bc86-4fc5-bd5e-143ec0eddf3b service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:50.523469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed60481-ad66-477c-9276-5d39d23779eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:50.524633 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed60481-ad66-477c-9276-5d39d23779eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:50.525172 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed60481-ad66-477c-9276-5d39d23779eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:50.525623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed60481-ad66-477c-9276-5d39d23779eb admin admin] PATH_INFO: `/v3/projects/888d806a52984426a6523469ea422941` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:50.527084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed60481-ad66-477c-9276-5d39d23779eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=888d806a52984426a6523469ea422941)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:50.529979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed60481-ad66-477c-9276-5d39d23779eb admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:50.596505 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b19d1db92b4e3084873e4a4fd22ae0', 'request_id': 'req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:50.616065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b19d1db92b4e3084873e4a4fd22ae0', 'request_id': 'req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:50.666271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-aed60481-ad66-477c-9276-5d39d23779eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '888d806a52984426a6523469ea422941', 'request_id': 'req-aed60481-ad66-477c-9276-5d39d23779eb'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:50.684534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-aed60481-ad66-477c-9276-5d39d23779eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '888d806a52984426a6523469ea422941', 'request_id': 'req-aed60481-ad66-477c-9276-5d39d23779eb'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:50.775286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b19d1db92b4e3084873e4a4fd22ae0', 'request_id': 'req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:50.787025 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92 admin admin] The token cache is being invalidate because project 90b19d1db92b4e3084873e4a4fd22ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:46:50.787311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:50.787992 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:50.789617 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 900/1807] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:46:50 2022] DELETE /identity/v3/projects/90b19d1db92b4e3084873e4a4fd22ae0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:50.793859 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:50.795465 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:50.869208 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adec0b1-a2a2-4bca-ac7d-6d1ad4981e92 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:50.877551 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-aed60481-ad66-477c-9276-5d39d23779eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '888d806a52984426a6523469ea422941', 'request_id': 'req-aed60481-ad66-477c-9276-5d39d23779eb'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:50.892439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-aed60481-ad66-477c-9276-5d39d23779eb admin admin] The token cache is being invalidate because project 888d806a52984426a6523469ea422941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:46:50.892739 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-aed60481-ad66-477c-9276-5d39d23779eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:50.893767 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-aed60481-ad66-477c-9276-5d39d23779eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:50.897041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 908/1808] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:46:50 2022] DELETE /identity/v3/projects/888d806a52984426a6523469ea422941 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:50.902747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0154e-69eb-4cc6-b7a0-3be6f545ed9c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:50.903273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0154e-69eb-4cc6-b7a0-3be6f545ed9c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:50.903999 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0154e-69eb-4cc6-b7a0-3be6f545ed9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:50.924620 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-4db0154e-69eb-4cc6-b7a0-3be6f545ed9c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:50.925975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4db0154e-69eb-4cc6-b7a0-3be6f545ed9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:50.957762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98eed4-a9c8-425c-a910-2de95f1a1bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:50.958659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98eed4-a9c8-425c-a910-2de95f1a1bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:50.958944 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98eed4-a9c8-425c-a910-2de95f1a1bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:50.959970 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98eed4-a9c8-425c-a910-2de95f1a1bbc admin admin] PATH_INFO: `/v3/users/b0a82776b8bd4150a09d2b07df770123` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:50.961622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98eed4-a9c8-425c-a910-2de95f1a1bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0a82776b8bd4150a09d2b07df770123)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:50.963689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98eed4-a9c8-425c-a910-2de95f1a1bbc admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:50.990588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:50.992981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 909/1809] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:51.011068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52490780-1008-4797-bdf6-ddab31d5d9ab None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:51.011363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52490780-1008-4797-bdf6-ddab31d5d9ab None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:51.011648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52490780-1008-4797-bdf6-ddab31d5d9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:51.030200 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-52490780-1008-4797-bdf6-ddab31d5d9ab None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:51.031415 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-52490780-1008-4797-bdf6-ddab31d5d9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:51.039379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 910/1810] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:46:51.045507 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52490780-1008-4797-bdf6-ddab31d5d9ab None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:51.055939 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52490780-1008-4797-bdf6-ddab31d5d9ab None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:51.061369 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866ee4a-be49-4569-a3d7-b069f938d3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:51.062025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866ee4a-be49-4569-a3d7-b069f938d3ab admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:51.062306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866ee4a-be49-4569-a3d7-b069f938d3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:51.062684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866ee4a-be49-4569-a3d7-b069f938d3ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:51.063352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866ee4a-be49-4569-a3d7-b069f938d3ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:51.063655 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866ee4a-be49-4569-a3d7-b069f938d3ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:51.066525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866ee4a-be49-4569-a3d7-b069f938d3ab admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:51.082418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 911/1811] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:46:51.083447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866ee4a-be49-4569-a3d7-b069f938d3ab admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:51.099082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866ee4a-be49-4569-a3d7-b069f938d3ab admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:51.099082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c31194-759b-4ebb-ad0d-12a209e1f2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:51.099561 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c31194-759b-4ebb-ad0d-12a209e1f2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:51.099847 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c31194-759b-4ebb-ad0d-12a209e1f2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:51.100125 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c31194-759b-4ebb-ad0d-12a209e1f2c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:51.100812 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c31194-759b-4ebb-ad0d-12a209e1f2c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:51.102742 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c31194-759b-4ebb-ad0d-12a209e1f2c2 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:51.191913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3c98eed4-a9c8-425c-a910-2de95f1a1bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0a82776b8bd4150a09d2b07df770123'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:51.222144 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 912/1812] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:51 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:46:51.223252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c31194-759b-4ebb-ad0d-12a209e1f2c2 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:51.266675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3c98eed4-a9c8-425c-a910-2de95f1a1bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0a82776b8bd4150a09d2b07df770123'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:51.276752 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3c98eed4-a9c8-425c-a910-2de95f1a1bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0a82776b8bd4150a09d2b07df770123'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:51.277960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3c98eed4-a9c8-425c-a910-2de95f1a1bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0a82776b8bd4150a09d2b07df770123'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:51.291920 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-3c98eed4-a9c8-425c-a910-2de95f1a1bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0a82776b8bd4150a09d2b07df770123'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:51.302807 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c31194-759b-4ebb-ad0d-12a209e1f2c2 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:51.304302 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 901/1813] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:46:50 2022] DELETE /identity/v3/users/b0a82776b8bd4150a09d2b07df770123 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:46:51.369781 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fa69c-7d5e-4f06-8af3-d75f175d523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:51.370484 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fa69c-7d5e-4f06-8af3-d75f175d523c admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:51.370778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fa69c-7d5e-4f06-8af3-d75f175d523c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:51.371062 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fa69c-7d5e-4f06-8af3-d75f175d523c admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:51.372456 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fa69c-7d5e-4f06-8af3-d75f175d523c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:51.374441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fa69c-7d5e-4f06-8af3-d75f175d523c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:51.444437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 913/1814] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:51 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:46:51.448638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98eed4-a9c8-425c-a910-2de95f1a1bbc admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:51.450836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3c98eed4-a9c8-425c-a910-2de95f1a1bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:51.463360 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98eed4-a9c8-425c-a910-2de95f1a1bbc admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:51.469436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd8ebb-fd29-4a32-945a-adb9e9f1cb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:51.469436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd8ebb-fd29-4a32-945a-adb9e9f1cb7d admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:51.469436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd8ebb-fd29-4a32-945a-adb9e9f1cb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:51.469726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd8ebb-fd29-4a32-945a-adb9e9f1cb7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:51.470621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd8ebb-fd29-4a32-945a-adb9e9f1cb7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:51.472253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd8ebb-fd29-4a32-945a-adb9e9f1cb7d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:51.482741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 902/1815] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:51.486728 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fa69c-7d5e-4f06-8af3-d75f175d523c admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:51.497883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fa69c-7d5e-4f06-8af3-d75f175d523c admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:51.502496 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e77c39-be5f-4478-ace7-fc37048af157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:51.503169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e77c39-be5f-4478-ace7-fc37048af157 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:51.503470 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e77c39-be5f-4478-ace7-fc37048af157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:51.503734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e77c39-be5f-4478-ace7-fc37048af157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:51.504462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e77c39-be5f-4478-ace7-fc37048af157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:51.506285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e77c39-be5f-4478-ace7-fc37048af157 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:51.517401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 914/1816] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:51.522203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd8ebb-fd29-4a32-945a-adb9e9f1cb7d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:51.534676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd8ebb-fd29-4a32-945a-adb9e9f1cb7d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:51.540019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f875a3a-039b-4dae-879a-e1d7ee6735c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:51.541006 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f875a3a-039b-4dae-879a-e1d7ee6735c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:51.541298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f875a3a-039b-4dae-879a-e1d7ee6735c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:51.541579 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f875a3a-039b-4dae-879a-e1d7ee6735c6 admin admin] PATH_INFO: `/v3/projects/a71af043998f4416be05c9fcdb6b8c49/users/177923b50d9b4dda93f44dbb55822270/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:51.561207 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f875a3a-039b-4dae-879a-e1d7ee6735c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71af043998f4416be05c9fcdb6b8c49, user_id=177923b50d9b4dda93f44dbb55822270, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:51.567123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f875a3a-039b-4dae-879a-e1d7ee6735c6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:51.646204 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 903/1817] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:51 2022] PUT /identity/v3/projects/a71af043998f4416be05c9fcdb6b8c49/users/177923b50d9b4dda93f44dbb55822270/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:51.656960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febac526-eb65-4dcb-bf67-e1fac4004bd5 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:51.657436 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febac526-eb65-4dcb-bf67-e1fac4004bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:51.657880 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febac526-eb65-4dcb-bf67-e1fac4004bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:51.694141 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-febac526-eb65-4dcb-bf67-e1fac4004bd5 None None] MFA Rules not processed for user `177923b50d9b4dda93f44dbb55822270`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:51.695853 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-febac526-eb65-4dcb-bf67-e1fac4004bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:51.801639 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 915/1818] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:46:51.807630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f875a3a-039b-4dae-879a-e1d7ee6735c6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:51.865091 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febac526-eb65-4dcb-bf67-e1fac4004bd5 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:51.866946 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-febac526-eb65-4dcb-bf67-e1fac4004bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:51.874609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f875a3a-039b-4dae-879a-e1d7ee6735c6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:51.880673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5e3a-0359-4de0-9950-7dba1c78466d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:51.881385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5e3a-0359-4de0-9950-7dba1c78466d admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:51.881672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5e3a-0359-4de0-9950-7dba1c78466d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:51.882298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5e3a-0359-4de0-9950-7dba1c78466d admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:51.883254 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a5e3a-0359-4de0-9950-7dba1c78466d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:51.885429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a5e3a-0359-4de0-9950-7dba1c78466d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:51.898477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febac526-eb65-4dcb-bf67-e1fac4004bd5 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:51.905102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b373cef-0fb1-459b-8a1a-8e0d732f5e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:51.906095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b373cef-0fb1-459b-8a1a-8e0d732f5e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:51.906451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b373cef-0fb1-459b-8a1a-8e0d732f5e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:51.906735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b373cef-0fb1-459b-8a1a-8e0d732f5e40 admin admin] PATH_INFO: `/v3/projects/46ed73eba36443c09fb377d6aaada2d6` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:51.907951 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b373cef-0fb1-459b-8a1a-8e0d732f5e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ed73eba36443c09fb377d6aaada2d6)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:51.921660 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b373cef-0fb1-459b-8a1a-8e0d732f5e40 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:52.033639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 904/1819] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:51 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:52.037300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5e3a-0359-4de0-9950-7dba1c78466d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:52.059964 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3b373cef-0fb1-459b-8a1a-8e0d732f5e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ed73eba36443c09fb377d6aaada2d6', 'request_id': 'req-3b373cef-0fb1-459b-8a1a-8e0d732f5e40'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:52.067319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3b373cef-0fb1-459b-8a1a-8e0d732f5e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ed73eba36443c09fb377d6aaada2d6', 'request_id': 'req-3b373cef-0fb1-459b-8a1a-8e0d732f5e40'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:52.112052 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5e3a-0359-4de0-9950-7dba1c78466d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:52.116673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be49b50-36a5-4943-9825-11efdf9bb1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:52.117395 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be49b50-36a5-4943-9825-11efdf9bb1fc admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.117712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be49b50-36a5-4943-9825-11efdf9bb1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.117985 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be49b50-36a5-4943-9825-11efdf9bb1fc admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.118693 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be49b50-36a5-4943-9825-11efdf9bb1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:52.120762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be49b50-36a5-4943-9825-11efdf9bb1fc admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:52.182607 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3b373cef-0fb1-459b-8a1a-8e0d732f5e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ed73eba36443c09fb377d6aaada2d6', 'request_id': 'req-3b373cef-0fb1-459b-8a1a-8e0d732f5e40'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:52.194708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3b373cef-0fb1-459b-8a1a-8e0d732f5e40 admin admin] The token cache is being invalidate because project 46ed73eba36443c09fb377d6aaada2d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:46:52.195002 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3b373cef-0fb1-459b-8a1a-8e0d732f5e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:52.195667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3b373cef-0fb1-459b-8a1a-8e0d732f5e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:52.197341 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 916/1820] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:46:51 2022] DELETE /identity/v3/projects/46ed73eba36443c09fb377d6aaada2d6 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:52.202156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de134c1-5d6f-4364-b94e-db6d2fa37335 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.202427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de134c1-5d6f-4364-b94e-db6d2fa37335 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.202708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de134c1-5d6f-4364-b94e-db6d2fa37335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.211865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 905/1821] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:52 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:46:52.216874 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be49b50-36a5-4943-9825-11efdf9bb1fc admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:52.218563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1be49b50-36a5-4943-9825-11efdf9bb1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:52.223330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-3de134c1-5d6f-4364-b94e-db6d2fa37335 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:52.224514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3de134c1-5d6f-4364-b94e-db6d2fa37335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:52.231313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be49b50-36a5-4943-9825-11efdf9bb1fc admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:52.233824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 917/1822] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:46:52.236246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbeef1-4b1c-41e7-8a79-4f837d246ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:52.236918 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbeef1-4b1c-41e7-8a79-4f837d246ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.237236 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbeef1-4b1c-41e7-8a79-4f837d246ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.238838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbeef1-4b1c-41e7-8a79-4f837d246ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.238838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbeef1-4b1c-41e7-8a79-4f837d246ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:52.239902 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbeef1-4b1c-41e7-8a79-4f837d246ac1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:52.245067 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dba54-a642-449d-856e-fe1a320affd7 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.245366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dba54-a642-449d-856e-fe1a320affd7 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.245652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dba54-a642-449d-856e-fe1a320affd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.251017 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 906/1823] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:46:52.255031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbeef1-4b1c-41e7-8a79-4f837d246ac1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:52.264493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-c72dba54-a642-449d-856e-fe1a320affd7 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:52.265331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbeef1-4b1c-41e7-8a79-4f837d246ac1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:52.265738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-c72dba54-a642-449d-856e-fe1a320affd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:52.273644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a45d59-50f5-4e87-abea-3836bb160614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:52.274644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a45d59-50f5-4e87-abea-3836bb160614 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.274935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a45d59-50f5-4e87-abea-3836bb160614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.275311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a45d59-50f5-4e87-abea-3836bb160614 admin admin] PATH_INFO: `/v3/projects/4badcf4fe1db4b54956e0f3c04e54eba/users/c660f3fa196c45b6b79e15c00900f8aa/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.277353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 918/1824] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:46:52.283734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dba54-a642-449d-856e-fe1a320affd7 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:52.293501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dba54-a642-449d-856e-fe1a320affd7 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:52.295852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a45d59-50f5-4e87-abea-3836bb160614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4badcf4fe1db4b54956e0f3c04e54eba, user_id=c660f3fa196c45b6b79e15c00900f8aa, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:52.298507 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542fd66-2b63-4f97-8bb4-0039e450605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:52.299063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a45d59-50f5-4e87-abea-3836bb160614 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:52.299216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542fd66-2b63-4f97-8bb4-0039e450605b admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.299439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542fd66-2b63-4f97-8bb4-0039e450605b admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.299714 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542fd66-2b63-4f97-8bb4-0039e450605b admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.300433 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542fd66-2b63-4f97-8bb4-0039e450605b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:52.300736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542fd66-2b63-4f97-8bb4-0039e450605b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:52.302415 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542fd66-2b63-4f97-8bb4-0039e450605b admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:52.314817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 919/1825] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:46:52.319032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542fd66-2b63-4f97-8bb4-0039e450605b admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:52.331984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542fd66-2b63-4f97-8bb4-0039e450605b admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:52.336970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d33ad-45ce-4e65-ba53-e57e42ccb442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:52.337715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d33ad-45ce-4e65-ba53-e57e42ccb442 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.338066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d33ad-45ce-4e65-ba53-e57e42ccb442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.338407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d33ad-45ce-4e65-ba53-e57e42ccb442 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.339642 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d33ad-45ce-4e65-ba53-e57e42ccb442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:52.342744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d33ad-45ce-4e65-ba53-e57e42ccb442 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:52.466550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 907/1826] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:52 2022] PUT /identity/v3/projects/4badcf4fe1db4b54956e0f3c04e54eba/users/c660f3fa196c45b6b79e15c00900f8aa/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:46:52.467531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a45d59-50f5-4e87-abea-3836bb160614 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:52.467677 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 920/1827] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:52 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:46:52.471771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d33ad-45ce-4e65-ba53-e57e42ccb442 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:52.535532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d33ad-45ce-4e65-ba53-e57e42ccb442 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:52.540323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1d743-75e9-4eea-b7cb-a6f6d9a6f7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:52.541023 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1d743-75e9-4eea-b7cb-a6f6d9a6f7ff admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.541135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a45d59-50f5-4e87-abea-3836bb160614 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:52.541310 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1d743-75e9-4eea-b7cb-a6f6d9a6f7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.541584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1d743-75e9-4eea-b7cb-a6f6d9a6f7ff admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.542300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1d743-75e9-4eea-b7cb-a6f6d9a6f7ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:52.544273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1d743-75e9-4eea-b7cb-a6f6d9a6f7ff admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:52.546396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e70f5-16e4-4110-891e-c90ed14ef9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:52.547074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e70f5-16e4-4110-891e-c90ed14ef9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.548478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:52.548983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e70f5-16e4-4110-891e-c90ed14ef9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.549349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e70f5-16e4-4110-891e-c90ed14ef9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.550330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e70f5-16e4-4110-891e-c90ed14ef9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:52.554509 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e70f5-16e4-4110-891e-c90ed14ef9d8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:52.562441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 908/1828] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:52.566500 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e70f5-16e4-4110-891e-c90ed14ef9d8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:52.576601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e70f5-16e4-4110-891e-c90ed14ef9d8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:52.581202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f17a54-7ee6-45e8-8807-b92139ba8519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:52.582067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f17a54-7ee6-45e8-8807-b92139ba8519 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.582351 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f17a54-7ee6-45e8-8807-b92139ba8519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.582671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f17a54-7ee6-45e8-8807-b92139ba8519 admin admin] PATH_INFO: `/v3/projects/4badcf4fe1db4b54956e0f3c04e54eba/users/c660f3fa196c45b6b79e15c00900f8aa/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.584674 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f17a54-7ee6-45e8-8807-b92139ba8519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4badcf4fe1db4b54956e0f3c04e54eba, user_id=c660f3fa196c45b6b79e15c00900f8aa, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:52.587396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f17a54-7ee6-45e8-8807-b92139ba8519 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:52.598407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 909/1829] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:52 2022] PUT /identity/v3/projects/4badcf4fe1db4b54956e0f3c04e54eba/users/c660f3fa196c45b6b79e15c00900f8aa/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:46:52.608417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e28472-3a2d-4a42-8545-87d5e2fc0d62 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.608741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e28472-3a2d-4a42-8545-87d5e2fc0d62 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.609064 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e28472-3a2d-4a42-8545-87d5e2fc0d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.640644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a0e28472-3a2d-4a42-8545-87d5e2fc0d62 None None] MFA Rules not processed for user `c660f3fa196c45b6b79e15c00900f8aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:52.641970 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a0e28472-3a2d-4a42-8545-87d5e2fc0d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:52.648998 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 921/1830] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:52 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:46:52.650267 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1d743-75e9-4eea-b7cb-a6f6d9a6f7ff admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:52.661834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1d743-75e9-4eea-b7cb-a6f6d9a6f7ff admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:52.717661 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 910/1831] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:46:52.719385 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023844-9110-4873-9c6f-6e55d6f7b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:52.720190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023844-9110-4873-9c6f-6e55d6f7b39a admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.720365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023844-9110-4873-9c6f-6e55d6f7b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.720646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023844-9110-4873-9c6f-6e55d6f7b39a admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.721771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03023844-9110-4873-9c6f-6e55d6f7b39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:52.723479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03023844-9110-4873-9c6f-6e55d6f7b39a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:52.731579 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e28472-3a2d-4a42-8545-87d5e2fc0d62 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:52.733436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a0e28472-3a2d-4a42-8545-87d5e2fc0d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:52.735235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 922/1832] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:46:52.745437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023844-9110-4873-9c6f-6e55d6f7b39a admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:52.759616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023844-9110-4873-9c6f-6e55d6f7b39a admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:52.766718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b24f55-eeda-4f35-8e71-657d55a6842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:52.767617 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b24f55-eeda-4f35-8e71-657d55a6842b admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.768067 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b24f55-eeda-4f35-8e71-657d55a6842b admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.770869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b24f55-eeda-4f35-8e71-657d55a6842b admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.770869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b24f55-eeda-4f35-8e71-657d55a6842b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:52.771263 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b24f55-eeda-4f35-8e71-657d55a6842b admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:52.783234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 923/1833] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:52.788562 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b24f55-eeda-4f35-8e71-657d55a6842b admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:52.800617 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b24f55-eeda-4f35-8e71-657d55a6842b admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:52.809909 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b5d1b-350a-43a1-a22a-21c2cbb60a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:52.810857 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b5d1b-350a-43a1-a22a-21c2cbb60a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.811138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b5d1b-350a-43a1-a22a-21c2cbb60a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.811439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b5d1b-350a-43a1-a22a-21c2cbb60a2c admin admin] PATH_INFO: `/v3/projects/83b5c58df7eb4c5ab19a60bfaca215c3/users/03665bb1493c40abb25e0092a5d77c2a/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.821761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e28472-3a2d-4a42-8545-87d5e2fc0d62 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:52.827445 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf103bc6-1daf-45d4-bf29-8c0156a44b69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:52.828846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf103bc6-1daf-45d4-bf29-8c0156a44b69 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.829367 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf103bc6-1daf-45d4-bf29-8c0156a44b69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.829839 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf103bc6-1daf-45d4-bf29-8c0156a44b69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.831301 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b5d1b-350a-43a1-a22a-21c2cbb60a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b5c58df7eb4c5ab19a60bfaca215c3, user_id=03665bb1493c40abb25e0092a5d77c2a, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:52.834576 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b5d1b-350a-43a1-a22a-21c2cbb60a2c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:52.847525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf103bc6-1daf-45d4-bf29-8c0156a44b69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:52.849055 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf103bc6-1daf-45d4-bf29-8c0156a44b69 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:52.859552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 911/1834] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:46:52.930387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf103bc6-1daf-45d4-bf29-8c0156a44b69 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:52.936232 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 924/1835] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:52 2022] PUT /identity/v3/projects/83b5c58df7eb4c5ab19a60bfaca215c3/users/03665bb1493c40abb25e0092a5d77c2a/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:46:52.946710 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:52.946872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf103bc6-1daf-45d4-bf29-8c0156a44b69 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:52.947000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5e1c3-320d-40de-9f8a-2c1ce2037d81 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:52.947000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5e1c3-320d-40de-9f8a-2c1ce2037d81 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:52.947164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5e1c3-320d-40de-9f8a-2c1ce2037d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:52.983045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-0cf5e1c3-320d-40de-9f8a-2c1ce2037d81 None None] MFA Rules not processed for user `03665bb1493c40abb25e0092a5d77c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:52.983045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0cf5e1c3-320d-40de-9f8a-2c1ce2037d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:53.010850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a160117-1e5a-4e58-90e1-9cecd092edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:53.012327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a160117-1e5a-4e58-90e1-9cecd092edb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:53.012612 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a160117-1e5a-4e58-90e1-9cecd092edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:53.012913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a160117-1e5a-4e58-90e1-9cecd092edb1 admin admin] PATH_INFO: `/v3/users/177923b50d9b4dda93f44dbb55822270` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:53.014208 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a160117-1e5a-4e58-90e1-9cecd092edb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=177923b50d9b4dda93f44dbb55822270)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:53.016199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a160117-1e5a-4e58-90e1-9cecd092edb1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:53.072520 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 925/1836] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:53.080037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5e1c3-320d-40de-9f8a-2c1ce2037d81 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:53.109967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5e1c3-320d-40de-9f8a-2c1ce2037d81 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:53.125090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002cecf-8924-4a99-8545-8ed59b515987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:53.125799 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002cecf-8924-4a99-8545-8ed59b515987 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:53.126086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002cecf-8924-4a99-8545-8ed59b515987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:53.126433 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002cecf-8924-4a99-8545-8ed59b515987 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:53.127154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002cecf-8924-4a99-8545-8ed59b515987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:53.134966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002cecf-8924-4a99-8545-8ed59b515987 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:53.258103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8a160117-1e5a-4e58-90e1-9cecd092edb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177923b50d9b4dda93f44dbb55822270'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:53.294393 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 926/1837] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:53 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:46:53.298846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002cecf-8924-4a99-8545-8ed59b515987 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:53.380627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8a160117-1e5a-4e58-90e1-9cecd092edb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177923b50d9b4dda93f44dbb55822270'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:53.387628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002cecf-8924-4a99-8545-8ed59b515987 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:53.391737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8a160117-1e5a-4e58-90e1-9cecd092edb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177923b50d9b4dda93f44dbb55822270'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:53.394723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8a160117-1e5a-4e58-90e1-9cecd092edb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177923b50d9b4dda93f44dbb55822270'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:53.394832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497036ba-4689-493c-97ee-bd327225c416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:53.394832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497036ba-4689-493c-97ee-bd327225c416 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:53.394832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497036ba-4689-493c-97ee-bd327225c416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:53.395333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497036ba-4689-493c-97ee-bd327225c416 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:53.396054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497036ba-4689-493c-97ee-bd327225c416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:53.398034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497036ba-4689-493c-97ee-bd327225c416 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:53.419174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8a160117-1e5a-4e58-90e1-9cecd092edb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177923b50d9b4dda93f44dbb55822270'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:53.463208 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 912/1838] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:46:52 2022] DELETE /identity/v3/users/177923b50d9b4dda93f44dbb55822270 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:53.468028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece34a1-b3ed-4730-937a-f5ee2ad7b6b2 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:53.469000 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece34a1-b3ed-4730-937a-f5ee2ad7b6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:53.471064 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece34a1-b3ed-4730-937a-f5ee2ad7b6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:53.490565 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 927/1839] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:53 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:53.494706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497036ba-4689-493c-97ee-bd327225c416 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:53.496444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-497036ba-4689-493c-97ee-bd327225c416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:53.521420 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497036ba-4689-493c-97ee-bd327225c416 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:53.540279 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-eece34a1-b3ed-4730-937a-f5ee2ad7b6b2 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:53.541710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-eece34a1-b3ed-4730-937a-f5ee2ad7b6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:53.640716 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e5d01-d26d-4052-ab80-770e7f9025b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:53.641724 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e5d01-d26d-4052-ab80-770e7f9025b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:53.642222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e5d01-d26d-4052-ab80-770e7f9025b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:53.642597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e5d01-d26d-4052-ab80-770e7f9025b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:53.643616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e5d01-d26d-4052-ab80-770e7f9025b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:53.645690 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e5d01-d26d-4052-ab80-770e7f9025b9 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:53.658783 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 913/1840] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:53.662747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 928/1841] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:46:53.667054 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece34a1-b3ed-4730-937a-f5ee2ad7b6b2 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:53.680924 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece34a1-b3ed-4730-937a-f5ee2ad7b6b2 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:53.688520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39053004-78f5-42c1-b1c8-b44a3d8f435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:53.689536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053004-78f5-42c1-b1c8-b44a3d8f435a admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:53.693690 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053004-78f5-42c1-b1c8-b44a3d8f435a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:53.693690 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053004-78f5-42c1-b1c8-b44a3d8f435a admin admin] PATH_INFO: `/v3/projects/684f2caf6c42410895019fefcd8b921d/users/66b6daaff915485d837fe70ee3518f1d/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:53.707311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e5d01-d26d-4052-ab80-770e7f9025b9 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:53.709253 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4b7e5d01-d26d-4052-ab80-770e7f9025b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:53.710876 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39053004-78f5-42c1-b1c8-b44a3d8f435a admin admin] RBAC: Authorizing `identity:create_grant(project_id=684f2caf6c42410895019fefcd8b921d, user_id=66b6daaff915485d837fe70ee3518f1d, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:53.717267 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39053004-78f5-42c1-b1c8-b44a3d8f435a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:53.813194 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 914/1842] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:53 2022] PUT /identity/v3/projects/684f2caf6c42410895019fefcd8b921d/users/66b6daaff915485d837fe70ee3518f1d/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:46:53.817467 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39053004-78f5-42c1-b1c8-b44a3d8f435a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:53.817605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e5d01-d26d-4052-ab80-770e7f9025b9 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:53.911734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bc376-f8c5-4d56-b3ca-d45ce7019bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:53.912398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bc376-f8c5-4d56-b3ca-d45ce7019bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:53.912751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bc376-f8c5-4d56-b3ca-d45ce7019bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:53.913107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bc376-f8c5-4d56-b3ca-d45ce7019bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:53.928459 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39053004-78f5-42c1-b1c8-b44a3d8f435a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:53.936709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ced8c-5228-42e5-8aa4-dc5218955e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:53.937712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ced8c-5228-42e5-8aa4-dc5218955e5c admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:53.938005 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ced8c-5228-42e5-8aa4-dc5218955e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:53.938291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ced8c-5228-42e5-8aa4-dc5218955e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:53.939037 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ced8c-5228-42e5-8aa4-dc5218955e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:53.941031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ced8c-5228-42e5-8aa4-dc5218955e5c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:53.957601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 915/1843] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:53.965308 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ced8c-5228-42e5-8aa4-dc5218955e5c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:53.983517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ced8c-5228-42e5-8aa4-dc5218955e5c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:53.998527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b722d-33fd-4e8a-a65a-ff6e38c32103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:53.998527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b722d-33fd-4e8a-a65a-ff6e38c32103 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:53.998527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b722d-33fd-4e8a-a65a-ff6e38c32103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:53.998527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b722d-33fd-4e8a-a65a-ff6e38c32103 admin admin] PATH_INFO: `/v3/projects/684f2caf6c42410895019fefcd8b921d/users/66b6daaff915485d837fe70ee3518f1d/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:54.002534 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b722d-33fd-4e8a-a65a-ff6e38c32103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684f2caf6c42410895019fefcd8b921d, user_id=66b6daaff915485d837fe70ee3518f1d, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:54.006619 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b722d-33fd-4e8a-a65a-ff6e38c32103 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:54.009987 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bc376-f8c5-4d56-b3ca-d45ce7019bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:54.011446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bc376-f8c5-4d56-b3ca-d45ce7019bf1 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:54.028438 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 929/1844] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:46:54.040479 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 916/1845] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:53 2022] PUT /identity/v3/projects/684f2caf6c42410895019fefcd8b921d/users/66b6daaff915485d837fe70ee3518f1d/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:46:54.042365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1547c31-9903-4406-8b3e-58f8e6206bdb None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:54.042658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1547c31-9903-4406-8b3e-58f8e6206bdb None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:54.042939 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1547c31-9903-4406-8b3e-58f8e6206bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:54.083729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-c1547c31-9903-4406-8b3e-58f8e6206bdb None None] MFA Rules not processed for user `66b6daaff915485d837fe70ee3518f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:54.085095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-c1547c31-9903-4406-8b3e-58f8e6206bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:54.201206 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 930/1846] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:54.213265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b722d-33fd-4e8a-a65a-ff6e38c32103 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:54.215793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c94b722d-33fd-4e8a-a65a-ff6e38c32103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:54.272302 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:54.276236 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b722d-33fd-4e8a-a65a-ff6e38c32103 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:54.280848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ca8a3-346c-4483-953f-fddb6957b0f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:54.281531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca8a3-346c-4483-953f-fddb6957b0f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:54.281815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca8a3-346c-4483-953f-fddb6957b0f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:54.282263 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca8a3-346c-4483-953f-fddb6957b0f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:54.291687 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ca8a3-346c-4483-953f-fddb6957b0f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:54.294322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ca8a3-346c-4483-953f-fddb6957b0f7 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:54.305353 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 917/1847] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:54.545092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1547c31-9903-4406-8b3e-58f8e6206bdb None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:54.546628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-c1547c31-9903-4406-8b3e-58f8e6206bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:54.558546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1547c31-9903-4406-8b3e-58f8e6206bdb None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:54.562623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c24aeb-554b-49d2-85e0-43285b93ce6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:54.563301 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c24aeb-554b-49d2-85e0-43285b93ce6b service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:54.563597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c24aeb-554b-49d2-85e0-43285b93ce6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:54.563999 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c24aeb-554b-49d2-85e0-43285b93ce6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:54.565835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a1c24aeb-554b-49d2-85e0-43285b93ce6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:54.600000 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ca8a3-346c-4483-953f-fddb6957b0f7 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:54.603714 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7d4ca8a3-346c-4483-953f-fddb6957b0f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:54.641923 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c24aeb-554b-49d2-85e0-43285b93ce6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:54.643682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c24aeb-554b-49d2-85e0-43285b93ce6b service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:54.654937 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 931/1848] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:54.703015 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ca8a3-346c-4483-953f-fddb6957b0f7 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:54.707816 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebfabd-7f98-4824-a173-a7f0d574b12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:54.708692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebfabd-7f98-4824-a173-a7f0d574b12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:54.709061 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebfabd-7f98-4824-a173-a7f0d574b12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:54.709345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebfabd-7f98-4824-a173-a7f0d574b12a admin admin] PATH_INFO: `/v3/projects/a71af043998f4416be05c9fcdb6b8c49` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:54.710538 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebfabd-7f98-4824-a173-a7f0d574b12a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71af043998f4416be05c9fcdb6b8c49)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:54.712694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebfabd-7f98-4824-a173-a7f0d574b12a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:54.830011 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-68ebfabd-7f98-4824-a173-a7f0d574b12a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71af043998f4416be05c9fcdb6b8c49', 'request_id': 'req-68ebfabd-7f98-4824-a173-a7f0d574b12a'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:54.836250 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-68ebfabd-7f98-4824-a173-a7f0d574b12a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71af043998f4416be05c9fcdb6b8c49', 'request_id': 'req-68ebfabd-7f98-4824-a173-a7f0d574b12a'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:54.925323 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-68ebfabd-7f98-4824-a173-a7f0d574b12a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71af043998f4416be05c9fcdb6b8c49', 'request_id': 'req-68ebfabd-7f98-4824-a173-a7f0d574b12a'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:54.937513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-68ebfabd-7f98-4824-a173-a7f0d574b12a admin admin] The token cache is being invalidate because project a71af043998f4416be05c9fcdb6b8c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:46:54.937807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-68ebfabd-7f98-4824-a173-a7f0d574b12a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:54.938474 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-68ebfabd-7f98-4824-a173-a7f0d574b12a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:54.940040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 918/1849] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:46:54 2022] DELETE /identity/v3/projects/a71af043998f4416be05c9fcdb6b8c49 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:46:54.944281 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c24aeb-554b-49d2-85e0-43285b93ce6b service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:54.956080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c24aeb-554b-49d2-85e0-43285b93ce6b service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:55.015598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368f26c-9f83-451e-9074-9f5ca3a7bb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:55.016428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368f26c-9f83-451e-9074-9f5ca3a7bb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:55.016714 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368f26c-9f83-451e-9074-9f5ca3a7bb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:55.017030 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368f26c-9f83-451e-9074-9f5ca3a7bb35 admin admin] PATH_INFO: `/v3/users/c660f3fa196c45b6b79e15c00900f8aa` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:55.018245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368f26c-9f83-451e-9074-9f5ca3a7bb35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c660f3fa196c45b6b79e15c00900f8aa)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:55.020175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368f26c-9f83-451e-9074-9f5ca3a7bb35 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:55.257536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:55.335866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e368f26c-9f83-451e-9074-9f5ca3a7bb35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c660f3fa196c45b6b79e15c00900f8aa'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:55.514230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e368f26c-9f83-451e-9074-9f5ca3a7bb35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c660f3fa196c45b6b79e15c00900f8aa'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:55.521929 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e368f26c-9f83-451e-9074-9f5ca3a7bb35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c660f3fa196c45b6b79e15c00900f8aa'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:55.522529 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e368f26c-9f83-451e-9074-9f5ca3a7bb35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c660f3fa196c45b6b79e15c00900f8aa'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:55.541255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e368f26c-9f83-451e-9074-9f5ca3a7bb35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c660f3fa196c45b6b79e15c00900f8aa'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:55.542257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 932/1850] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:46:54 2022] DELETE /identity/v3/users/c660f3fa196c45b6b79e15c00900f8aa => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:46:55.895417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:56.013994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebfabd-7f98-4824-a173-a7f0d574b12a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:56.015554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-68ebfabd-7f98-4824-a173-a7f0d574b12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:56.029350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebfabd-7f98-4824-a173-a7f0d574b12a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:56.091148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925b5a1-fe81-467e-a5fa-4ac233e5b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:56.092063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925b5a1-fe81-467e-a5fa-4ac233e5b8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:56.092338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925b5a1-fe81-467e-a5fa-4ac233e5b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:56.092612 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925b5a1-fe81-467e-a5fa-4ac233e5b8b0 admin admin] PATH_INFO: `/v3/projects/4badcf4fe1db4b54956e0f3c04e54eba` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:56.093997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925b5a1-fe81-467e-a5fa-4ac233e5b8b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4badcf4fe1db4b54956e0f3c04e54eba)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:56.095965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925b5a1-fe81-467e-a5fa-4ac233e5b8b0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:56.225107 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9925b5a1-fe81-467e-a5fa-4ac233e5b8b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4badcf4fe1db4b54956e0f3c04e54eba', 'request_id': 'req-9925b5a1-fe81-467e-a5fa-4ac233e5b8b0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:56.232629 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9925b5a1-fe81-467e-a5fa-4ac233e5b8b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4badcf4fe1db4b54956e0f3c04e54eba', 'request_id': 'req-9925b5a1-fe81-467e-a5fa-4ac233e5b8b0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:56.357984 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9925b5a1-fe81-467e-a5fa-4ac233e5b8b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4badcf4fe1db4b54956e0f3c04e54eba', 'request_id': 'req-9925b5a1-fe81-467e-a5fa-4ac233e5b8b0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:56.363265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9925b5a1-fe81-467e-a5fa-4ac233e5b8b0 admin admin] The token cache is being invalidate because project 4badcf4fe1db4b54956e0f3c04e54eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:46:56.363566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9925b5a1-fe81-467e-a5fa-4ac233e5b8b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:56.364293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9925b5a1-fe81-467e-a5fa-4ac233e5b8b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:56.368982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 919/1851] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:46:56 2022] DELETE /identity/v3/projects/4badcf4fe1db4b54956e0f3c04e54eba => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:46:56.371973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003c70f-e872-441f-aea6-dcd7d2f1536f None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:56.372273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003c70f-e872-441f-aea6-dcd7d2f1536f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:56.372574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003c70f-e872-441f-aea6-dcd7d2f1536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:56.401944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b003c70f-e872-441f-aea6-dcd7d2f1536f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:56.403778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b003c70f-e872-441f-aea6-dcd7d2f1536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:56.489164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 933/1852] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:46:56.498390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682cdae-fa8c-48f3-8915-157ebd045721 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:56.498687 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682cdae-fa8c-48f3-8915-157ebd045721 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:56.498975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682cdae-fa8c-48f3-8915-157ebd045721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:56.520050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2682cdae-fa8c-48f3-8915-157ebd045721 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:56.521533 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2682cdae-fa8c-48f3-8915-157ebd045721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:56.532172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 920/1853] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:56.536315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003c70f-e872-441f-aea6-dcd7d2f1536f None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:56.548455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003c70f-e872-441f-aea6-dcd7d2f1536f None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:56.554832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0af8a-04a6-41db-b78a-6adadc33d092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:56.569031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0af8a-04a6-41db-b78a-6adadc33d092 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:56.569031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0af8a-04a6-41db-b78a-6adadc33d092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:56.569031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0af8a-04a6-41db-b78a-6adadc33d092 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:56.569031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0af8a-04a6-41db-b78a-6adadc33d092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:46:56.569031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0af8a-04a6-41db-b78a-6adadc33d092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:56.569031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0af8a-04a6-41db-b78a-6adadc33d092 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:56.581304 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 934/1854] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:46:56.589503 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682cdae-fa8c-48f3-8915-157ebd045721 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:56.599997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682cdae-fa8c-48f3-8915-157ebd045721 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:56.604844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d469e-4567-4299-bf18-5abca0c2a48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:56.608621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d469e-4567-4299-bf18-5abca0c2a48e admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:56.608621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d469e-4567-4299-bf18-5abca0c2a48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:56.608621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d469e-4567-4299-bf18-5abca0c2a48e admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:56.608621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d469e-4567-4299-bf18-5abca0c2a48e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:56.609408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d469e-4567-4299-bf18-5abca0c2a48e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:56.712008 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 921/1855] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:56 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:46:56.716776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0af8a-04a6-41db-b78a-6adadc33d092 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:56.735471 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0af8a-04a6-41db-b78a-6adadc33d092 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:56.829361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962e635-a5cf-4ef8-a22d-2ae6eb920b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:56.830044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962e635-a5cf-4ef8-a22d-2ae6eb920b65 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:56.830330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962e635-a5cf-4ef8-a22d-2ae6eb920b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:56.830634 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962e635-a5cf-4ef8-a22d-2ae6eb920b65 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:56.831321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962e635-a5cf-4ef8-a22d-2ae6eb920b65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:56.833327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962e635-a5cf-4ef8-a22d-2ae6eb920b65 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:56.942719 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 935/1856] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:56 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:56.946749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d469e-4567-4299-bf18-5abca0c2a48e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:56.957229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d469e-4567-4299-bf18-5abca0c2a48e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:56.961758 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b0493-8958-455f-836b-f24f49308365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:56.962417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b0493-8958-455f-836b-f24f49308365 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:56.962724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b0493-8958-455f-836b-f24f49308365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:56.963002 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b0493-8958-455f-836b-f24f49308365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:56.964004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b0493-8958-455f-836b-f24f49308365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:56.965973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b0493-8958-455f-836b-f24f49308365 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:56.976606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 922/1857] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:56.981232 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962e635-a5cf-4ef8-a22d-2ae6eb920b65 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:56.991426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962e635-a5cf-4ef8-a22d-2ae6eb920b65 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:56.996775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ab215-14b1-49d6-9021-0b5be1b6217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:56.997520 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ab215-14b1-49d6-9021-0b5be1b6217d admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:56.997759 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ab215-14b1-49d6-9021-0b5be1b6217d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:56.998068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ab215-14b1-49d6-9021-0b5be1b6217d admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:56.998843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ab215-14b1-49d6-9021-0b5be1b6217d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:57.000494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ab215-14b1-49d6-9021-0b5be1b6217d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:57.011048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 936/1858] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:57.015701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b0493-8958-455f-836b-f24f49308365 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:57.025789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b0493-8958-455f-836b-f24f49308365 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:57.030851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e69586-c85e-4791-9c89-5a8fe8e43f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:57.031724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e69586-c85e-4791-9c89-5a8fe8e43f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:57.032005 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e69586-c85e-4791-9c89-5a8fe8e43f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:57.032390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e69586-c85e-4791-9c89-5a8fe8e43f99 admin admin] PATH_INFO: `/v3/projects/30822e8ec205455e9f24428166134267/users/3c8105dc50a247afb9e20439372eed1e/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:57.047184 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e69586-c85e-4791-9c89-5a8fe8e43f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30822e8ec205455e9f24428166134267, user_id=3c8105dc50a247afb9e20439372eed1e, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:57.049957 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e69586-c85e-4791-9c89-5a8fe8e43f99 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:57.129887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 923/1859] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:57 2022] PUT /identity/v3/projects/30822e8ec205455e9f24428166134267/users/3c8105dc50a247afb9e20439372eed1e/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:57.139994 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b51cd-62a8-435f-9d8f-cca40aa99a3d None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:57.140298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b51cd-62a8-435f-9d8f-cca40aa99a3d None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:57.140583 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b51cd-62a8-435f-9d8f-cca40aa99a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:57.168754 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-3d4b51cd-62a8-435f-9d8f-cca40aa99a3d None None] MFA Rules not processed for user `3c8105dc50a247afb9e20439372eed1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:57.170118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3d4b51cd-62a8-435f-9d8f-cca40aa99a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:57.250523 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 937/1860] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:57.255027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e69586-c85e-4791-9c89-5a8fe8e43f99 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:57.329741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e69586-c85e-4791-9c89-5a8fe8e43f99 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:57.334747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d534a-3428-47bd-b7a3-b6083908f4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:57.335507 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d534a-3428-47bd-b7a3-b6083908f4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:57.335896 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d534a-3428-47bd-b7a3-b6083908f4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:57.336246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d534a-3428-47bd-b7a3-b6083908f4f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:57.337069 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d534a-3428-47bd-b7a3-b6083908f4f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:57.339293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d534a-3428-47bd-b7a3-b6083908f4f1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:57.365906 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:57.463137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 924/1861] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:57 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:57.468090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b51cd-62a8-435f-9d8f-cca40aa99a3d None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:57.488306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b51cd-62a8-435f-9d8f-cca40aa99a3d None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:57.548913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:46:57.572786 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eab027-24dc-4be6-8ea4-fb76b9b0ef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:57.573515 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eab027-24dc-4be6-8ea4-fb76b9b0ef67 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:57.573799 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eab027-24dc-4be6-8ea4-fb76b9b0ef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:57.574076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eab027-24dc-4be6-8ea4-fb76b9b0ef67 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:57.575795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eab027-24dc-4be6-8ea4-fb76b9b0ef67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:57.577767 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eab027-24dc-4be6-8ea4-fb76b9b0ef67 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:57.689327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 938/1862] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:57 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:57.693250 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d534a-3428-47bd-b7a3-b6083908f4f1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:57.708502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d534a-3428-47bd-b7a3-b6083908f4f1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:57.716016 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cd9b5-c16e-48c1-b65c-c01890fedd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:57.716691 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cd9b5-c16e-48c1-b65c-c01890fedd32 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:57.717162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cd9b5-c16e-48c1-b65c-c01890fedd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:57.717590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cd9b5-c16e-48c1-b65c-c01890fedd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:57.720491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cd9b5-c16e-48c1-b65c-c01890fedd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:57.720491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cd9b5-c16e-48c1-b65c-c01890fedd32 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:57.739515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 925/1863] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:57.743302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eab027-24dc-4be6-8ea4-fb76b9b0ef67 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:57.755314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eab027-24dc-4be6-8ea4-fb76b9b0ef67 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:57.760359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb70fe-3c50-4bb0-ba34-a0724b58c860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:57.761089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb70fe-3c50-4bb0-ba34-a0724b58c860 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:57.761425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb70fe-3c50-4bb0-ba34-a0724b58c860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:57.761722 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb70fe-3c50-4bb0-ba34-a0724b58c860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:57.762485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb70fe-3c50-4bb0-ba34-a0724b58c860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:57.764228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb70fe-3c50-4bb0-ba34-a0724b58c860 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:57.777028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 939/1864] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:46:57.783564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cd9b5-c16e-48c1-b65c-c01890fedd32 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:57.791869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cd9b5-c16e-48c1-b65c-c01890fedd32 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:57.797757 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa824216-6432-435d-a3e2-9a45537635b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:57.798764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa824216-6432-435d-a3e2-9a45537635b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:57.799124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa824216-6432-435d-a3e2-9a45537635b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:57.799472 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa824216-6432-435d-a3e2-9a45537635b3 admin admin] PATH_INFO: `/v3/projects/e86793aff08741afa84d53de82fb2c09/users/9d0d9330216748ba91cb714fd85cba5f/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:57.814473 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa824216-6432-435d-a3e2-9a45537635b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86793aff08741afa84d53de82fb2c09, user_id=9d0d9330216748ba91cb714fd85cba5f, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:57.817905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa824216-6432-435d-a3e2-9a45537635b3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:57.926772 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 926/1865] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:57 2022] PUT /identity/v3/projects/e86793aff08741afa84d53de82fb2c09/users/9d0d9330216748ba91cb714fd85cba5f/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:57.930325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52829315-edad-49a0-b035-661bb5ffa99c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:57.930325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52829315-edad-49a0-b035-661bb5ffa99c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:57.930325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52829315-edad-49a0-b035-661bb5ffa99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:57.975878 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-52829315-edad-49a0-b035-661bb5ffa99c None None] MFA Rules not processed for user `9d0d9330216748ba91cb714fd85cba5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:57.977622 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-52829315-edad-49a0-b035-661bb5ffa99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:58.079003 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 940/1866] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:58.087036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa824216-6432-435d-a3e2-9a45537635b3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:58.148993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa824216-6432-435d-a3e2-9a45537635b3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:58.154264 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f0496-3c76-40a2-b4d9-e7dcfa05f6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:58.154933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f0496-3c76-40a2-b4d9-e7dcfa05f6af admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:58.155252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f0496-3c76-40a2-b4d9-e7dcfa05f6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:58.155533 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f0496-3c76-40a2-b4d9-e7dcfa05f6af admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:58.156238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f0496-3c76-40a2-b4d9-e7dcfa05f6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:58.158220 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f0496-3c76-40a2-b4d9-e7dcfa05f6af admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:58.307731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 927/1867] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:46:58 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:58.312983 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52829315-edad-49a0-b035-661bb5ffa99c None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:58.323793 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52829315-edad-49a0-b035-661bb5ffa99c None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:58.388812 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba7fd4-8848-4282-947f-c42181b16e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:58.389654 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba7fd4-8848-4282-947f-c42181b16e02 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:58.390092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba7fd4-8848-4282-947f-c42181b16e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:58.392988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba7fd4-8848-4282-947f-c42181b16e02 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:58.392988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba7fd4-8848-4282-947f-c42181b16e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:58.394441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba7fd4-8848-4282-947f-c42181b16e02 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:58.414544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f0496-3c76-40a2-b4d9-e7dcfa05f6af admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:58.417519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b40f0496-3c76-40a2-b4d9-e7dcfa05f6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:58.433098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f0496-3c76-40a2-b4d9-e7dcfa05f6af admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:58.446060 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260feb59-30b6-4dec-aa5b-cf6337b184e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:58.446794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260feb59-30b6-4dec-aa5b-cf6337b184e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:58.447229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260feb59-30b6-4dec-aa5b-cf6337b184e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:58.448086 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260feb59-30b6-4dec-aa5b-cf6337b184e8 admin admin] PATH_INFO: `/v3/users/7d622e7ba2e74459bce0db0ee260e1f7` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:58.449343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260feb59-30b6-4dec-aa5b-cf6337b184e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d622e7ba2e74459bce0db0ee260e1f7)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:58.451961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260feb59-30b6-4dec-aa5b-cf6337b184e8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:58.521168 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 941/1868] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:46:58 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:46:58.533901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba7fd4-8848-4282-947f-c42181b16e02 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:58.548271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba7fd4-8848-4282-947f-c42181b16e02 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:58.561974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe65687-3a50-4061-97eb-d4bcf054d227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:58.562499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe65687-3a50-4061-97eb-d4bcf054d227 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:58.562929 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe65687-3a50-4061-97eb-d4bcf054d227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:58.563353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe65687-3a50-4061-97eb-d4bcf054d227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:58.564235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe65687-3a50-4061-97eb-d4bcf054d227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:58.570989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe65687-3a50-4061-97eb-d4bcf054d227 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:58.601402 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 942/1869] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:46:58.601402 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe65687-3a50-4061-97eb-d4bcf054d227 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:58.619300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe65687-3a50-4061-97eb-d4bcf054d227 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:58.625734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7ec53-0e6c-4fd5-8bb4-7483d6b44819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:58.626867 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7ec53-0e6c-4fd5-8bb4-7483d6b44819 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:58.627202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7ec53-0e6c-4fd5-8bb4-7483d6b44819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:58.627491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7ec53-0e6c-4fd5-8bb4-7483d6b44819 admin admin] PATH_INFO: `/v3/projects/81b2994b410e4e57829bcf37a98b0a06/users/602b96167a074c86ae678772505d6aba/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:58.644096 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7ec53-0e6c-4fd5-8bb4-7483d6b44819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81b2994b410e4e57829bcf37a98b0a06, user_id=602b96167a074c86ae678772505d6aba, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:58.646832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7ec53-0e6c-4fd5-8bb4-7483d6b44819 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:58.712656 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-260feb59-30b6-4dec-aa5b-cf6337b184e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d622e7ba2e74459bce0db0ee260e1f7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:58.765651 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 943/1870] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:58 2022] PUT /identity/v3/projects/81b2994b410e4e57829bcf37a98b0a06/users/602b96167a074c86ae678772505d6aba/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:58.769779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7ec53-0e6c-4fd5-8bb4-7483d6b44819 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:58.795209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-260feb59-30b6-4dec-aa5b-cf6337b184e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d622e7ba2e74459bce0db0ee260e1f7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:58.804788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-260feb59-30b6-4dec-aa5b-cf6337b184e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d622e7ba2e74459bce0db0ee260e1f7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:58.805699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-260feb59-30b6-4dec-aa5b-cf6337b184e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d622e7ba2e74459bce0db0ee260e1f7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:58.859559 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7ec53-0e6c-4fd5-8bb4-7483d6b44819 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:58.860172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-260feb59-30b6-4dec-aa5b-cf6337b184e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d622e7ba2e74459bce0db0ee260e1f7'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:46:58.860274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf60857-5cb9-40d8-8bde-3dd3413b3cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:58.860274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf60857-5cb9-40d8-8bde-3dd3413b3cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:58.860462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf60857-5cb9-40d8-8bde-3dd3413b3cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:58.860760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf60857-5cb9-40d8-8bde-3dd3413b3cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:58.861618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf60857-5cb9-40d8-8bde-3dd3413b3cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:58.863309 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf60857-5cb9-40d8-8bde-3dd3413b3cfe admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:58.871077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 928/1871] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:46:58 2022] DELETE /identity/v3/users/7d622e7ba2e74459bce0db0ee260e1f7 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:46:58.875467 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12cb41-931e-4d44-95ee-32d5f02c87c4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:58.875838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12cb41-931e-4d44-95ee-32d5f02c87c4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:58.876275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12cb41-931e-4d44-95ee-32d5f02c87c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:58.880982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 944/1872] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:46:58.882301 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf60857-5cb9-40d8-8bde-3dd3413b3cfe admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:58.884243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-2cf60857-5cb9-40d8-8bde-3dd3413b3cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:58.898691 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf60857-5cb9-40d8-8bde-3dd3413b3cfe admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:58.898923 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-3d12cb41-931e-4d44-95ee-32d5f02c87c4 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:58.900712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3d12cb41-931e-4d44-95ee-32d5f02c87c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:58.972814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 929/1873] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:58.982819 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12cb41-931e-4d44-95ee-32d5f02c87c4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:58.984149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c61e5b-405f-4639-ad44-ef399f67e5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:58.985676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c61e5b-405f-4639-ad44-ef399f67e5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:58.985676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c61e5b-405f-4639-ad44-ef399f67e5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:58.985676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c61e5b-405f-4639-ad44-ef399f67e5c7 admin admin] PATH_INFO: `/v3/projects/81b2994b410e4e57829bcf37a98b0a06/users/602b96167a074c86ae678772505d6aba/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:58.987995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c61e5b-405f-4639-ad44-ef399f67e5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81b2994b410e4e57829bcf37a98b0a06, user_id=602b96167a074c86ae678772505d6aba, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:58.990792 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c61e5b-405f-4639-ad44-ef399f67e5c7 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:58.991598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3d12cb41-931e-4d44-95ee-32d5f02c87c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:59.004988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 945/1874] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:46:58 2022] PUT /identity/v3/projects/81b2994b410e4e57829bcf37a98b0a06/users/602b96167a074c86ae678772505d6aba/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:46:59.014386 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5bd0a-586d-4ce9-a6ce-ddac070b7524 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:59.014989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5bd0a-586d-4ce9-a6ce-ddac070b7524 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:59.015578 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5bd0a-586d-4ce9-a6ce-ddac070b7524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:59.042467 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-dda5bd0a-586d-4ce9-a6ce-ddac070b7524 None None] MFA Rules not processed for user `602b96167a074c86ae678772505d6aba`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:46:59.044653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-dda5bd0a-586d-4ce9-a6ce-ddac070b7524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:59.065428 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12cb41-931e-4d44-95ee-32d5f02c87c4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:59.124142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 946/1875] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:46:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:46:59.136083 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5bd0a-586d-4ce9-a6ce-ddac070b7524 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:59.137593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-dda5bd0a-586d-4ce9-a6ce-ddac070b7524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:59.152410 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a922ee-4bf0-425f-b98f-5823fac70dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:59.155001 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a922ee-4bf0-425f-b98f-5823fac70dfb service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:59.155001 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a922ee-4bf0-425f-b98f-5823fac70dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:59.155001 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a922ee-4bf0-425f-b98f-5823fac70dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:59.198538 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5bd0a-586d-4ce9-a6ce-ddac070b7524 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:59.203557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000367e-11d5-49b8-969e-5986aa1f80c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:59.204230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000367e-11d5-49b8-969e-5986aa1f80c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:59.204557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000367e-11d5-49b8-969e-5986aa1f80c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:59.204793 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000367e-11d5-49b8-969e-5986aa1f80c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:59.214850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000367e-11d5-49b8-969e-5986aa1f80c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:59.216392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000367e-11d5-49b8-969e-5986aa1f80c9 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:59.226949 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 947/1876] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:46:59.237041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a922ee-4bf0-425f-b98f-5823fac70dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:59.238749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a922ee-4bf0-425f-b98f-5823fac70dfb service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:46:59.256329 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 930/1877] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:46:59.907455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000367e-11d5-49b8-969e-5986aa1f80c9 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:46:59.909716 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0000367e-11d5-49b8-969e-5986aa1f80c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:46:59.929653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000367e-11d5-49b8-969e-5986aa1f80c9 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:46:59.937235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c29ff-575d-4593-8863-9b2fc33a8e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:46:59.938360 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c29ff-575d-4593-8863-9b2fc33a8e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:46:59.939575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c29ff-575d-4593-8863-9b2fc33a8e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:46:59.939974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c29ff-575d-4593-8863-9b2fc33a8e20 admin admin] PATH_INFO: `/v3/projects/2445f1798a23484380a55085d5ff276e` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:46:59.942153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c29ff-575d-4593-8863-9b2fc33a8e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2445f1798a23484380a55085d5ff276e)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:46:59.944633 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c29ff-575d-4593-8863-9b2fc33a8e20 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:00.106618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7c3c29ff-575d-4593-8863-9b2fc33a8e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2445f1798a23484380a55085d5ff276e', 'request_id': 'req-7c3c29ff-575d-4593-8863-9b2fc33a8e20'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:00.114473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7c3c29ff-575d-4593-8863-9b2fc33a8e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2445f1798a23484380a55085d5ff276e', 'request_id': 'req-7c3c29ff-575d-4593-8863-9b2fc33a8e20'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:00.126384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:00.263694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7c3c29ff-575d-4593-8863-9b2fc33a8e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2445f1798a23484380a55085d5ff276e', 'request_id': 'req-7c3c29ff-575d-4593-8863-9b2fc33a8e20'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:00.276531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7c3c29ff-575d-4593-8863-9b2fc33a8e20 admin admin] The token cache is being invalidate because project 2445f1798a23484380a55085d5ff276e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:00.277015 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7c3c29ff-575d-4593-8863-9b2fc33a8e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:00.278236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7c3c29ff-575d-4593-8863-9b2fc33a8e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:00.284424 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a922ee-4bf0-425f-b98f-5823fac70dfb service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:00.284972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 948/1878] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:46:59 2022] DELETE /identity/v3/projects/2445f1798a23484380a55085d5ff276e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:00.295480 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a922ee-4bf0-425f-b98f-5823fac70dfb service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:00.352391 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7abd44-769f-4f50-ad28-a1aed7598280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:00.353309 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7abd44-769f-4f50-ad28-a1aed7598280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:00.353598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7abd44-769f-4f50-ad28-a1aed7598280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:00.353879 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7abd44-769f-4f50-ad28-a1aed7598280 admin admin] PATH_INFO: `/v3/users/861fc85d9ddb41a786d0faa1d803aa03` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:00.355079 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7abd44-769f-4f50-ad28-a1aed7598280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=861fc85d9ddb41a786d0faa1d803aa03)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:00.357786 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7abd44-769f-4f50-ad28-a1aed7598280 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:00.603338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6c7abd44-769f-4f50-ad28-a1aed7598280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861fc85d9ddb41a786d0faa1d803aa03'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:00.668645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:00.709009 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6c7abd44-769f-4f50-ad28-a1aed7598280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861fc85d9ddb41a786d0faa1d803aa03'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:00.721673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6c7abd44-769f-4f50-ad28-a1aed7598280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861fc85d9ddb41a786d0faa1d803aa03'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:00.722948 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6c7abd44-769f-4f50-ad28-a1aed7598280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861fc85d9ddb41a786d0faa1d803aa03'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:00.746905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6c7abd44-769f-4f50-ad28-a1aed7598280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861fc85d9ddb41a786d0faa1d803aa03'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:00.767046 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 931/1879] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:00 2022] DELETE /identity/v3/users/861fc85d9ddb41a786d0faa1d803aa03 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:00.946203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c29ff-575d-4593-8863-9b2fc33a8e20 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:00.947670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7c3c29ff-575d-4593-8863-9b2fc33a8e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:01.018695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c29ff-575d-4593-8863-9b2fc33a8e20 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:01.086637 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f81d9-f13b-4efe-8f6c-cf8c82e6c67d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:01.087316 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f81d9-f13b-4efe-8f6c-cf8c82e6c67d service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:01.087898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f81d9-f13b-4efe-8f6c-cf8c82e6c67d service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:01.088354 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f81d9-f13b-4efe-8f6c-cf8c82e6c67d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:01.090794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-391f81d9-f13b-4efe-8f6c-cf8c82e6c67d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:01.166526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f81d9-f13b-4efe-8f6c-cf8c82e6c67d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:01.169831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f81d9-f13b-4efe-8f6c-cf8c82e6c67d service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:01.182725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 949/1880] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:01.313173 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7abd44-769f-4f50-ad28-a1aed7598280 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:01.317090 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6c7abd44-769f-4f50-ad28-a1aed7598280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:01.423226 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7abd44-769f-4f50-ad28-a1aed7598280 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:01.428595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76068a06-3ca7-47f5-8517-464d2f05fed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:01.429523 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76068a06-3ca7-47f5-8517-464d2f05fed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:01.429814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76068a06-3ca7-47f5-8517-464d2f05fed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:01.430094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76068a06-3ca7-47f5-8517-464d2f05fed1 admin admin] PATH_INFO: `/v3/projects/172ddd531f1749a68bcccfd863a333b3` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:01.431307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76068a06-3ca7-47f5-8517-464d2f05fed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=172ddd531f1749a68bcccfd863a333b3)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:01.433381 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76068a06-3ca7-47f5-8517-464d2f05fed1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:01.586306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-76068a06-3ca7-47f5-8517-464d2f05fed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172ddd531f1749a68bcccfd863a333b3', 'request_id': 'req-76068a06-3ca7-47f5-8517-464d2f05fed1'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:01.595272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-76068a06-3ca7-47f5-8517-464d2f05fed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172ddd531f1749a68bcccfd863a333b3', 'request_id': 'req-76068a06-3ca7-47f5-8517-464d2f05fed1'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:01.674181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-76068a06-3ca7-47f5-8517-464d2f05fed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172ddd531f1749a68bcccfd863a333b3', 'request_id': 'req-76068a06-3ca7-47f5-8517-464d2f05fed1'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:01.690330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-76068a06-3ca7-47f5-8517-464d2f05fed1 admin admin] The token cache is being invalidate because project 172ddd531f1749a68bcccfd863a333b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:01.690330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-76068a06-3ca7-47f5-8517-464d2f05fed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:01.691983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-76068a06-3ca7-47f5-8517-464d2f05fed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:01.692807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 932/1881] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:01 2022] DELETE /identity/v3/projects/172ddd531f1749a68bcccfd863a333b3 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:01.699850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3aa5-5640-4188-a753-328e69a19f35 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:01.700623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3aa5-5640-4188-a753-328e69a19f35 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:01.701165 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3aa5-5640-4188-a753-328e69a19f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:01.722775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-46ab3aa5-5640-4188-a753-328e69a19f35 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:01.724424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-46ab3aa5-5640-4188-a753-328e69a19f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:01.798836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 950/1882] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:01.807926 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7f51d-5594-454d-9a1f-3a9c02d7a86c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:01.808297 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7f51d-5594-454d-9a1f-3a9c02d7a86c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:01.808795 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7f51d-5594-454d-9a1f-3a9c02d7a86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:01.827308 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f0c7f51d-5594-454d-9a1f-3a9c02d7a86c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:01.828505 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f0c7f51d-5594-454d-9a1f-3a9c02d7a86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:01.836728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 933/1883] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:01.841963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3aa5-5640-4188-a753-328e69a19f35 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:01.853408 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3aa5-5640-4188-a753-328e69a19f35 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:01.858982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861b2fa-6b59-4613-a4e6-c7356502729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:01.859741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861b2fa-6b59-4613-a4e6-c7356502729d admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:01.860099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861b2fa-6b59-4613-a4e6-c7356502729d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:01.860450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861b2fa-6b59-4613-a4e6-c7356502729d admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:01.861294 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861b2fa-6b59-4613-a4e6-c7356502729d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:47:01.861681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861b2fa-6b59-4613-a4e6-c7356502729d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:01.863469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861b2fa-6b59-4613-a4e6-c7356502729d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:01.876997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:01.884418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 951/1884] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:47:01.901600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7f51d-5594-454d-9a1f-3a9c02d7a86c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:01.913248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7f51d-5594-454d-9a1f-3a9c02d7a86c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:01.919609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea74c2-23e5-46be-9b1e-680302caa6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:01.928325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea74c2-23e5-46be-9b1e-680302caa6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:01.928631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea74c2-23e5-46be-9b1e-680302caa6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:01.928920 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea74c2-23e5-46be-9b1e-680302caa6a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:01.929692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea74c2-23e5-46be-9b1e-680302caa6a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:01.931609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea74c2-23e5-46be-9b1e-680302caa6a1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:02.049911 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 934/1885] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:01 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:02.053647 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861b2fa-6b59-4613-a4e6-c7356502729d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:02.067028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861b2fa-6b59-4613-a4e6-c7356502729d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:02.103340 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:02.125758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c3104-5b6f-4a59-b73f-5ec2c1d0817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:02.126444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c3104-5b6f-4a59-b73f-5ec2c1d0817d admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:02.126871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c3104-5b6f-4a59-b73f-5ec2c1d0817d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:02.127267 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c3104-5b6f-4a59-b73f-5ec2c1d0817d admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:02.128197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c3104-5b6f-4a59-b73f-5ec2c1d0817d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:02.130327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c3104-5b6f-4a59-b73f-5ec2c1d0817d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:02.295322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 952/1886] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:02 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:02.296597 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea74c2-23e5-46be-9b1e-680302caa6a1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:02.313102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea74c2-23e5-46be-9b1e-680302caa6a1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:02.313102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e06c20-62fd-4793-b1a3-7a2387e487e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:02.313102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e06c20-62fd-4793-b1a3-7a2387e487e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:02.313874 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e06c20-62fd-4793-b1a3-7a2387e487e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:02.313874 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e06c20-62fd-4793-b1a3-7a2387e487e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:02.314489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e06c20-62fd-4793-b1a3-7a2387e487e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:02.316106 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e06c20-62fd-4793-b1a3-7a2387e487e0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:02.327627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 935/1887] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:02.331713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c3104-5b6f-4a59-b73f-5ec2c1d0817d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:02.342860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c3104-5b6f-4a59-b73f-5ec2c1d0817d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:02.347706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a26db-c26c-4f4b-a477-fb12269b760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:02.348423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a26db-c26c-4f4b-a477-fb12269b760f admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:02.348870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a26db-c26c-4f4b-a477-fb12269b760f admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:02.349188 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a26db-c26c-4f4b-a477-fb12269b760f admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:02.349960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a26db-c26c-4f4b-a477-fb12269b760f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:02.351626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a26db-c26c-4f4b-a477-fb12269b760f admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:02.365260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 953/1888] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:47:02.366502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e06c20-62fd-4793-b1a3-7a2387e487e0 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:02.377377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e06c20-62fd-4793-b1a3-7a2387e487e0 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:02.382167 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959d93a-71d3-400c-9344-a3363a8029d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:02.383099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959d93a-71d3-400c-9344-a3363a8029d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:02.383387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959d93a-71d3-400c-9344-a3363a8029d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:02.383668 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959d93a-71d3-400c-9344-a3363a8029d9 admin admin] PATH_INFO: `/v3/projects/dbdb83196a124ceab8b3813eb6d0c52d/users/9009211fb2fe406db53631409e5ccedf/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:02.399852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959d93a-71d3-400c-9344-a3363a8029d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbdb83196a124ceab8b3813eb6d0c52d, user_id=9009211fb2fe406db53631409e5ccedf, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:02.402636 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959d93a-71d3-400c-9344-a3363a8029d9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:02.504997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 936/1889] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:02 2022] PUT /identity/v3/projects/dbdb83196a124ceab8b3813eb6d0c52d/users/9009211fb2fe406db53631409e5ccedf/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:02.515466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cc34a-ad51-43ef-8f32-b2ffc58763fc None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:02.516199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cc34a-ad51-43ef-8f32-b2ffc58763fc None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:02.516488 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cc34a-ad51-43ef-8f32-b2ffc58763fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:02.546953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-009cc34a-ad51-43ef-8f32-b2ffc58763fc None None] MFA Rules not processed for user `9009211fb2fe406db53631409e5ccedf`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:02.548210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-009cc34a-ad51-43ef-8f32-b2ffc58763fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:02.640308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 954/1890] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:02.647239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959d93a-71d3-400c-9344-a3363a8029d9 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:02.716785 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959d93a-71d3-400c-9344-a3363a8029d9 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:02.721653 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8918108-e791-4923-aa97-da3057b3650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:02.722326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8918108-e791-4923-aa97-da3057b3650e admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:02.722615 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8918108-e791-4923-aa97-da3057b3650e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:02.722900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8918108-e791-4923-aa97-da3057b3650e admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:02.723593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8918108-e791-4923-aa97-da3057b3650e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:02.725561 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8918108-e791-4923-aa97-da3057b3650e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:02.818996 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 937/1891] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:02 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:02.825299 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cc34a-ad51-43ef-8f32-b2ffc58763fc None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:02.837238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cc34a-ad51-43ef-8f32-b2ffc58763fc None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:02.895804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124b259-3b62-46dd-bb08-70af26865104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:02.896490 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b259-3b62-46dd-bb08-70af26865104 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:02.896776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b259-3b62-46dd-bb08-70af26865104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:02.897091 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b259-3b62-46dd-bb08-70af26865104 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:02.897780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124b259-3b62-46dd-bb08-70af26865104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:02.899712 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124b259-3b62-46dd-bb08-70af26865104 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:02.998500 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 955/1892] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:02 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:03.004631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8918108-e791-4923-aa97-da3057b3650e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:03.020646 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8918108-e791-4923-aa97-da3057b3650e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:03.020750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:03.024353 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae402018-3ac2-4ed1-88e7-a6cc5fe30aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:03.025211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae402018-3ac2-4ed1-88e7-a6cc5fe30aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:03.025498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae402018-3ac2-4ed1-88e7-a6cc5fe30aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:03.025778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae402018-3ac2-4ed1-88e7-a6cc5fe30aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:03.026509 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae402018-3ac2-4ed1-88e7-a6cc5fe30aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:03.028799 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae402018-3ac2-4ed1-88e7-a6cc5fe30aa0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:03.040116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 938/1893] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:03.044447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124b259-3b62-46dd-bb08-70af26865104 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:03.054967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124b259-3b62-46dd-bb08-70af26865104 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:03.060111 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274adf00-6775-4aa2-aa2c-e672d578f142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:03.061141 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274adf00-6775-4aa2-aa2c-e672d578f142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:03.061432 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274adf00-6775-4aa2-aa2c-e672d578f142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:03.061741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274adf00-6775-4aa2-aa2c-e672d578f142 admin admin] PATH_INFO: `/v3/projects/5f36893c95584e6d9fecf824d84302d1/users/6e26df2c2c954cb1b8191ce16b6b396b/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:03.079234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274adf00-6775-4aa2-aa2c-e672d578f142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f36893c95584e6d9fecf824d84302d1, user_id=6e26df2c2c954cb1b8191ce16b6b396b, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:03.081997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274adf00-6775-4aa2-aa2c-e672d578f142 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:03.216038 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 956/1894] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:03 2022] PUT /identity/v3/projects/5f36893c95584e6d9fecf824d84302d1/users/6e26df2c2c954cb1b8191ce16b6b396b/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:03.220014 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae402018-3ac2-4ed1-88e7-a6cc5fe30aa0 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:03.229845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae402018-3ac2-4ed1-88e7-a6cc5fe30aa0 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:03.286356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0059f-a132-42af-83c1-f836ec84cf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:03.287034 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0059f-a132-42af-83c1-f836ec84cf79 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:03.287354 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0059f-a132-42af-83c1-f836ec84cf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:03.287642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0059f-a132-42af-83c1-f836ec84cf79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:03.288364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0059f-a132-42af-83c1-f836ec84cf79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:03.289998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0059f-a132-42af-83c1-f836ec84cf79 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:03.300327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 939/1895] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:03.304434 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274adf00-6775-4aa2-aa2c-e672d578f142 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:03.315645 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274adf00-6775-4aa2-aa2c-e672d578f142 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:03.320430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5f197-0662-465d-818c-422cbb88f292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:03.321451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5f197-0662-465d-818c-422cbb88f292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:03.321630 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5f197-0662-465d-818c-422cbb88f292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:03.321913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5f197-0662-465d-818c-422cbb88f292 admin admin] PATH_INFO: `/v3/projects/5f36893c95584e6d9fecf824d84302d1/users/6e26df2c2c954cb1b8191ce16b6b396b/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:03.323925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5f197-0662-465d-818c-422cbb88f292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f36893c95584e6d9fecf824d84302d1, user_id=6e26df2c2c954cb1b8191ce16b6b396b, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:03.327319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5f197-0662-465d-818c-422cbb88f292 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:03.339859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 957/1896] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:03 2022] PUT /identity/v3/projects/5f36893c95584e6d9fecf824d84302d1/users/6e26df2c2c954cb1b8191ce16b6b396b/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:03.350022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403a16f-a73d-4e02-bc0f-30cf3ef782fa None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:03.350526 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403a16f-a73d-4e02-bc0f-30cf3ef782fa None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:03.350834 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403a16f-a73d-4e02-bc0f-30cf3ef782fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:03.382238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8403a16f-a73d-4e02-bc0f-30cf3ef782fa None None] MFA Rules not processed for user `6e26df2c2c954cb1b8191ce16b6b396b`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:03.383468 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8403a16f-a73d-4e02-bc0f-30cf3ef782fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:03.460320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 940/1897] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:03.531309 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:04.257384 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:04.438057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:05.123240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:05.519544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:06.311969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:06.451964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:06.794915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:07.090980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513c4ba-41b1-43cc-a050-068dfde6266e None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:07.091384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513c4ba-41b1-43cc-a050-068dfde6266e None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:07.091725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513c4ba-41b1-43cc-a050-068dfde6266e None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:07.093158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 958/1898] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jun 1 17:47:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:47:07.311591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa9290-9e0e-4b9a-a748-352efce9af04 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:07.311591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa9290-9e0e-4b9a-a748-352efce9af04 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:07.311929 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa9290-9e0e-4b9a-a748-352efce9af04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:07.331974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ebaa9290-9e0e-4b9a-a748-352efce9af04 None None] MFA Rules not processed for user `ae952b30dffa450e97ce4a73da8d00f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:07.333215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ebaa9290-9e0e-4b9a-a748-352efce9af04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:07.423231 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 941/1899] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jun 1 17:47:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:07.436605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513c4ba-41b1-43cc-a050-068dfde6266e None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:07.438635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0513c4ba-41b1-43cc-a050-068dfde6266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:07.462809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513c4ba-41b1-43cc-a050-068dfde6266e None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:07.469474 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7154c-25ec-4c9f-86f6-f6dc0ca0165a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:07.470589 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7154c-25ec-4c9f-86f6-f6dc0ca0165a service placement] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:07.471039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7154c-25ec-4c9f-86f6-f6dc0ca0165a service placement] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:07.471325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7154c-25ec-4c9f-86f6-f6dc0ca0165a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:07.484780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7154c-25ec-4c9f-86f6-f6dc0ca0165a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:07.486615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7154c-25ec-4c9f-86f6-f6dc0ca0165a service placement] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:07.498613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 959/1900] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:07.723992 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:07.942200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:08.419931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa9290-9e0e-4b9a-a748-352efce9af04 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:08.421587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ebaa9290-9e0e-4b9a-a748-352efce9af04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:08.499373 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa9290-9e0e-4b9a-a748-352efce9af04 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:08.504033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07a9ac-2b23-4e4d-9ba6-efe2cf39dedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:08.505054 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07a9ac-2b23-4e4d-9ba6-efe2cf39dedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:08.505335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07a9ac-2b23-4e4d-9ba6-efe2cf39dedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:08.505609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07a9ac-2b23-4e4d-9ba6-efe2cf39dedb admin admin] PATH_INFO: `/v3/users/4695ce568c8c43e9a8d960ce76dc7ab2` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:08.506800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07a9ac-2b23-4e4d-9ba6-efe2cf39dedb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4695ce568c8c43e9a8d960ce76dc7ab2)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:08.509275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07a9ac-2b23-4e4d-9ba6-efe2cf39dedb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:08.623211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:08.729156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5e07a9ac-2b23-4e4d-9ba6-efe2cf39dedb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4695ce568c8c43e9a8d960ce76dc7ab2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:08.864496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5e07a9ac-2b23-4e4d-9ba6-efe2cf39dedb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4695ce568c8c43e9a8d960ce76dc7ab2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:08.875284 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5e07a9ac-2b23-4e4d-9ba6-efe2cf39dedb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4695ce568c8c43e9a8d960ce76dc7ab2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:08.876003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5e07a9ac-2b23-4e4d-9ba6-efe2cf39dedb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4695ce568c8c43e9a8d960ce76dc7ab2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:08.888032 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5e07a9ac-2b23-4e4d-9ba6-efe2cf39dedb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4695ce568c8c43e9a8d960ce76dc7ab2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:08.893905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 942/1901] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:08 2022] DELETE /identity/v3/users/4695ce568c8c43e9a8d960ce76dc7ab2 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:09.353315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7154c-25ec-4c9f-86f6-f6dc0ca0165a service placement] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:09.369046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7154c-25ec-4c9f-86f6-f6dc0ca0165a service placement] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:09.501906 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:09.503654 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:09.503939 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:09.504209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe admin admin] PATH_INFO: `/v3/projects/b991a2dc922d4f8baa539b1ab418492d` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:09.506380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b991a2dc922d4f8baa539b1ab418492d)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:09.509468 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:09.662863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b991a2dc922d4f8baa539b1ab418492d', 'request_id': 'req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:09.671520 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b991a2dc922d4f8baa539b1ab418492d', 'request_id': 'req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:09.817179 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b991a2dc922d4f8baa539b1ab418492d', 'request_id': 'req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:09.835524 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe admin admin] The token cache is being invalidate because project b991a2dc922d4f8baa539b1ab418492d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:09.836204 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:09.836916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:09.839425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 960/1902] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:09 2022] DELETE /identity/v3/projects/b991a2dc922d4f8baa539b1ab418492d => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:09.844556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07a9ac-2b23-4e4d-9ba6-efe2cf39dedb admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:09.846908 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5e07a9ac-2b23-4e4d-9ba6-efe2cf39dedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:09.862820 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07a9ac-2b23-4e4d-9ba6-efe2cf39dedb admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:09.938196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46dabb-07dd-45c3-acbe-7496883535b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:09.939127 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46dabb-07dd-45c3-acbe-7496883535b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:09.939537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46dabb-07dd-45c3-acbe-7496883535b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:09.939824 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46dabb-07dd-45c3-acbe-7496883535b8 admin admin] PATH_INFO: `/v3/users/ba0f642c46594140b4dd7c270250d271` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:09.942596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46dabb-07dd-45c3-acbe-7496883535b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba0f642c46594140b4dd7c270250d271)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:09.943341 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46dabb-07dd-45c3-acbe-7496883535b8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:10.738728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9a46dabb-07dd-45c3-acbe-7496883535b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba0f642c46594140b4dd7c270250d271'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:10.757605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:10.902966 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9a46dabb-07dd-45c3-acbe-7496883535b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba0f642c46594140b4dd7c270250d271'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:10.910653 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9a46dabb-07dd-45c3-acbe-7496883535b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba0f642c46594140b4dd7c270250d271'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:10.913703 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9a46dabb-07dd-45c3-acbe-7496883535b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba0f642c46594140b4dd7c270250d271'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:10.924536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9a46dabb-07dd-45c3-acbe-7496883535b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba0f642c46594140b4dd7c270250d271'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:10.931703 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 943/1903] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:09 2022] DELETE /identity/v3/users/ba0f642c46594140b4dd7c270250d271 => generated 0 bytes in 1088 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:10.978431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:10.979910 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:11.055987 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31179a-5f85-4eb9-bd56-0f85b5dc5cfe admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:11.128695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fbbb4-89ab-44d5-9c99-8ed7dd70afd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:11.129795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fbbb4-89ab-44d5-9c99-8ed7dd70afd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:11.130452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fbbb4-89ab-44d5-9c99-8ed7dd70afd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:11.130895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fbbb4-89ab-44d5-9c99-8ed7dd70afd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:11.132902 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-035fbbb4-89ab-44d5-9c99-8ed7dd70afd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:11.198079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fbbb4-89ab-44d5-9c99-8ed7dd70afd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:11.199497 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fbbb4-89ab-44d5-9c99-8ed7dd70afd6 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:11.212299 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 961/1904] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:11.273438 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46dabb-07dd-45c3-acbe-7496883535b8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:11.275326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9a46dabb-07dd-45c3-acbe-7496883535b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:11.305195 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fbbb4-89ab-44d5-9c99-8ed7dd70afd6 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:11.306881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-035fbbb4-89ab-44d5-9c99-8ed7dd70afd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:11.392561 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46dabb-07dd-45c3-acbe-7496883535b8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:11.397118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fbbb4-89ab-44d5-9c99-8ed7dd70afd6 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:11.397581 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da78e74-1225-4553-b171-84ac200ac791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:11.398496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da78e74-1225-4553-b171-84ac200ac791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:11.398823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da78e74-1225-4553-b171-84ac200ac791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:11.399043 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da78e74-1225-4553-b171-84ac200ac791 admin admin] PATH_INFO: `/v3/projects/c1cf86d7ddaf4eb8b2f8fa4c543da903` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:11.400205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da78e74-1225-4553-b171-84ac200ac791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1cf86d7ddaf4eb8b2f8fa4c543da903)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:11.402065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353a2e1-48fc-4048-be8e-45058a336fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:11.402317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da78e74-1225-4553-b171-84ac200ac791 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:11.403091 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353a2e1-48fc-4048-be8e-45058a336fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:11.403379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353a2e1-48fc-4048-be8e-45058a336fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:11.403858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353a2e1-48fc-4048-be8e-45058a336fc7 admin admin] PATH_INFO: `/v3/users/03665bb1493c40abb25e0092a5d77c2a` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:11.404870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353a2e1-48fc-4048-be8e-45058a336fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03665bb1493c40abb25e0092a5d77c2a)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:11.406958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353a2e1-48fc-4048-be8e-45058a336fc7 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:11.581998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:11.622348 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6da78e74-1225-4553-b171-84ac200ac791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1cf86d7ddaf4eb8b2f8fa4c543da903', 'request_id': 'req-6da78e74-1225-4553-b171-84ac200ac791'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:11.622809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f353a2e1-48fc-4048-be8e-45058a336fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03665bb1493c40abb25e0092a5d77c2a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:11.631300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6da78e74-1225-4553-b171-84ac200ac791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1cf86d7ddaf4eb8b2f8fa4c543da903', 'request_id': 'req-6da78e74-1225-4553-b171-84ac200ac791'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:11.708104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f353a2e1-48fc-4048-be8e-45058a336fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03665bb1493c40abb25e0092a5d77c2a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:11.716478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f353a2e1-48fc-4048-be8e-45058a336fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03665bb1493c40abb25e0092a5d77c2a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:11.717214 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f353a2e1-48fc-4048-be8e-45058a336fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03665bb1493c40abb25e0092a5d77c2a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:11.729616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f353a2e1-48fc-4048-be8e-45058a336fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03665bb1493c40abb25e0092a5d77c2a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:11.736555 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 962/1905] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:11 2022] DELETE /identity/v3/users/03665bb1493c40abb25e0092a5d77c2a => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:11.740963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef752246-47dc-44a2-8aa2-bf83d6a6bca1 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:11.741254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef752246-47dc-44a2-8aa2-bf83d6a6bca1 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:11.741541 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef752246-47dc-44a2-8aa2-bf83d6a6bca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:11.759663 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-ef752246-47dc-44a2-8aa2-bf83d6a6bca1 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:11.762833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ef752246-47dc-44a2-8aa2-bf83d6a6bca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:11.816728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6da78e74-1225-4553-b171-84ac200ac791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1cf86d7ddaf4eb8b2f8fa4c543da903', 'request_id': 'req-6da78e74-1225-4553-b171-84ac200ac791'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:11.825531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 963/1906] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:47:11.832666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6da78e74-1225-4553-b171-84ac200ac791 admin admin] The token cache is being invalidate because project c1cf86d7ddaf4eb8b2f8fa4c543da903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:11.832998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6da78e74-1225-4553-b171-84ac200ac791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:11.833725 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6da78e74-1225-4553-b171-84ac200ac791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:11.835147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef752246-47dc-44a2-8aa2-bf83d6a6bca1 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:11.841963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 944/1907] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:11 2022] DELETE /identity/v3/projects/c1cf86d7ddaf4eb8b2f8fa4c543da903 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:11.842133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ef752246-47dc-44a2-8aa2-bf83d6a6bca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:11.842374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7019f27-38ff-4fdc-9f11-242dd33f3d6d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:11.842671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7019f27-38ff-4fdc-9f11-242dd33f3d6d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:11.842999 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7019f27-38ff-4fdc-9f11-242dd33f3d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:11.862494 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e7019f27-38ff-4fdc-9f11-242dd33f3d6d None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:11.864286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e7019f27-38ff-4fdc-9f11-242dd33f3d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:11.873906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 945/1908] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:11.882954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de1c80-ca7c-406d-8ead-abcf3eb76571 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:11.883428 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de1c80-ca7c-406d-8ead-abcf3eb76571 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:11.884106 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de1c80-ca7c-406d-8ead-abcf3eb76571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:11.903648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef752246-47dc-44a2-8aa2-bf83d6a6bca1 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:11.904642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e8de1c80-ca7c-406d-8ead-abcf3eb76571 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:11.906650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e8de1c80-ca7c-406d-8ead-abcf3eb76571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:11.909010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5289e-f6b7-4526-9354-8e10095e8448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:11.909886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5289e-f6b7-4526-9354-8e10095e8448 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:11.910211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5289e-f6b7-4526-9354-8e10095e8448 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:11.910656 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5289e-f6b7-4526-9354-8e10095e8448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:11.912549 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-cea5289e-f6b7-4526-9354-8e10095e8448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:11.917037 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 946/1909] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:11.921616 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de1c80-ca7c-406d-8ead-abcf3eb76571 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:11.928219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5289e-f6b7-4526-9354-8e10095e8448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:11.930055 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5289e-f6b7-4526-9354-8e10095e8448 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:11.931812 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de1c80-ca7c-406d-8ead-abcf3eb76571 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:11.937931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41781c-0111-4135-89fd-3c9c231d5f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:11.942720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:11.942848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41781c-0111-4135-89fd-3c9c231d5f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:11.942848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41781c-0111-4135-89fd-3c9c231d5f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:11.942848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41781c-0111-4135-89fd-3c9c231d5f09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:11.942848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41781c-0111-4135-89fd-3c9c231d5f09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:47:11.942848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41781c-0111-4135-89fd-3c9c231d5f09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:11.942848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41781c-0111-4135-89fd-3c9c231d5f09 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:11.943558 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 964/1910] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:47:11.959784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 947/1911] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:47:11.961516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5289e-f6b7-4526-9354-8e10095e8448 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:11.973324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5289e-f6b7-4526-9354-8e10095e8448 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:11.979329 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822562f3-c619-4a5e-8bcd-8fdbb88c2943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:11.980216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822562f3-c619-4a5e-8bcd-8fdbb88c2943 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:11.981256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822562f3-c619-4a5e-8bcd-8fdbb88c2943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:11.981640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822562f3-c619-4a5e-8bcd-8fdbb88c2943 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:11.982536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822562f3-c619-4a5e-8bcd-8fdbb88c2943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:11.984836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822562f3-c619-4a5e-8bcd-8fdbb88c2943 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:12.103447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 965/1912] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:11 2022] POST /identity/v3/projects => generated 359 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:12.107749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41781c-0111-4135-89fd-3c9c231d5f09 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:12.118070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41781c-0111-4135-89fd-3c9c231d5f09 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:12.205948 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955991dd-296a-428a-b722-131ad2443016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:12.205948 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955991dd-296a-428a-b722-131ad2443016 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:12.205948 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955991dd-296a-428a-b722-131ad2443016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:12.205948 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955991dd-296a-428a-b722-131ad2443016 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:12.206840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955991dd-296a-428a-b722-131ad2443016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:12.209709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955991dd-296a-428a-b722-131ad2443016 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:12.323797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 948/1913] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:12 2022] POST /identity/v3/users => generated 280 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:12.328047 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822562f3-c619-4a5e-8bcd-8fdbb88c2943 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:12.341947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822562f3-c619-4a5e-8bcd-8fdbb88c2943 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:12.350669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85755e9-b750-4236-9153-54479a85ad17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:12.352040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85755e9-b750-4236-9153-54479a85ad17 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:12.352040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85755e9-b750-4236-9153-54479a85ad17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:12.352297 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85755e9-b750-4236-9153-54479a85ad17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:12.353275 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85755e9-b750-4236-9153-54479a85ad17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:12.355142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85755e9-b750-4236-9153-54479a85ad17 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:12.369154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 966/1914] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:12.373214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955991dd-296a-428a-b722-131ad2443016 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:12.390679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955991dd-296a-428a-b722-131ad2443016 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:12.390679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c951fe-2e8c-4d44-b7d7-34423bfe1811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:12.390679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c951fe-2e8c-4d44-b7d7-34423bfe1811 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:12.390679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c951fe-2e8c-4d44-b7d7-34423bfe1811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:12.391033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c951fe-2e8c-4d44-b7d7-34423bfe1811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:12.391033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c951fe-2e8c-4d44-b7d7-34423bfe1811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:12.392626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c951fe-2e8c-4d44-b7d7-34423bfe1811 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:12.410438 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 949/1915] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:47:12.415113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85755e9-b750-4236-9153-54479a85ad17 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:12.427662 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85755e9-b750-4236-9153-54479a85ad17 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:12.432651 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b894e-eca3-4a75-a896-a15a9c436c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:12.434066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b894e-eca3-4a75-a896-a15a9c436c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:12.434526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b894e-eca3-4a75-a896-a15a9c436c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:12.434801 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b894e-eca3-4a75-a896-a15a9c436c48 admin admin] PATH_INFO: `/v3/projects/510cbbdd6d61440880e2c7dc5022d9c4/users/08d8fec9fc454a13b7c805703c0861bd/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:12.451232 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b894e-eca3-4a75-a896-a15a9c436c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=510cbbdd6d61440880e2c7dc5022d9c4, user_id=08d8fec9fc454a13b7c805703c0861bd, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:12.454141 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b894e-eca3-4a75-a896-a15a9c436c48 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:12.583892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c951fe-2e8c-4d44-b7d7-34423bfe1811 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:12.583892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f9c951fe-2e8c-4d44-b7d7-34423bfe1811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:12.602873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 967/1916] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:12 2022] PUT /identity/v3/projects/510cbbdd6d61440880e2c7dc5022d9c4/users/08d8fec9fc454a13b7c805703c0861bd/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:12.606156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecd429-dce7-4891-b9f7-cfa706da0b83 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:12.606416 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecd429-dce7-4891-b9f7-cfa706da0b83 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:12.606684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecd429-dce7-4891-b9f7-cfa706da0b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:12.608574 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c951fe-2e8c-4d44-b7d7-34423bfe1811 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:12.666752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-24ecd429-dce7-4891-b9f7-cfa706da0b83 None None] MFA Rules not processed for user `08d8fec9fc454a13b7c805703c0861bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:12.669518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-24ecd429-dce7-4891-b9f7-cfa706da0b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:12.722668 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc262be2-17cb-492e-9206-76f9aa4671da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:12.723647 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc262be2-17cb-492e-9206-76f9aa4671da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:12.724065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc262be2-17cb-492e-9206-76f9aa4671da admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:12.724366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc262be2-17cb-492e-9206-76f9aa4671da admin admin] PATH_INFO: `/v3/projects/83b5c58df7eb4c5ab19a60bfaca215c3` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:12.725808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc262be2-17cb-492e-9206-76f9aa4671da admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b5c58df7eb4c5ab19a60bfaca215c3)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:12.727843 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc262be2-17cb-492e-9206-76f9aa4671da admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:12.745813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 968/1917] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:12 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:47:12.784772 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecd429-dce7-4891-b9f7-cfa706da0b83 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:12.786212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-24ecd429-dce7-4891-b9f7-cfa706da0b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:12.843196 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecd429-dce7-4891-b9f7-cfa706da0b83 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:12.846939 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edaeb92-9b75-419c-9121-09c440cdb982 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:12.847630 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaeb92-9b75-419c-9121-09c440cdb982 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:12.847919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaeb92-9b75-419c-9121-09c440cdb982 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:12.848199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaeb92-9b75-419c-9121-09c440cdb982 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:12.856809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edaeb92-9b75-419c-9121-09c440cdb982 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:12.858281 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edaeb92-9b75-419c-9121-09c440cdb982 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:12.867096 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 969/1918] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:12 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:47:12.881873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edaeb92-9b75-419c-9121-09c440cdb982 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:12.891024 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cc262be2-17cb-492e-9206-76f9aa4671da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b5c58df7eb4c5ab19a60bfaca215c3', 'request_id': 'req-cc262be2-17cb-492e-9206-76f9aa4671da'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:12.894858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edaeb92-9b75-419c-9121-09c440cdb982 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:12.901892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cc262be2-17cb-492e-9206-76f9aa4671da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b5c58df7eb4c5ab19a60bfaca215c3', 'request_id': 'req-cc262be2-17cb-492e-9206-76f9aa4671da'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:12.959118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858df41-da4f-4f52-a187-fc065390f162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:12.960211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858df41-da4f-4f52-a187-fc065390f162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:12.960563 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858df41-da4f-4f52-a187-fc065390f162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:12.960779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858df41-da4f-4f52-a187-fc065390f162 admin admin] PATH_INFO: `/v3/users/08d8fec9fc454a13b7c805703c0861bd` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:12.962034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858df41-da4f-4f52-a187-fc065390f162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d8fec9fc454a13b7c805703c0861bd)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:12.964262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858df41-da4f-4f52-a187-fc065390f162 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:13.022156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cc262be2-17cb-492e-9206-76f9aa4671da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b5c58df7eb4c5ab19a60bfaca215c3', 'request_id': 'req-cc262be2-17cb-492e-9206-76f9aa4671da'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:13.033386 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cc262be2-17cb-492e-9206-76f9aa4671da admin admin] The token cache is being invalidate because project 83b5c58df7eb4c5ab19a60bfaca215c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:13.033643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cc262be2-17cb-492e-9206-76f9aa4671da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:13.034277 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-cc262be2-17cb-492e-9206-76f9aa4671da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:13.035854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 950/1919] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:12 2022] DELETE /identity/v3/projects/83b5c58df7eb4c5ab19a60bfaca215c3 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:13.039954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc262be2-17cb-492e-9206-76f9aa4671da admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:13.041419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cc262be2-17cb-492e-9206-76f9aa4671da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:13.056166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc262be2-17cb-492e-9206-76f9aa4671da admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:13.060537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8e623-728a-41e3-aff1-7b6434ae1202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:13.061552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8e623-728a-41e3-aff1-7b6434ae1202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:13.064374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8e623-728a-41e3-aff1-7b6434ae1202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:13.064374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8e623-728a-41e3-aff1-7b6434ae1202 admin admin] PATH_INFO: `/v3/users/66b6daaff915485d837fe70ee3518f1d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:13.064374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8e623-728a-41e3-aff1-7b6434ae1202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b6daaff915485d837fe70ee3518f1d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:13.065511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8e623-728a-41e3-aff1-7b6434ae1202 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:13.247249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7858df41-da4f-4f52-a187-fc065390f162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d8fec9fc454a13b7c805703c0861bd'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:13.375531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7858df41-da4f-4f52-a187-fc065390f162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d8fec9fc454a13b7c805703c0861bd'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:13.382971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7858df41-da4f-4f52-a187-fc065390f162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d8fec9fc454a13b7c805703c0861bd'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:13.383605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7858df41-da4f-4f52-a187-fc065390f162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d8fec9fc454a13b7c805703c0861bd'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:13.385866 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-34b8e623-728a-41e3-aff1-7b6434ae1202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b6daaff915485d837fe70ee3518f1d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:13.395642 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7858df41-da4f-4f52-a187-fc065390f162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d8fec9fc454a13b7c805703c0861bd'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:13.401788 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 970/1920] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:12 2022] DELETE /identity/v3/users/08d8fec9fc454a13b7c805703c0861bd => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:13.406448 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1453c-64bf-466a-901e-4c99fd971fce None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:13.408622 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1453c-64bf-466a-901e-4c99fd971fce None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:13.408622 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1453c-64bf-466a-901e-4c99fd971fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:13.426896 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-47c1453c-64bf-466a-901e-4c99fd971fce None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:13.428290 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-47c1453c-64bf-466a-901e-4c99fd971fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:13.489878 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 971/1921] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:47:13.500272 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1453c-64bf-466a-901e-4c99fd971fce None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:13.500520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-34b8e623-728a-41e3-aff1-7b6434ae1202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b6daaff915485d837fe70ee3518f1d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:13.501717 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-47c1453c-64bf-466a-901e-4c99fd971fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:13.508895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-34b8e623-728a-41e3-aff1-7b6434ae1202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b6daaff915485d837fe70ee3518f1d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:13.512709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-34b8e623-728a-41e3-aff1-7b6434ae1202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b6daaff915485d837fe70ee3518f1d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:13.521675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-34b8e623-728a-41e3-aff1-7b6434ae1202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b6daaff915485d837fe70ee3518f1d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:13.527877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 951/1922] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:13 2022] DELETE /identity/v3/users/66b6daaff915485d837fe70ee3518f1d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:13.560402 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1453c-64bf-466a-901e-4c99fd971fce None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:13.613274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a6802-a43f-4170-958e-b0d5fb9aed9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:13.614032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a6802-a43f-4170-958e-b0d5fb9aed9d service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:13.614439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a6802-a43f-4170-958e-b0d5fb9aed9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:13.614721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a6802-a43f-4170-958e-b0d5fb9aed9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:13.616634 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-628a6802-a43f-4170-958e-b0d5fb9aed9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:13.682730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a6802-a43f-4170-958e-b0d5fb9aed9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:13.684213 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a6802-a43f-4170-958e-b0d5fb9aed9d service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:13.695944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 972/1923] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:47:13.733060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:13.798243 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:14.138735 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8e623-728a-41e3-aff1-7b6434ae1202 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:14.139312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-34b8e623-728a-41e3-aff1-7b6434ae1202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:14.156048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8e623-728a-41e3-aff1-7b6434ae1202 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:14.161404 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228dcb9-4033-4fa2-97a5-5fea53b20b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:14.162567 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228dcb9-4033-4fa2-97a5-5fea53b20b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:14.162845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228dcb9-4033-4fa2-97a5-5fea53b20b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:14.163320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228dcb9-4033-4fa2-97a5-5fea53b20b3b admin admin] PATH_INFO: `/v3/projects/684f2caf6c42410895019fefcd8b921d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:14.165853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228dcb9-4033-4fa2-97a5-5fea53b20b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=684f2caf6c42410895019fefcd8b921d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:14.168551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228dcb9-4033-4fa2-97a5-5fea53b20b3b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:14.307377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b228dcb9-4033-4fa2-97a5-5fea53b20b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '684f2caf6c42410895019fefcd8b921d', 'request_id': 'req-b228dcb9-4033-4fa2-97a5-5fea53b20b3b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:14.314107 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b228dcb9-4033-4fa2-97a5-5fea53b20b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '684f2caf6c42410895019fefcd8b921d', 'request_id': 'req-b228dcb9-4033-4fa2-97a5-5fea53b20b3b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:14.362531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a6802-a43f-4170-958e-b0d5fb9aed9d service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:14.362531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-628a6802-a43f-4170-958e-b0d5fb9aed9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:14.375155 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a6802-a43f-4170-958e-b0d5fb9aed9d service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:14.383461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:14.428560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b228dcb9-4033-4fa2-97a5-5fea53b20b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '684f2caf6c42410895019fefcd8b921d', 'request_id': 'req-b228dcb9-4033-4fa2-97a5-5fea53b20b3b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:14.447673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b228dcb9-4033-4fa2-97a5-5fea53b20b3b admin admin] The token cache is being invalidate because project 684f2caf6c42410895019fefcd8b921d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:14.448312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b228dcb9-4033-4fa2-97a5-5fea53b20b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:14.449669 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b228dcb9-4033-4fa2-97a5-5fea53b20b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:14.452587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 952/1924] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:14 2022] DELETE /identity/v3/projects/684f2caf6c42410895019fefcd8b921d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:14.465724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bfc7a-5d19-4d41-8cf5-187c2823a5c0 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:14.465724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bfc7a-5d19-4d41-8cf5-187c2823a5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:14.465724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bfc7a-5d19-4d41-8cf5-187c2823a5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:14.466843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d5820-7027-4b5b-8dee-d832b1ab6a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:14.466843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d5820-7027-4b5b-8dee-d832b1ab6a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:14.466843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d5820-7027-4b5b-8dee-d832b1ab6a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:14.466843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d5820-7027-4b5b-8dee-d832b1ab6a71 admin admin] PATH_INFO: `/v3/projects/510cbbdd6d61440880e2c7dc5022d9c4` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:14.467452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d5820-7027-4b5b-8dee-d832b1ab6a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=510cbbdd6d61440880e2c7dc5022d9c4)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:14.467452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d5820-7027-4b5b-8dee-d832b1ab6a71 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:14.508276 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-745bfc7a-5d19-4d41-8cf5-187c2823a5c0 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:14.509526 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-745bfc7a-5d19-4d41-8cf5-187c2823a5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:14.519210 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 953/1925] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:47:14.530084 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378c13-c708-4c58-8bd1-2d0656ffc6f2 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:14.530462 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378c13-c708-4c58-8bd1-2d0656ffc6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:14.530808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378c13-c708-4c58-8bd1-2d0656ffc6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:14.554428 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-82378c13-c708-4c58-8bd1-2d0656ffc6f2 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:14.555644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-82378c13-c708-4c58-8bd1-2d0656ffc6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:14.565861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 954/1926] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:14.569863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82378c13-c708-4c58-8bd1-2d0656ffc6f2 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:14.580069 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82378c13-c708-4c58-8bd1-2d0656ffc6f2 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:14.603728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c36d66-6cd3-4ff5-a19d-60bf576ce6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:14.604241 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c36d66-6cd3-4ff5-a19d-60bf576ce6bb admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:14.607311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c36d66-6cd3-4ff5-a19d-60bf576ce6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:14.607725 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c36d66-6cd3-4ff5-a19d-60bf576ce6bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:14.608460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-550d5820-7027-4b5b-8dee-d832b1ab6a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510cbbdd6d61440880e2c7dc5022d9c4', 'request_id': 'req-550d5820-7027-4b5b-8dee-d832b1ab6a71'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:14.608677 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c36d66-6cd3-4ff5-a19d-60bf576ce6bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:47:14.609123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c36d66-6cd3-4ff5-a19d-60bf576ce6bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:14.613287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c36d66-6cd3-4ff5-a19d-60bf576ce6bb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:14.617671 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-550d5820-7027-4b5b-8dee-d832b1ab6a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510cbbdd6d61440880e2c7dc5022d9c4', 'request_id': 'req-550d5820-7027-4b5b-8dee-d832b1ab6a71'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:14.641028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 955/1927] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:47:14.645710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c36d66-6cd3-4ff5-a19d-60bf576ce6bb admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:14.659053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c36d66-6cd3-4ff5-a19d-60bf576ce6bb admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:14.692110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-550d5820-7027-4b5b-8dee-d832b1ab6a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510cbbdd6d61440880e2c7dc5022d9c4', 'request_id': 'req-550d5820-7027-4b5b-8dee-d832b1ab6a71'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:14.703427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-550d5820-7027-4b5b-8dee-d832b1ab6a71 admin admin] The token cache is being invalidate because project 510cbbdd6d61440880e2c7dc5022d9c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:14.705405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-550d5820-7027-4b5b-8dee-d832b1ab6a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:14.706922 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-550d5820-7027-4b5b-8dee-d832b1ab6a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:14.709252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 973/1928] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:14 2022] DELETE /identity/v3/projects/510cbbdd6d61440880e2c7dc5022d9c4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:14.714295 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac060f46-7e46-48ee-b450-973b4357cb87 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:14.715168 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac060f46-7e46-48ee-b450-973b4357cb87 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:14.715513 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac060f46-7e46-48ee-b450-973b4357cb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:14.737217 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade8e6f-ee1b-43f4-8ff6-bf3590a87a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:14.737767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade8e6f-ee1b-43f4-8ff6-bf3590a87a0f admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:14.738042 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade8e6f-ee1b-43f4-8ff6-bf3590a87a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:14.738325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade8e6f-ee1b-43f4-8ff6-bf3590a87a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:14.739123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade8e6f-ee1b-43f4-8ff6-bf3590a87a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:14.741290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade8e6f-ee1b-43f4-8ff6-bf3590a87a0f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:14.741616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-ac060f46-7e46-48ee-b450-973b4357cb87 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:14.742941 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ac060f46-7e46-48ee-b450-973b4357cb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:14.752978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 974/1929] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:47:14.759757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0632b4f-47f1-4fed-b954-20d67886b2fe None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:14.760178 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0632b4f-47f1-4fed-b954-20d67886b2fe None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:14.760820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0632b4f-47f1-4fed-b954-20d67886b2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:14.782160 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b0632b4f-47f1-4fed-b954-20d67886b2fe None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:14.784074 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b0632b4f-47f1-4fed-b954-20d67886b2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:14.795360 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 975/1930] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:47:14.796619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0632b4f-47f1-4fed-b954-20d67886b2fe None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:14.806963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0632b4f-47f1-4fed-b954-20d67886b2fe None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:14.812688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff337d-e5e3-4d95-8bcd-c08277d1a908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:14.813346 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff337d-e5e3-4d95-8bcd-c08277d1a908 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:14.813635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff337d-e5e3-4d95-8bcd-c08277d1a908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:14.813915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff337d-e5e3-4d95-8bcd-c08277d1a908 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:14.814646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff337d-e5e3-4d95-8bcd-c08277d1a908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:47:14.814966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff337d-e5e3-4d95-8bcd-c08277d1a908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:14.816545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff337d-e5e3-4d95-8bcd-c08277d1a908 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:14.828790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 976/1931] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:47:14.833134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff337d-e5e3-4d95-8bcd-c08277d1a908 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:14.843865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff337d-e5e3-4d95-8bcd-c08277d1a908 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:14.848773 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf951c76-09c9-40c9-8ea9-1d8737dd39f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:14.849481 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951c76-09c9-40c9-8ea9-1d8737dd39f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:14.849909 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951c76-09c9-40c9-8ea9-1d8737dd39f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:14.850197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951c76-09c9-40c9-8ea9-1d8737dd39f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:14.850897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf951c76-09c9-40c9-8ea9-1d8737dd39f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:14.853016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf951c76-09c9-40c9-8ea9-1d8737dd39f5 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:14.872983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 956/1932] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:14 2022] POST /identity/v3/projects => generated 407 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:47:14.874863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade8e6f-ee1b-43f4-8ff6-bf3590a87a0f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:14.876716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9ade8e6f-ee1b-43f4-8ff6-bf3590a87a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:14.949969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade8e6f-ee1b-43f4-8ff6-bf3590a87a0f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:14.954963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb0310-dcf7-470a-aa46-531413948884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:14.955696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb0310-dcf7-470a-aa46-531413948884 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:14.955982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb0310-dcf7-470a-aa46-531413948884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:14.956261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb0310-dcf7-470a-aa46-531413948884 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:14.957289 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb0310-dcf7-470a-aa46-531413948884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:14.959295 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb0310-dcf7-470a-aa46-531413948884 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:14.966696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 977/1933] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:14 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:47:14.967911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf951c76-09c9-40c9-8ea9-1d8737dd39f5 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:15.023159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 957/1934] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:14 2022] POST /identity/v3/users => generated 304 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:15.027463 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb0310-dcf7-470a-aa46-531413948884 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:15.038113 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb0310-dcf7-470a-aa46-531413948884 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:15.041627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf951c76-09c9-40c9-8ea9-1d8737dd39f5 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:15.046550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113fcda-992c-41fb-852b-2876ddf4b1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:15.047438 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113fcda-992c-41fb-852b-2876ddf4b1ab admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:15.047791 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113fcda-992c-41fb-852b-2876ddf4b1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:15.050960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113fcda-992c-41fb-852b-2876ddf4b1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:15.050960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113fcda-992c-41fb-852b-2876ddf4b1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:15.051152 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322abafa-888f-4c63-95f4-66f6ca06d327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:15.051256 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113fcda-992c-41fb-852b-2876ddf4b1ab admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:15.051340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322abafa-888f-4c63-95f4-66f6ca06d327 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:15.051517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322abafa-888f-4c63-95f4-66f6ca06d327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:15.052319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322abafa-888f-4c63-95f4-66f6ca06d327 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:15.053518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322abafa-888f-4c63-95f4-66f6ca06d327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:15.055558 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322abafa-888f-4c63-95f4-66f6ca06d327 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:15.063293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 958/1935] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:47:15.067580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113fcda-992c-41fb-852b-2876ddf4b1ab admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:15.077323 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113fcda-992c-41fb-852b-2876ddf4b1ab admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:15.082054 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c5828-fa1f-4f85-906a-be0b474b7485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:15.082723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c5828-fa1f-4f85-906a-be0b474b7485 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:15.083013 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c5828-fa1f-4f85-906a-be0b474b7485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:15.083347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c5828-fa1f-4f85-906a-be0b474b7485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:15.084082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c5828-fa1f-4f85-906a-be0b474b7485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:15.085739 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c5828-fa1f-4f85-906a-be0b474b7485 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:15.096049 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 959/1936] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:15.100105 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c5828-fa1f-4f85-906a-be0b474b7485 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:15.110269 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c5828-fa1f-4f85-906a-be0b474b7485 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:15.114915 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a5c7a-02f3-41bd-8e6b-01c0c9bca7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:15.115860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a5c7a-02f3-41bd-8e6b-01c0c9bca7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:15.116150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a5c7a-02f3-41bd-8e6b-01c0c9bca7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:15.116430 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a5c7a-02f3-41bd-8e6b-01c0c9bca7d0 admin admin] PATH_INFO: `/v3/projects/44390d7f50814689a0b6af5ecd132751/users/cb57497f3d3e48a6b274a05359d7177f/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:15.133060 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a5c7a-02f3-41bd-8e6b-01c0c9bca7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44390d7f50814689a0b6af5ecd132751, user_id=cb57497f3d3e48a6b274a05359d7177f, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:15.135805 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a5c7a-02f3-41bd-8e6b-01c0c9bca7d0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:15.179013 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 978/1937] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:14 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:15.180282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322abafa-888f-4c63-95f4-66f6ca06d327 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:15.190874 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322abafa-888f-4c63-95f4-66f6ca06d327 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:15.196442 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6cb0e-d87f-46f6-8b24-109c728ee3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:15.197137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6cb0e-d87f-46f6-8b24-109c728ee3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:15.197424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6cb0e-d87f-46f6-8b24-109c728ee3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:15.197700 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6cb0e-d87f-46f6-8b24-109c728ee3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:15.198430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6cb0e-d87f-46f6-8b24-109c728ee3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:15.200381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6cb0e-d87f-46f6-8b24-109c728ee3b3 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:15.210759 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 979/1938] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:15.215409 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6cb0e-d87f-46f6-8b24-109c728ee3b3 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:15.225345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6cb0e-d87f-46f6-8b24-109c728ee3b3 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:15.229970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693f983-6710-49bd-8586-8f3a9366f92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:15.231453 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693f983-6710-49bd-8586-8f3a9366f92e admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:15.231796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693f983-6710-49bd-8586-8f3a9366f92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:15.232082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693f983-6710-49bd-8586-8f3a9366f92e admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:15.232799 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693f983-6710-49bd-8586-8f3a9366f92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:15.234438 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693f983-6710-49bd-8586-8f3a9366f92e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:15.248624 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 980/1939] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:47:15.250085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693f983-6710-49bd-8586-8f3a9366f92e admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:15.261264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693f983-6710-49bd-8586-8f3a9366f92e admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:15.263212 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 960/1940] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:15 2022] PUT /identity/v3/projects/44390d7f50814689a0b6af5ecd132751/users/cb57497f3d3e48a6b274a05359d7177f/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:15.273580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da39570-9b0e-429c-ab83-09a8474b8352 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:15.274858 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da39570-9b0e-429c-ab83-09a8474b8352 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:15.274858 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da39570-9b0e-429c-ab83-09a8474b8352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:15.307587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6da39570-9b0e-429c-ab83-09a8474b8352 None None] MFA Rules not processed for user `cb57497f3d3e48a6b274a05359d7177f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:15.309119 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6da39570-9b0e-429c-ab83-09a8474b8352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:15.338111 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f78d3b-df6d-4ff5-a515-b855b5af9006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:15.339284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f78d3b-df6d-4ff5-a515-b855b5af9006 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:15.340243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f78d3b-df6d-4ff5-a515-b855b5af9006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:15.340530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f78d3b-df6d-4ff5-a515-b855b5af9006 admin admin] PATH_INFO: `/v3/projects/e09020c080d648dea21f96d3591c8a16/users/97b0709b4999468eab06708dad660d7d/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:15.356917 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f78d3b-df6d-4ff5-a515-b855b5af9006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09020c080d648dea21f96d3591c8a16, user_id=97b0709b4999468eab06708dad660d7d, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:15.359893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f78d3b-df6d-4ff5-a515-b855b5af9006 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:15.364686 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:15.401372 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 961/1941] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:15.406452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da39570-9b0e-429c-ab83-09a8474b8352 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:15.416826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da39570-9b0e-429c-ab83-09a8474b8352 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:15.424215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb4f96-d9ab-4dfa-a5c9-60a592513bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:15.429065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb4f96-d9ab-4dfa-a5c9-60a592513bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:15.429065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb4f96-d9ab-4dfa-a5c9-60a592513bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:15.429065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb4f96-d9ab-4dfa-a5c9-60a592513bb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:15.429065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb4f96-d9ab-4dfa-a5c9-60a592513bb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:15.429681 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb4f96-d9ab-4dfa-a5c9-60a592513bb2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:15.458041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 981/1942] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:15 2022] PUT /identity/v3/projects/e09020c080d648dea21f96d3591c8a16/users/97b0709b4999468eab06708dad660d7d/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:15.469414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0fa2c-808d-4f10-8476-7ab4db613f5b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:15.469704 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0fa2c-808d-4f10-8476-7ab4db613f5b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:15.469985 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0fa2c-808d-4f10-8476-7ab4db613f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:15.509703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-31c0fa2c-808d-4f10-8476-7ab4db613f5b None None] MFA Rules not processed for user `97b0709b4999468eab06708dad660d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:15.510944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-31c0fa2c-808d-4f10-8476-7ab4db613f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:15.544053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 962/1943] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:15 2022] POST /identity/v3/projects => generated 409 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:47:15.548132 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb4f96-d9ab-4dfa-a5c9-60a592513bb2 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:15.576638 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 982/1944] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:47:15.589227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0fa2c-808d-4f10-8476-7ab4db613f5b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:15.591611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-31c0fa2c-808d-4f10-8476-7ab4db613f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:15.613276 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb4f96-d9ab-4dfa-a5c9-60a592513bb2 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:15.618115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa10eb-1f5b-4cd0-a42b-2596194ee941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:15.618793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa10eb-1f5b-4cd0-a42b-2596194ee941 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:15.619083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa10eb-1f5b-4cd0-a42b-2596194ee941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:15.619363 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa10eb-1f5b-4cd0-a42b-2596194ee941 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:15.620053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa10eb-1f5b-4cd0-a42b-2596194ee941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:15.622638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa10eb-1f5b-4cd0-a42b-2596194ee941 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:15.647571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0fa2c-808d-4f10-8476-7ab4db613f5b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:15.697424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6f1fc-19ed-42d1-960a-a3eeb1afca20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:15.698088 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6f1fc-19ed-42d1-960a-a3eeb1afca20 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:15.698374 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6f1fc-19ed-42d1-960a-a3eeb1afca20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:15.698654 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6f1fc-19ed-42d1-960a-a3eeb1afca20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:15.741227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 963/1945] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:15 2022] POST /identity/v3/users => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:47:15.743006 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa10eb-1f5b-4cd0-a42b-2596194ee941 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:15.758872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa10eb-1f5b-4cd0-a42b-2596194ee941 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:15.765301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c95a7-4fb7-46da-b5a0-6c529416a7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:15.767012 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c95a7-4fb7-46da-b5a0-6c529416a7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:15.768438 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:15.769161 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c95a7-4fb7-46da-b5a0-6c529416a7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:15.769562 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c95a7-4fb7-46da-b5a0-6c529416a7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:15.770513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c95a7-4fb7-46da-b5a0-6c529416a7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:15.772276 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c95a7-4fb7-46da-b5a0-6c529416a7e3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:15.780040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6f1fc-19ed-42d1-960a-a3eeb1afca20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:15.781921 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6f1fc-19ed-42d1-960a-a3eeb1afca20 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:15.784030 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 964/1946] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:15.788135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c95a7-4fb7-46da-b5a0-6c529416a7e3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:15.793653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 983/1947] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:47:15.798813 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c95a7-4fb7-46da-b5a0-6c529416a7e3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:15.804207 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffc2e8-66c3-47b2-a7bd-75b754d6bfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:15.805218 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffc2e8-66c3-47b2-a7bd-75b754d6bfce admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:15.805686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffc2e8-66c3-47b2-a7bd-75b754d6bfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:15.806631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffc2e8-66c3-47b2-a7bd-75b754d6bfce admin admin] PATH_INFO: `/v3/projects/4e5059535b3147e7933fa683f7d14bed/users/18a50399114d4b84ba2d13dfb154169b/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:15.823445 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffc2e8-66c3-47b2-a7bd-75b754d6bfce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5059535b3147e7933fa683f7d14bed, user_id=18a50399114d4b84ba2d13dfb154169b, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:15.828609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffc2e8-66c3-47b2-a7bd-75b754d6bfce admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:15.843568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:15.907111 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 965/1948] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:15 2022] PUT /identity/v3/projects/4e5059535b3147e7933fa683f7d14bed/users/18a50399114d4b84ba2d13dfb154169b/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:15.911166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6f1fc-19ed-42d1-960a-a3eeb1afca20 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:15.922037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6f1fc-19ed-42d1-960a-a3eeb1afca20 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:15.982823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7ab84-00c2-4cb6-aae4-6ca8808618af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:15.983547 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7ab84-00c2-4cb6-aae4-6ca8808618af admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:15.983942 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7ab84-00c2-4cb6-aae4-6ca8808618af admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:15.984240 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7ab84-00c2-4cb6-aae4-6ca8808618af admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:15.988548 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7ab84-00c2-4cb6-aae4-6ca8808618af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:15.988548 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7ab84-00c2-4cb6-aae4-6ca8808618af admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:15.997712 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 984/1949] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:16.001890 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffc2e8-66c3-47b2-a7bd-75b754d6bfce admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:16.013982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffc2e8-66c3-47b2-a7bd-75b754d6bfce admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:16.019483 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb70b2-3611-47ed-9a52-485c2deecca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:16.029163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb70b2-3611-47ed-9a52-485c2deecca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:16.029163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb70b2-3611-47ed-9a52-485c2deecca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:16.029163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb70b2-3611-47ed-9a52-485c2deecca0 admin admin] PATH_INFO: `/v3/projects/4e5059535b3147e7933fa683f7d14bed/users/18a50399114d4b84ba2d13dfb154169b/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:16.029163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb70b2-3611-47ed-9a52-485c2deecca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5059535b3147e7933fa683f7d14bed, user_id=18a50399114d4b84ba2d13dfb154169b, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:16.029163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb70b2-3611-47ed-9a52-485c2deecca0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:16.036839 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 966/1950] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:16 2022] PUT /identity/v3/projects/4e5059535b3147e7933fa683f7d14bed/users/18a50399114d4b84ba2d13dfb154169b/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:16.048214 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929866-f8a2-4585-ae10-eb990a8af7d5 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:16.048625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929866-f8a2-4585-ae10-eb990a8af7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:16.049164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929866-f8a2-4585-ae10-eb990a8af7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:16.064882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb70b2-3611-47ed-9a52-485c2deecca0 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:16.066812 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-89eb70b2-3611-47ed-9a52-485c2deecca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:16.085711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-16929866-f8a2-4585-ae10-eb990a8af7d5 None None] MFA Rules not processed for user `18a50399114d4b84ba2d13dfb154169b`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:16.086876 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-16929866-f8a2-4585-ae10-eb990a8af7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:16.142202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb70b2-3611-47ed-9a52-485c2deecca0 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:16.146865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9460111-7917-4c6e-be80-f685c776a786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:16.147736 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9460111-7917-4c6e-be80-f685c776a786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:16.148020 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9460111-7917-4c6e-be80-f685c776a786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:16.148303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9460111-7917-4c6e-be80-f685c776a786 admin admin] PATH_INFO: `/v3/users/3c8105dc50a247afb9e20439372eed1e` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:16.149559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9460111-7917-4c6e-be80-f685c776a786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8105dc50a247afb9e20439372eed1e)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:16.151486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9460111-7917-4c6e-be80-f685c776a786 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:16.160994 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 985/1951] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:16 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:16.160994 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16929866-f8a2-4585-ae10-eb990a8af7d5 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:16.160994 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-16929866-f8a2-4585-ae10-eb990a8af7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:16.222189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16929866-f8a2-4585-ae10-eb990a8af7d5 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:16.226699 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a2d4b-1ef8-4f0a-b492-750bb4f72bfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:16.228178 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a2d4b-1ef8-4f0a-b492-750bb4f72bfa service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:16.228178 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a2d4b-1ef8-4f0a-b492-750bb4f72bfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:16.228178 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a2d4b-1ef8-4f0a-b492-750bb4f72bfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:16.229740 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ab8a2d4b-1ef8-4f0a-b492-750bb4f72bfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:16.291929 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a2d4b-1ef8-4f0a-b492-750bb4f72bfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:16.293530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a2d4b-1ef8-4f0a-b492-750bb4f72bfa service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:16.303215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 986/1952] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:16.342259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a2d4b-1ef8-4f0a-b492-750bb4f72bfa service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:16.350619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a2d4b-1ef8-4f0a-b492-750bb4f72bfa service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:16.354508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac543e-604e-47f0-8158-4c91050e6732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:16.355865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac543e-604e-47f0-8158-4c91050e6732 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:16.356169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac543e-604e-47f0-8158-4c91050e6732 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:16.356450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac543e-604e-47f0-8158-4c91050e6732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:16.365650 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac543e-604e-47f0-8158-4c91050e6732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:16.367075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac543e-604e-47f0-8158-4c91050e6732 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:16.377748 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 987/1953] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:16 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:47:16.394465 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e9460111-7917-4c6e-be80-f685c776a786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8105dc50a247afb9e20439372eed1e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:16.403897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:16.502035 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e9460111-7917-4c6e-be80-f685c776a786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8105dc50a247afb9e20439372eed1e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:16.509578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e9460111-7917-4c6e-be80-f685c776a786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8105dc50a247afb9e20439372eed1e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:16.513623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e9460111-7917-4c6e-be80-f685c776a786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8105dc50a247afb9e20439372eed1e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:16.522388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e9460111-7917-4c6e-be80-f685c776a786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8105dc50a247afb9e20439372eed1e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:16.528805 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 967/1954] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:16 2022] DELETE /identity/v3/users/3c8105dc50a247afb9e20439372eed1e => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:16.533521 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46687db7-edf9-49e2-8815-0246a2095b2c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:16.533815 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46687db7-edf9-49e2-8815-0246a2095b2c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:16.536541 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46687db7-edf9-49e2-8815-0246a2095b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:16.552339 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-46687db7-edf9-49e2-8815-0246a2095b2c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:16.553578 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-46687db7-edf9-49e2-8815-0246a2095b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:16.617903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 988/1955] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:16.628156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9460111-7917-4c6e-be80-f685c776a786 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:16.629591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e9460111-7917-4c6e-be80-f685c776a786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:16.690261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9460111-7917-4c6e-be80-f685c776a786 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:16.694127 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9272341-dace-42f9-b424-3dd0a8757b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:16.694788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9272341-dace-42f9-b424-3dd0a8757b98 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:16.695077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9272341-dace-42f9-b424-3dd0a8757b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:16.695457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9272341-dace-42f9-b424-3dd0a8757b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:16.705399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9272341-dace-42f9-b424-3dd0a8757b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:16.706855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9272341-dace-42f9-b424-3dd0a8757b98 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:16.717311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 968/1956] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:16.868094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:INSERT=4,keystone:SELECT=81,keystone:DELETE=15 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:16.908595 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46687db7-edf9-49e2-8815-0246a2095b2c None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:16.910019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-46687db7-edf9-49e2-8815-0246a2095b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:16.977635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46687db7-edf9-49e2-8815-0246a2095b2c None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:16.982531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3aecfd-cf3e-4909-ba1d-ba6db06131bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:16.983256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3aecfd-cf3e-4909-ba1d-ba6db06131bf service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:16.983544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3aecfd-cf3e-4909-ba1d-ba6db06131bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:16.983835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3aecfd-cf3e-4909-ba1d-ba6db06131bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:16.985683 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-db3aecfd-cf3e-4909-ba1d-ba6db06131bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:17.049375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3aecfd-cf3e-4909-ba1d-ba6db06131bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:17.051778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3aecfd-cf3e-4909-ba1d-ba6db06131bf service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:17.062374 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 989/1957] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:16 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:17.274197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:17.283015 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9272341-dace-42f9-b424-3dd0a8757b98 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:17.284463 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f9272341-dace-42f9-b424-3dd0a8757b98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:17.301888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9272341-dace-42f9-b424-3dd0a8757b98 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:17.307960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db70e9-26f7-4c02-97b8-8e7adc7931dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:17.309706 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db70e9-26f7-4c02-97b8-8e7adc7931dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:17.309995 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db70e9-26f7-4c02-97b8-8e7adc7931dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:17.310276 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db70e9-26f7-4c02-97b8-8e7adc7931dd admin admin] PATH_INFO: `/v3/projects/30822e8ec205455e9f24428166134267` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:17.311868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db70e9-26f7-4c02-97b8-8e7adc7931dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=30822e8ec205455e9f24428166134267)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:17.313866 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db70e9-26f7-4c02-97b8-8e7adc7931dd admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:17.481830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-69db70e9-26f7-4c02-97b8-8e7adc7931dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30822e8ec205455e9f24428166134267', 'request_id': 'req-69db70e9-26f7-4c02-97b8-8e7adc7931dd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:17.488155 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-69db70e9-26f7-4c02-97b8-8e7adc7931dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30822e8ec205455e9f24428166134267', 'request_id': 'req-69db70e9-26f7-4c02-97b8-8e7adc7931dd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:17.597215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-69db70e9-26f7-4c02-97b8-8e7adc7931dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30822e8ec205455e9f24428166134267', 'request_id': 'req-69db70e9-26f7-4c02-97b8-8e7adc7931dd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:17.609556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-69db70e9-26f7-4c02-97b8-8e7adc7931dd admin admin] The token cache is being invalidate because project 30822e8ec205455e9f24428166134267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:17.609848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-69db70e9-26f7-4c02-97b8-8e7adc7931dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:17.612730 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-69db70e9-26f7-4c02-97b8-8e7adc7931dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:17.612730 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 969/1958] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:17 2022] DELETE /identity/v3/projects/30822e8ec205455e9f24428166134267 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:17.616019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3aecfd-cf3e-4909-ba1d-ba6db06131bf service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:17.627626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3aecfd-cf3e-4909-ba1d-ba6db06131bf service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:17.688769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb68ba-bf30-4f3e-b9f6-7be57ae87a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:17.689708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb68ba-bf30-4f3e-b9f6-7be57ae87a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:17.689991 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb68ba-bf30-4f3e-b9f6-7be57ae87a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:17.690265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb68ba-bf30-4f3e-b9f6-7be57ae87a76 admin admin] PATH_INFO: `/v3/users/9d0d9330216748ba91cb714fd85cba5f` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:17.691545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb68ba-bf30-4f3e-b9f6-7be57ae87a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0d9330216748ba91cb714fd85cba5f)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:17.693459 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb68ba-bf30-4f3e-b9f6-7be57ae87a76 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:17.908606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:17.927763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-88bb68ba-bf30-4f3e-b9f6-7be57ae87a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0d9330216748ba91cb714fd85cba5f'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:17.973932 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db70e9-26f7-4c02-97b8-8e7adc7931dd admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:17.975467 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-69db70e9-26f7-4c02-97b8-8e7adc7931dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:18.033661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-88bb68ba-bf30-4f3e-b9f6-7be57ae87a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0d9330216748ba91cb714fd85cba5f'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:18.041121 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-88bb68ba-bf30-4f3e-b9f6-7be57ae87a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0d9330216748ba91cb714fd85cba5f'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:18.041763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-88bb68ba-bf30-4f3e-b9f6-7be57ae87a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0d9330216748ba91cb714fd85cba5f'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:18.048387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db70e9-26f7-4c02-97b8-8e7adc7931dd admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:18.054272 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-88bb68ba-bf30-4f3e-b9f6-7be57ae87a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0d9330216748ba91cb714fd85cba5f'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:18.054512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0b7ed-b17a-45fa-9cb7-505ce96b64a2 tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e26df2c2c954cb1b8191ce16b6b396b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f36893c95584e6d9fecf824d84302d1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:18.055185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b7ed-b17a-45fa-9cb7-505ce96b64a2 tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:18.055479 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b7ed-b17a-45fa-9cb7-505ce96b64a2 tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:18.055765 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b7ed-b17a-45fa-9cb7-505ce96b64a2 tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:18.056504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0b7ed-b17a-45fa-9cb7-505ce96b64a2 tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:47:18.056822 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0b7ed-b17a-45fa-9cb7-505ce96b64a2 tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:18.058507 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0b7ed-b17a-45fa-9cb7-505ce96b64a2 tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:18.061257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 990/1959] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:17 2022] DELETE /identity/v3/users/9d0d9330216748ba91cb714fd85cba5f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:18.076293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 970/1960] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:47:18.077562 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb68ba-bf30-4f3e-b9f6-7be57ae87a76 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:18.083917 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-88bb68ba-bf30-4f3e-b9f6-7be57ae87a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:18.178807 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb68ba-bf30-4f3e-b9f6-7be57ae87a76 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:18.184868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19317064-6e54-46ec-ba6c-fab37bd42afa tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e26df2c2c954cb1b8191ce16b6b396b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f36893c95584e6d9fecf824d84302d1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:18.185649 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19317064-6e54-46ec-ba6c-fab37bd42afa tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:18.186032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19317064-6e54-46ec-ba6c-fab37bd42afa tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:18.186633 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19317064-6e54-46ec-ba6c-fab37bd42afa tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:18.187437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19317064-6e54-46ec-ba6c-fab37bd42afa tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:18.190316 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19317064-6e54-46ec-ba6c-fab37bd42afa tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:18.359347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 991/1961] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:18 2022] POST /identity/v3/projects => generated 355 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:18.360719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0b7ed-b17a-45fa-9cb7-505ce96b64a2 tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:18.373801 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0b7ed-b17a-45fa-9cb7-505ce96b64a2 tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:18.440114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:18.450875 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48e33f-cfa5-408d-b854-d16eb443106c tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e26df2c2c954cb1b8191ce16b6b396b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f36893c95584e6d9fecf824d84302d1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:18.451977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48e33f-cfa5-408d-b854-d16eb443106c tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:18.460849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48e33f-cfa5-408d-b854-d16eb443106c tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:18.461947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48e33f-cfa5-408d-b854-d16eb443106c tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:18.462769 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48e33f-cfa5-408d-b854-d16eb443106c tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:47:18.463735 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48e33f-cfa5-408d-b854-d16eb443106c tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:18.465739 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48e33f-cfa5-408d-b854-d16eb443106c tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:18.481381 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 971/1962] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:47:18.538671 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19317064-6e54-46ec-ba6c-fab37bd42afa tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:18.550405 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19317064-6e54-46ec-ba6c-fab37bd42afa tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:18.555594 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e26df2c2c954cb1b8191ce16b6b396b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f36893c95584e6d9fecf824d84302d1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:18.560721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:18.560721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:18.560721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] PATH_INFO: `/v3/projects/fafc9510551c4306873836441943a642` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:18.560721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fafc9510551c4306873836441943a642)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:18.561086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:18.679583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48e33f-cfa5-408d-b854-d16eb443106c tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:18.679583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-df48e33f-cfa5-408d-b854-d16eb443106c tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:18.706630 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fafc9510551c4306873836441943a642', 'request_id': 'req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:18.717226 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fafc9510551c4306873836441943a642', 'request_id': 'req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:18.758066 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48e33f-cfa5-408d-b854-d16eb443106c tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:18.820886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:18.822163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:18.822528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:18.822890 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2 admin admin] PATH_INFO: `/v3/projects/e86793aff08741afa84d53de82fb2c09` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:18.825887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86793aff08741afa84d53de82fb2c09)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:18.828371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:18.862093 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fafc9510551c4306873836441943a642', 'request_id': 'req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:18.875859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] The token cache is being invalidate because project fafc9510551c4306873836441943a642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:18.876147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:18.876792 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:18.878444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 992/1963] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:18 2022] DELETE /identity/v3/projects/fafc9510551c4306873836441943a642 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:18.961904 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86793aff08741afa84d53de82fb2c09', 'request_id': 'req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:18.966663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:18.971962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86793aff08741afa84d53de82fb2c09', 'request_id': 'req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:19.033524 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86793aff08741afa84d53de82fb2c09', 'request_id': 'req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:19.045854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2 admin admin] The token cache is being invalidate because project e86793aff08741afa84d53de82fb2c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:19.046174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:19.046951 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:19.048759 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 972/1964] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:18 2022] DELETE /identity/v3/projects/e86793aff08741afa84d53de82fb2c09 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:19.053053 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:19.054481 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:19.078237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5a3d3-bd73-4a2f-9f19-2e83fae74f3a tempest-VolumeQuotaClassesTest-726392787 tempest-VolumeQuotaClassesTest-726392787-project-admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:19.135011 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a876f79-45b0-4918-acf6-8d152c98990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:19.135900 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a876f79-45b0-4918-acf6-8d152c98990b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:19.136238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a876f79-45b0-4918-acf6-8d152c98990b admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:19.136574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a876f79-45b0-4918-acf6-8d152c98990b admin admin] PATH_INFO: `/v3/users/602b96167a074c86ae678772505d6aba` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:19.137826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a876f79-45b0-4918-acf6-8d152c98990b admin admin] RBAC: Authorizing `identity:delete_user(user_id=602b96167a074c86ae678772505d6aba)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:19.139833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a876f79-45b0-4918-acf6-8d152c98990b admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:19.407700 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0a876f79-45b0-4918-acf6-8d152c98990b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602b96167a074c86ae678772505d6aba'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:19.478444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0a876f79-45b0-4918-acf6-8d152c98990b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602b96167a074c86ae678772505d6aba'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:19.487586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0a876f79-45b0-4918-acf6-8d152c98990b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602b96167a074c86ae678772505d6aba'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:19.488478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0a876f79-45b0-4918-acf6-8d152c98990b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602b96167a074c86ae678772505d6aba'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:19.505107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0a876f79-45b0-4918-acf6-8d152c98990b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602b96167a074c86ae678772505d6aba'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:19.513947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 993/1965] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:19 2022] DELETE /identity/v3/users/602b96167a074c86ae678772505d6aba => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:19.623255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:19.624136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:19.625591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:19.638156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f81e2-db86-43e0-95d5-d37f8f82efe2 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:19.696531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a802a-e548-4e56-b3d6-d08897ec6f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:19.697455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a802a-e548-4e56-b3d6-d08897ec6f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:19.697744 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a802a-e548-4e56-b3d6-d08897ec6f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:19.698024 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a802a-e548-4e56-b3d6-d08897ec6f74 admin admin] PATH_INFO: `/v3/users/9009211fb2fe406db53631409e5ccedf` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:19.699851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a802a-e548-4e56-b3d6-d08897ec6f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9009211fb2fe406db53631409e5ccedf)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:19.701936 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a802a-e548-4e56-b3d6-d08897ec6f74 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:19.822119 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:19.970825 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a876f79-45b0-4918-acf6-8d152c98990b admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:19.972408 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0a876f79-45b0-4918-acf6-8d152c98990b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:19.987584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a876f79-45b0-4918-acf6-8d152c98990b admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:19.992585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d91c6-2126-48e1-ab13-4f9c4e491f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:19.993621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d91c6-2126-48e1-ab13-4f9c4e491f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:19.993981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d91c6-2126-48e1-ab13-4f9c4e491f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:19.994334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d91c6-2126-48e1-ab13-4f9c4e491f16 admin admin] PATH_INFO: `/v3/projects/81b2994b410e4e57829bcf37a98b0a06` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:19.996170 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d91c6-2126-48e1-ab13-4f9c4e491f16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81b2994b410e4e57829bcf37a98b0a06)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:19.998287 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d91c6-2126-48e1-ab13-4f9c4e491f16 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:20.008549 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ea1a802a-e548-4e56-b3d6-d08897ec6f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9009211fb2fe406db53631409e5ccedf'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:20.130987 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ea1a802a-e548-4e56-b3d6-d08897ec6f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9009211fb2fe406db53631409e5ccedf'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:20.139206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ea1a802a-e548-4e56-b3d6-d08897ec6f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9009211fb2fe406db53631409e5ccedf'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:20.140761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ea1a802a-e548-4e56-b3d6-d08897ec6f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9009211fb2fe406db53631409e5ccedf'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:20.150348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8b0d91c6-2126-48e1-ab13-4f9c4e491f16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81b2994b410e4e57829bcf37a98b0a06', 'request_id': 'req-8b0d91c6-2126-48e1-ab13-4f9c4e491f16'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:20.151933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ea1a802a-e548-4e56-b3d6-d08897ec6f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9009211fb2fe406db53631409e5ccedf'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:20.157122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8b0d91c6-2126-48e1-ab13-4f9c4e491f16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81b2994b410e4e57829bcf37a98b0a06', 'request_id': 'req-8b0d91c6-2126-48e1-ab13-4f9c4e491f16'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:20.157807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 973/1966] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:19 2022] DELETE /identity/v3/users/9009211fb2fe406db53631409e5ccedf => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:20.162092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372fae-0ae7-4ffd-978a-ad0c68c9e2e4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:20.162381 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372fae-0ae7-4ffd-978a-ad0c68c9e2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:20.162694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68372fae-0ae7-4ffd-978a-ad0c68c9e2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:20.181079 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-68372fae-0ae7-4ffd-978a-ad0c68c9e2e4 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:20.182265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-68372fae-0ae7-4ffd-978a-ad0c68c9e2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:20.239432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 974/1967] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:47:20.249696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68372fae-0ae7-4ffd-978a-ad0c68c9e2e4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:20.251024 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-68372fae-0ae7-4ffd-978a-ad0c68c9e2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:20.305360 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68372fae-0ae7-4ffd-978a-ad0c68c9e2e4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:20.309724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fd1d2-d21b-4fb3-969c-7baacd2e37a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:20.310370 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fd1d2-d21b-4fb3-969c-7baacd2e37a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:20.310661 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fd1d2-d21b-4fb3-969c-7baacd2e37a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:20.310935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fd1d2-d21b-4fb3-969c-7baacd2e37a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:20.319811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fd1d2-d21b-4fb3-969c-7baacd2e37a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:20.321271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fd1d2-d21b-4fb3-969c-7baacd2e37a5 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:20.331025 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 975/1968] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:47:20.608783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8b0d91c6-2126-48e1-ab13-4f9c4e491f16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81b2994b410e4e57829bcf37a98b0a06', 'request_id': 'req-8b0d91c6-2126-48e1-ab13-4f9c4e491f16'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:20.621135 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8b0d91c6-2126-48e1-ab13-4f9c4e491f16 admin admin] The token cache is being invalidate because project 81b2994b410e4e57829bcf37a98b0a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:20.621431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8b0d91c6-2126-48e1-ab13-4f9c4e491f16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:20.622109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8b0d91c6-2126-48e1-ab13-4f9c4e491f16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:20.623790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 994/1969] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:19 2022] DELETE /identity/v3/projects/81b2994b410e4e57829bcf37a98b0a06 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:20.629700 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368fffc-13cc-46a6-937f-6917ce960a27 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:20.630049 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368fffc-13cc-46a6-937f-6917ce960a27 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:20.630332 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368fffc-13cc-46a6-937f-6917ce960a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:20.649610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-9368fffc-13cc-46a6-937f-6917ce960a27 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:20.651411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9368fffc-13cc-46a6-937f-6917ce960a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:20.661796 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 976/1970] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:20.675154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf929a7-d6a1-41b5-91e6-27e0a5ab3dcc None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:20.675579 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf929a7-d6a1-41b5-91e6-27e0a5ab3dcc None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:20.675928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf929a7-d6a1-41b5-91e6-27e0a5ab3dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:20.698967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-ccf929a7-d6a1-41b5-91e6-27e0a5ab3dcc None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:20.700350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ccf929a7-d6a1-41b5-91e6-27e0a5ab3dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:20.708484 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 995/1971] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:20.712803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368fffc-13cc-46a6-937f-6917ce960a27 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:20.723931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368fffc-13cc-46a6-937f-6917ce960a27 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:20.734213 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca549b-77a7-4071-91b6-07f99250de18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:20.734905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca549b-77a7-4071-91b6-07f99250de18 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:20.735193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca549b-77a7-4071-91b6-07f99250de18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:20.735514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca549b-77a7-4071-91b6-07f99250de18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:20.736449 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca549b-77a7-4071-91b6-07f99250de18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:47:20.736748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca549b-77a7-4071-91b6-07f99250de18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:20.738427 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca549b-77a7-4071-91b6-07f99250de18 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:20.751091 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 977/1972] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:47:20.755419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf929a7-d6a1-41b5-91e6-27e0a5ab3dcc None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:20.766350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf929a7-d6a1-41b5-91e6-27e0a5ab3dcc None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:20.771118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b427f-a49d-4220-9458-3a6d911c4844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:20.771777 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b427f-a49d-4220-9458-3a6d911c4844 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:20.772062 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b427f-a49d-4220-9458-3a6d911c4844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:20.772334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b427f-a49d-4220-9458-3a6d911c4844 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:20.773070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b427f-a49d-4220-9458-3a6d911c4844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:20.774990 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b427f-a49d-4220-9458-3a6d911c4844 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:20.864332 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 996/1973] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:20 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:20.864597 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca549b-77a7-4071-91b6-07f99250de18 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:20.867284 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-deca549b-77a7-4071-91b6-07f99250de18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:20.868219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b427f-a49d-4220-9458-3a6d911c4844 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:20.883685 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca549b-77a7-4071-91b6-07f99250de18 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:20.934547 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b427f-a49d-4220-9458-3a6d911c4844 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:20.939554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf1250-f60c-42be-9b6e-2e5ce4cc0015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:20.940240 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf1250-f60c-42be-9b6e-2e5ce4cc0015 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:20.940530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf1250-f60c-42be-9b6e-2e5ce4cc0015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:20.940837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf1250-f60c-42be-9b6e-2e5ce4cc0015 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:20.941552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf1250-f60c-42be-9b6e-2e5ce4cc0015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:20.943478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf1250-f60c-42be-9b6e-2e5ce4cc0015 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:20.949508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a1671-f7b8-4cb2-8857-2d8742bed363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:20.950669 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a1671-f7b8-4cb2-8857-2d8742bed363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:20.951069 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a1671-f7b8-4cb2-8857-2d8742bed363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:20.951424 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a1671-f7b8-4cb2-8857-2d8742bed363 admin admin] PATH_INFO: `/v3/projects/dbdb83196a124ceab8b3813eb6d0c52d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:20.953889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a1671-f7b8-4cb2-8857-2d8742bed363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbdb83196a124ceab8b3813eb6d0c52d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:20.956862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a1671-f7b8-4cb2-8857-2d8742bed363 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:21.125122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 997/1974] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:20 2022] POST /identity/v3/users => generated 295 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:21.129029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf1250-f60c-42be-9b6e-2e5ce4cc0015 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:21.138289 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f20a1671-f7b8-4cb2-8857-2d8742bed363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbdb83196a124ceab8b3813eb6d0c52d', 'request_id': 'req-f20a1671-f7b8-4cb2-8857-2d8742bed363'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:21.139351 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf1250-f60c-42be-9b6e-2e5ce4cc0015 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:21.145140 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f20a1671-f7b8-4cb2-8857-2d8742bed363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbdb83196a124ceab8b3813eb6d0c52d', 'request_id': 'req-f20a1671-f7b8-4cb2-8857-2d8742bed363'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:21.197527 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b206a-f148-40a1-963f-88cac6001228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:21.198201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b206a-f148-40a1-963f-88cac6001228 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:21.198488 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b206a-f148-40a1-963f-88cac6001228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:21.198811 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b206a-f148-40a1-963f-88cac6001228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:21.199552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b206a-f148-40a1-963f-88cac6001228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:21.201162 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b206a-f148-40a1-963f-88cac6001228 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:21.210943 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 998/1975] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:47:21.217186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b206a-f148-40a1-963f-88cac6001228 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:21.226733 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b206a-f148-40a1-963f-88cac6001228 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:21.232010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa09eed-e32c-410e-9127-6e4482118866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:21.232726 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa09eed-e32c-410e-9127-6e4482118866 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:21.232990 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa09eed-e32c-410e-9127-6e4482118866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:21.233843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa09eed-e32c-410e-9127-6e4482118866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:21.234608 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa09eed-e32c-410e-9127-6e4482118866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:21.234826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f20a1671-f7b8-4cb2-8857-2d8742bed363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbdb83196a124ceab8b3813eb6d0c52d', 'request_id': 'req-f20a1671-f7b8-4cb2-8857-2d8742bed363'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:21.236356 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa09eed-e32c-410e-9127-6e4482118866 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:21.246118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f20a1671-f7b8-4cb2-8857-2d8742bed363 admin admin] The token cache is being invalidate because project dbdb83196a124ceab8b3813eb6d0c52d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:21.246393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f20a1671-f7b8-4cb2-8857-2d8742bed363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:21.246935 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 999/1976] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:47:21.247196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f20a1671-f7b8-4cb2-8857-2d8742bed363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:21.249047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 978/1977] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:20 2022] DELETE /identity/v3/projects/dbdb83196a124ceab8b3813eb6d0c52d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:21.251138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa09eed-e32c-410e-9127-6e4482118866 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:21.252775 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a1671-f7b8-4cb2-8857-2d8742bed363 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:21.253127 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3fa09eed-e32c-410e-9127-6e4482118866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:21.254190 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f20a1671-f7b8-4cb2-8857-2d8742bed363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:21.265844 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa09eed-e32c-410e-9127-6e4482118866 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:21.272890 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a1671-f7b8-4cb2-8857-2d8742bed363 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:21.273021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034d140-22cc-455a-b5e9-6d739dd27e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:21.273021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034d140-22cc-455a-b5e9-6d739dd27e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:21.273205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72bc9c-9759-4545-8803-509fbcc84619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:21.273298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034d140-22cc-455a-b5e9-6d739dd27e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:21.273298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034d140-22cc-455a-b5e9-6d739dd27e66 admin admin] PATH_INFO: `/v3/projects/09e8e85ed38e4d48b9409c40ebf917ea/users/23445e1ed54348bd9a68add870f5fee5/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:21.273650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72bc9c-9759-4545-8803-509fbcc84619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:21.273952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72bc9c-9759-4545-8803-509fbcc84619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:21.274231 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72bc9c-9759-4545-8803-509fbcc84619 admin admin] PATH_INFO: `/v3/users/6e26df2c2c954cb1b8191ce16b6b396b` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:21.275453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72bc9c-9759-4545-8803-509fbcc84619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e26df2c2c954cb1b8191ce16b6b396b)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:21.278030 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72bc9c-9759-4545-8803-509fbcc84619 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:21.288385 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034d140-22cc-455a-b5e9-6d739dd27e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e8e85ed38e4d48b9409c40ebf917ea, user_id=23445e1ed54348bd9a68add870f5fee5, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:21.291461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034d140-22cc-455a-b5e9-6d739dd27e66 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:21.319181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:21.380421 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1000/1978] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:21 2022] PUT /identity/v3/projects/09e8e85ed38e4d48b9409c40ebf917ea/users/23445e1ed54348bd9a68add870f5fee5/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:21.392524 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b502b97-c6d0-4e06-9f0a-959c0bfa46e7 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:21.392814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b502b97-c6d0-4e06-9f0a-959c0bfa46e7 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:21.393127 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b502b97-c6d0-4e06-9f0a-959c0bfa46e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:21.421237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-4b502b97-c6d0-4e06-9f0a-959c0bfa46e7 None None] MFA Rules not processed for user `23445e1ed54348bd9a68add870f5fee5`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:21.422446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4b502b97-c6d0-4e06-9f0a-959c0bfa46e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:21.454932 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:21.489974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1001/1979] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:47:21.496173 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b502b97-c6d0-4e06-9f0a-959c0bfa46e7 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:21.497912 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ec72bc9c-9759-4545-8803-509fbcc84619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e26df2c2c954cb1b8191ce16b6b396b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:21.562016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b502b97-c6d0-4e06-9f0a-959c0bfa46e7 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:21.566893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3ac96-d86d-4538-92af-19724f3196c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:21.567569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3ac96-d86d-4538-92af-19724f3196c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:21.567858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3ac96-d86d-4538-92af-19724f3196c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:21.568146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3ac96-d86d-4538-92af-19724f3196c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:21.568836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3ac96-d86d-4538-92af-19724f3196c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:21.570773 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3ac96-d86d-4538-92af-19724f3196c4 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:21.580053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ec72bc9c-9759-4545-8803-509fbcc84619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e26df2c2c954cb1b8191ce16b6b396b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:21.587477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ec72bc9c-9759-4545-8803-509fbcc84619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e26df2c2c954cb1b8191ce16b6b396b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:21.588119 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ec72bc9c-9759-4545-8803-509fbcc84619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e26df2c2c954cb1b8191ce16b6b396b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:21.601908 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ec72bc9c-9759-4545-8803-509fbcc84619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e26df2c2c954cb1b8191ce16b6b396b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:21.609173 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 979/1980] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:21 2022] DELETE /identity/v3/users/6e26df2c2c954cb1b8191ce16b6b396b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:21.662364 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1002/1981] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:21 2022] POST /identity/v3/projects => generated 393 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:47:21.663670 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72bc9c-9759-4545-8803-509fbcc84619 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:21.665152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ec72bc9c-9759-4545-8803-509fbcc84619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:21.738500 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72bc9c-9759-4545-8803-509fbcc84619 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:21.805436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348244a9-a3d6-449f-bd79-2f981550daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:21.806278 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348244a9-a3d6-449f-bd79-2f981550daf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:21.806637 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348244a9-a3d6-449f-bd79-2f981550daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:21.806984 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348244a9-a3d6-449f-bd79-2f981550daf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:21.807760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348244a9-a3d6-449f-bd79-2f981550daf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:21.810058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348244a9-a3d6-449f-bd79-2f981550daf6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:21.914283 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 980/1982] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:21 2022] POST /identity/v3/users => generated 303 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:21.918961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3ac96-d86d-4538-92af-19724f3196c4 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:21.929455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3ac96-d86d-4538-92af-19724f3196c4 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:21.934763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f3d26-2231-4350-baaa-f292ca64b817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:21.935577 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f3d26-2231-4350-baaa-f292ca64b817 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:21.935871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f3d26-2231-4350-baaa-f292ca64b817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:21.936275 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f3d26-2231-4350-baaa-f292ca64b817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:21.937428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f3d26-2231-4350-baaa-f292ca64b817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:21.939973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f3d26-2231-4350-baaa-f292ca64b817 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:21.949667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:21.955457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1003/1983] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:21.959811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348244a9-a3d6-449f-bd79-2f981550daf6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:21.970453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348244a9-a3d6-449f-bd79-2f981550daf6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:21.975201 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4752763-9dcd-4c57-8c80-00a71935522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:21.977872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4752763-9dcd-4c57-8c80-00a71935522b admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:21.977872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4752763-9dcd-4c57-8c80-00a71935522b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:21.977872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4752763-9dcd-4c57-8c80-00a71935522b admin admin] PATH_INFO: `/v3/projects/41e9383e8391491ebbb58c8c6eda956a/users/506e4aa2311b4f2e9c82aeb8a1656842/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:21.994353 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4752763-9dcd-4c57-8c80-00a71935522b admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e9383e8391491ebbb58c8c6eda956a, user_id=506e4aa2311b4f2e9c82aeb8a1656842, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:21.997775 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4752763-9dcd-4c57-8c80-00a71935522b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:22.076088 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f3d26-2231-4350-baaa-f292ca64b817 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:22.077846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-c75f3d26-2231-4350-baaa-f292ca64b817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:22.107648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f3d26-2231-4350-baaa-f292ca64b817 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:22.107648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2a586-4ae9-457c-b52b-ff52c010f526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:22.108527 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2a586-4ae9-457c-b52b-ff52c010f526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:22.108527 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2a586-4ae9-457c-b52b-ff52c010f526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:22.108702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2a586-4ae9-457c-b52b-ff52c010f526 admin admin] PATH_INFO: `/v3/projects/5f36893c95584e6d9fecf824d84302d1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:22.109963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2a586-4ae9-457c-b52b-ff52c010f526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f36893c95584e6d9fecf824d84302d1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:22.111975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2a586-4ae9-457c-b52b-ff52c010f526 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:22.144247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 981/1984] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:21 2022] PUT /identity/v3/projects/41e9383e8391491ebbb58c8c6eda956a/users/506e4aa2311b4f2e9c82aeb8a1656842/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:22.148107 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4752763-9dcd-4c57-8c80-00a71935522b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:22.211606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4752763-9dcd-4c57-8c80-00a71935522b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:22.220751 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21fb60-38b4-4c3d-a055-fe11ce791160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:22.220751 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21fb60-38b4-4c3d-a055-fe11ce791160 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:22.220751 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21fb60-38b4-4c3d-a055-fe11ce791160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:22.220751 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21fb60-38b4-4c3d-a055-fe11ce791160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:22.221048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21fb60-38b4-4c3d-a055-fe11ce791160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:22.221048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21fb60-38b4-4c3d-a055-fe11ce791160 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:22.231185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 982/1985] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:47:22.236168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21fb60-38b4-4c3d-a055-fe11ce791160 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:22.245976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21fb60-38b4-4c3d-a055-fe11ce791160 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:22.250992 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f40b3-64cb-47f9-b03a-84564e78053e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:22.251825 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f40b3-64cb-47f9-b03a-84564e78053e admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:22.252112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f40b3-64cb-47f9-b03a-84564e78053e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:22.252393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f40b3-64cb-47f9-b03a-84564e78053e admin admin] PATH_INFO: `/v3/projects/41e9383e8391491ebbb58c8c6eda956a/users/506e4aa2311b4f2e9c82aeb8a1656842/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:22.254425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f40b3-64cb-47f9-b03a-84564e78053e admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e9383e8391491ebbb58c8c6eda956a, user_id=506e4aa2311b4f2e9c82aeb8a1656842, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:22.257105 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f40b3-64cb-47f9-b03a-84564e78053e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:22.268175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 983/1986] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:22 2022] PUT /identity/v3/projects/41e9383e8391491ebbb58c8c6eda956a/users/506e4aa2311b4f2e9c82aeb8a1656842/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:22.281313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4115d-5569-48e5-9471-9f46d2771710 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:22.281727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4115d-5569-48e5-9471-9f46d2771710 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:22.282205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4115d-5569-48e5-9471-9f46d2771710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:22.293885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c5b2a586-4ae9-457c-b52b-ff52c010f526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f36893c95584e6d9fecf824d84302d1', 'request_id': 'req-c5b2a586-4ae9-457c-b52b-ff52c010f526'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:22.300830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c5b2a586-4ae9-457c-b52b-ff52c010f526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f36893c95584e6d9fecf824d84302d1', 'request_id': 'req-c5b2a586-4ae9-457c-b52b-ff52c010f526'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:22.311008 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0fb4115d-5569-48e5-9471-9f46d2771710 None None] MFA Rules not processed for user `506e4aa2311b4f2e9c82aeb8a1656842`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:22.312221 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0fb4115d-5569-48e5-9471-9f46d2771710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:22.323156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:22.381911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c5b2a586-4ae9-457c-b52b-ff52c010f526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f36893c95584e6d9fecf824d84302d1', 'request_id': 'req-c5b2a586-4ae9-457c-b52b-ff52c010f526'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:22.387519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 984/1987] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:47:22.393997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c5b2a586-4ae9-457c-b52b-ff52c010f526 admin admin] The token cache is being invalidate because project 5f36893c95584e6d9fecf824d84302d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:22.394274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c5b2a586-4ae9-457c-b52b-ff52c010f526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:22.394971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c5b2a586-4ae9-457c-b52b-ff52c010f526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:22.396605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1004/1988] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:22 2022] DELETE /identity/v3/projects/5f36893c95584e6d9fecf824d84302d1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:22.399361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4115d-5569-48e5-9471-9f46d2771710 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:22.401019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f4ec6-c172-4ec7-9fbb-437f52623c66 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:22.401139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0fb4115d-5569-48e5-9471-9f46d2771710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:22.401311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f4ec6-c172-4ec7-9fbb-437f52623c66 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:22.401594 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f4ec6-c172-4ec7-9fbb-437f52623c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:22.420251 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-a25f4ec6-c172-4ec7-9fbb-437f52623c66 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:22.421586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a25f4ec6-c172-4ec7-9fbb-437f52623c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:22.459021 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4115d-5569-48e5-9471-9f46d2771710 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:22.464101 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654cf21-7aba-41a1-8243-403e4a5a69db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:22.465035 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654cf21-7aba-41a1-8243-403e4a5a69db service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:22.465282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654cf21-7aba-41a1-8243-403e4a5a69db service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:22.465575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654cf21-7aba-41a1-8243-403e4a5a69db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:22.467459 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7654cf21-7aba-41a1-8243-403e4a5a69db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:22.480744 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654cf21-7aba-41a1-8243-403e4a5a69db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:22.482241 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654cf21-7aba-41a1-8243-403e4a5a69db service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:22.491515 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1005/1989] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:22.493305 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 985/1990] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:22.500077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f858c-ecfd-4849-901a-e0d4851f8126 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:22.500442 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f858c-ecfd-4849-901a-e0d4851f8126 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:22.500639 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f858c-ecfd-4849-901a-e0d4851f8126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:22.519494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-fd3f858c-ecfd-4849-901a-e0d4851f8126 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:22.521304 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-fd3f858c-ecfd-4849-901a-e0d4851f8126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:22.534944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1006/1991] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:22.539113 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654cf21-7aba-41a1-8243-403e4a5a69db service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:22.545106 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f858c-ecfd-4849-901a-e0d4851f8126 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:22.547070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-fd3f858c-ecfd-4849-901a-e0d4851f8126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:22.550788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654cf21-7aba-41a1-8243-403e4a5a69db service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:22.555443 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370e570-d98c-4e74-a565-2b07d3edfdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:22.556104 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e570-d98c-4e74-a565-2b07d3edfdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:22.556394 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e570-d98c-4e74-a565-2b07d3edfdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:22.556717 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e570-d98c-4e74-a565-2b07d3edfdb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:22.557696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370e570-d98c-4e74-a565-2b07d3edfdb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:47:22.558170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370e570-d98c-4e74-a565-2b07d3edfdb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:22.560092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370e570-d98c-4e74-a565-2b07d3edfdb4 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:22.560730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f858c-ecfd-4849-901a-e0d4851f8126 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:22.567808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d0035-425b-4925-a1ce-0acd4ab71c05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:22.570620 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d0035-425b-4925-a1ce-0acd4ab71c05 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:22.570620 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d0035-425b-4925-a1ce-0acd4ab71c05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:22.570620 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d0035-425b-4925-a1ce-0acd4ab71c05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:22.570996 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-489d0035-425b-4925-a1ce-0acd4ab71c05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:22.577546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 986/1992] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:47:22.578852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370e570-d98c-4e74-a565-2b07d3edfdb4 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:22.589018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370e570-d98c-4e74-a565-2b07d3edfdb4 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:22.596913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b636f1-9951-4667-a9e4-dbc9547caa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:22.599252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b636f1-9951-4667-a9e4-dbc9547caa44 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:22.599252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b636f1-9951-4667-a9e4-dbc9547caa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:22.599252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b636f1-9951-4667-a9e4-dbc9547caa44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:22.599252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b636f1-9951-4667-a9e4-dbc9547caa44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:22.600722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b636f1-9951-4667-a9e4-dbc9547caa44 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:22.621197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:22.643096 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d0035-425b-4925-a1ce-0acd4ab71c05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:22.645325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d0035-425b-4925-a1ce-0acd4ab71c05 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:22.656607 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1007/1993] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:47:22.683657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 987/1994] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:22 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:47:22.688294 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d0035-425b-4925-a1ce-0acd4ab71c05 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:22.700043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d0035-425b-4925-a1ce-0acd4ab71c05 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:22.761759 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dc953-7275-4dd0-888d-f1eefd782d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:22.762090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dc953-7275-4dd0-888d-f1eefd782d91 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:22.762384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dc953-7275-4dd0-888d-f1eefd782d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:22.762668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dc953-7275-4dd0-888d-f1eefd782d91 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:22.763381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dc953-7275-4dd0-888d-f1eefd782d91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:22.765348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dc953-7275-4dd0-888d-f1eefd782d91 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:22.780766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:22.834103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1008/1995] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:22 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:22.838065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b636f1-9951-4667-a9e4-dbc9547caa44 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:22.850689 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:22.852543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b636f1-9951-4667-a9e4-dbc9547caa44 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:22.860421 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051d56a-fdb8-4192-a4ad-80aba61e4077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:22.861143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051d56a-fdb8-4192-a4ad-80aba61e4077 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:22.861426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051d56a-fdb8-4192-a4ad-80aba61e4077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:22.861704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051d56a-fdb8-4192-a4ad-80aba61e4077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:22.862437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051d56a-fdb8-4192-a4ad-80aba61e4077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:22.864169 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051d56a-fdb8-4192-a4ad-80aba61e4077 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:22.878414 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 988/1996] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:47:22.881792 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dc953-7275-4dd0-888d-f1eefd782d91 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:22.892699 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dc953-7275-4dd0-888d-f1eefd782d91 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:22.900564 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd17efb-774e-44aa-9d88-53673fae943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:22.901321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd17efb-774e-44aa-9d88-53673fae943a admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:22.901609 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd17efb-774e-44aa-9d88-53673fae943a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:22.902450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd17efb-774e-44aa-9d88-53673fae943a admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:22.903194 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd17efb-774e-44aa-9d88-53673fae943a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:22.904826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd17efb-774e-44aa-9d88-53673fae943a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:22.921752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1009/1997] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:47:22.927966 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051d56a-fdb8-4192-a4ad-80aba61e4077 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:22.936913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051d56a-fdb8-4192-a4ad-80aba61e4077 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:22.942604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef50b7-eb02-45ac-b27c-34b356a2bf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:22.943505 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef50b7-eb02-45ac-b27c-34b356a2bf84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:22.943788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef50b7-eb02-45ac-b27c-34b356a2bf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:22.944238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef50b7-eb02-45ac-b27c-34b356a2bf84 admin admin] PATH_INFO: `/v3/projects/0b198579e5474f7a9576da437b98f6c7/users/2f3d39b0fa294e238cab405406986bc6/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:22.961036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef50b7-eb02-45ac-b27c-34b356a2bf84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b198579e5474f7a9576da437b98f6c7, user_id=2f3d39b0fa294e238cab405406986bc6, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:22.965255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef50b7-eb02-45ac-b27c-34b356a2bf84 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:22.976586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:23.089511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 989/1998] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:22 2022] PUT /identity/v3/projects/0b198579e5474f7a9576da437b98f6c7/users/2f3d39b0fa294e238cab405406986bc6/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:23.100887 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad59987-45b1-4650-b502-b8d5a08ae520 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:23.101311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad59987-45b1-4650-b502-b8d5a08ae520 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:23.101683 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad59987-45b1-4650-b502-b8d5a08ae520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:23.128737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-cad59987-45b1-4650-b502-b8d5a08ae520 None None] MFA Rules not processed for user `2f3d39b0fa294e238cab405406986bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:23.129993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-cad59987-45b1-4650-b502-b8d5a08ae520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:23.193569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1010/1999] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:23.198060 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef50b7-eb02-45ac-b27c-34b356a2bf84 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:23.259253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef50b7-eb02-45ac-b27c-34b356a2bf84 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:23.264482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d774f-29a1-47a1-8755-ae3270017e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:23.265176 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d774f-29a1-47a1-8755-ae3270017e7f admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:23.265469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d774f-29a1-47a1-8755-ae3270017e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:23.265753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d774f-29a1-47a1-8755-ae3270017e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:23.266456 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d774f-29a1-47a1-8755-ae3270017e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:23.268365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d774f-29a1-47a1-8755-ae3270017e7f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:23.546793 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:23.621038 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 990/2000] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:23 2022] POST /identity/v3/projects => generated 383 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:23.625253 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad59987-45b1-4650-b502-b8d5a08ae520 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:23.635947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad59987-45b1-4650-b502-b8d5a08ae520 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:23.706856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7c204-8162-4fb4-bde9-f3afa07c18e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:23.707631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7c204-8162-4fb4-bde9-f3afa07c18e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:23.708031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7c204-8162-4fb4-bde9-f3afa07c18e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:23.708588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7c204-8162-4fb4-bde9-f3afa07c18e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:23.709340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7c204-8162-4fb4-bde9-f3afa07c18e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:23.711604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7c204-8162-4fb4-bde9-f3afa07c18e3 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:23.812784 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1011/2001] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:23 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:23.816516 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d774f-29a1-47a1-8755-ae3270017e7f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:23.829317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d774f-29a1-47a1-8755-ae3270017e7f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:23.834107 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a93dba-79b6-44f9-957c-43a16cd641c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:23.834788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a93dba-79b6-44f9-957c-43a16cd641c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:23.835079 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a93dba-79b6-44f9-957c-43a16cd641c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:23.835361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a93dba-79b6-44f9-957c-43a16cd641c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:23.836105 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a93dba-79b6-44f9-957c-43a16cd641c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:23.837805 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a93dba-79b6-44f9-957c-43a16cd641c6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:23.843282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:23.854651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 991/2002] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:23.860020 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7c204-8162-4fb4-bde9-f3afa07c18e3 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:23.878547 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7c204-8162-4fb4-bde9-f3afa07c18e3 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:23.878547 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a3f2-3e03-47c3-bcba-f40567a99a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:23.878547 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a3f2-3e03-47c3-bcba-f40567a99a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:23.879728 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a3f2-3e03-47c3-bcba-f40567a99a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:23.880257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a3f2-3e03-47c3-bcba-f40567a99a5a admin admin] PATH_INFO: `/v3/projects/4dfe4e5e9389486989171e21663af165/users/dd9b4d3f9f354167a4f55275516f75c4/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:23.899164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7a3f2-3e03-47c3-bcba-f40567a99a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dfe4e5e9389486989171e21663af165, user_id=dd9b4d3f9f354167a4f55275516f75c4, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:23.902648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7a3f2-3e03-47c3-bcba-f40567a99a5a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:23.999997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1012/2003] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:23 2022] PUT /identity/v3/projects/4dfe4e5e9389486989171e21663af165/users/dd9b4d3f9f354167a4f55275516f75c4/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:24.006298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a93dba-79b6-44f9-957c-43a16cd641c6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:24.018011 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a93dba-79b6-44f9-957c-43a16cd641c6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:24.081259 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dbe5b-3719-47f1-b04d-1bde148dc792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:24.081954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dbe5b-3719-47f1-b04d-1bde148dc792 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:24.082243 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dbe5b-3719-47f1-b04d-1bde148dc792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:24.082528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dbe5b-3719-47f1-b04d-1bde148dc792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:24.083273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431dbe5b-3719-47f1-b04d-1bde148dc792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:24.085009 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431dbe5b-3719-47f1-b04d-1bde148dc792 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:24.098648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 992/2004] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:24.102761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a3f2-3e03-47c3-bcba-f40567a99a5a admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:24.114273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a3f2-3e03-47c3-bcba-f40567a99a5a admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:24.121333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28390727-46c3-48d9-9648-44a01219a2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:24.122441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28390727-46c3-48d9-9648-44a01219a2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:24.122744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28390727-46c3-48d9-9648-44a01219a2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:24.123023 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28390727-46c3-48d9-9648-44a01219a2c4 admin admin] PATH_INFO: `/v3/projects/4dfe4e5e9389486989171e21663af165/users/dd9b4d3f9f354167a4f55275516f75c4/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:24.125095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28390727-46c3-48d9-9648-44a01219a2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dfe4e5e9389486989171e21663af165, user_id=dd9b4d3f9f354167a4f55275516f75c4, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:24.128045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28390727-46c3-48d9-9648-44a01219a2c4 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:24.147039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1013/2005] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:24 2022] PUT /identity/v3/projects/4dfe4e5e9389486989171e21663af165/users/dd9b4d3f9f354167a4f55275516f75c4/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:24.152655 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb42e4a-39dc-4cbe-b4c9-f92fe90af38d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:24.160498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb42e4a-39dc-4cbe-b4c9-f92fe90af38d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:24.160498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb42e4a-39dc-4cbe-b4c9-f92fe90af38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:24.185473 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1cb42e4a-39dc-4cbe-b4c9-f92fe90af38d None None] MFA Rules not processed for user `dd9b4d3f9f354167a4f55275516f75c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:24.186660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1cb42e4a-39dc-4cbe-b4c9-f92fe90af38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:24.269900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 993/2006] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:24.281652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28390727-46c3-48d9-9648-44a01219a2c4 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:24.283337 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-28390727-46c3-48d9-9648-44a01219a2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:24.343056 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28390727-46c3-48d9-9648-44a01219a2c4 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:24.347322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1c09-b00f-4d91-9cdf-7b3ffc70be9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:24.352312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1c09-b00f-4d91-9cdf-7b3ffc70be9a service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:24.352312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1c09-b00f-4d91-9cdf-7b3ffc70be9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:24.352312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1c09-b00f-4d91-9cdf-7b3ffc70be9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:24.358352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1c09-b00f-4d91-9cdf-7b3ffc70be9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:24.359770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1c09-b00f-4d91-9cdf-7b3ffc70be9a service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:24.369178 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1014/2007] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:24.391469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:24.482745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb42e4a-39dc-4cbe-b4c9-f92fe90af38d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:24.494186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb42e4a-39dc-4cbe-b4c9-f92fe90af38d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:24.497903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e85f54-6ea9-4ebf-9a6a-d9b5291e2b2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:24.498572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e85f54-6ea9-4ebf-9a6a-d9b5291e2b2e service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:24.498855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e85f54-6ea9-4ebf-9a6a-d9b5291e2b2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:24.499134 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e85f54-6ea9-4ebf-9a6a-d9b5291e2b2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:24.538592 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:24.564849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e85f54-6ea9-4ebf-9a6a-d9b5291e2b2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:24.566620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e85f54-6ea9-4ebf-9a6a-d9b5291e2b2e service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:24.575984 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 994/2008] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:24.856911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:25.232833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:25.587583 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:25.614232 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:25.757066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:25.861785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:35.780017 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=55 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:35.905458 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=83,keystone:INSERT=5 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:39.134590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1c09-b00f-4d91-9cdf-7b3ffc70be9a service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:39.136294 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-c7bc1c09-b00f-4d91-9cdf-7b3ffc70be9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:39.207364 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1c09-b00f-4d91-9cdf-7b3ffc70be9a service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:39.212073 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485d2ec-8195-439a-b29e-66d3ec90650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:39.213308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485d2ec-8195-439a-b29e-66d3ec90650e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:39.213610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485d2ec-8195-439a-b29e-66d3ec90650e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:39.213873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485d2ec-8195-439a-b29e-66d3ec90650e admin admin] PATH_INFO: `/v3/users/23445e1ed54348bd9a68add870f5fee5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:39.215642 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485d2ec-8195-439a-b29e-66d3ec90650e admin admin] RBAC: Authorizing `identity:delete_user(user_id=23445e1ed54348bd9a68add870f5fee5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:39.217632 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485d2ec-8195-439a-b29e-66d3ec90650e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:39.336163 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e85f54-6ea9-4ebf-9a6a-d9b5291e2b2e service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:39.337608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f1e85f54-6ea9-4ebf-9a6a-d9b5291e2b2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:39.354310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e85f54-6ea9-4ebf-9a6a-d9b5291e2b2e service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:39.362556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85deaf59-b395-4257-928b-2b4ff0537806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:39.363460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85deaf59-b395-4257-928b-2b4ff0537806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:39.363903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85deaf59-b395-4257-928b-2b4ff0537806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:39.364068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85deaf59-b395-4257-928b-2b4ff0537806 admin admin] PATH_INFO: `/v3/users/cb57497f3d3e48a6b274a05359d7177f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:39.365446 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85deaf59-b395-4257-928b-2b4ff0537806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb57497f3d3e48a6b274a05359d7177f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:39.367668 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85deaf59-b395-4257-928b-2b4ff0537806 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:39.482792 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f485d2ec-8195-439a-b29e-66d3ec90650e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23445e1ed54348bd9a68add870f5fee5'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:39.564662 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-85deaf59-b395-4257-928b-2b4ff0537806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb57497f3d3e48a6b274a05359d7177f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:39.587134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f485d2ec-8195-439a-b29e-66d3ec90650e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23445e1ed54348bd9a68add870f5fee5'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:39.603501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f485d2ec-8195-439a-b29e-66d3ec90650e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23445e1ed54348bd9a68add870f5fee5'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:39.604232 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f485d2ec-8195-439a-b29e-66d3ec90650e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23445e1ed54348bd9a68add870f5fee5'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:39.625753 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f485d2ec-8195-439a-b29e-66d3ec90650e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23445e1ed54348bd9a68add870f5fee5'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:39.635936 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1015/2009] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:39 2022] DELETE /identity/v3/users/23445e1ed54348bd9a68add870f5fee5 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:39.635936 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485d2ec-8195-439a-b29e-66d3ec90650e admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:39.635936 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f485d2ec-8195-439a-b29e-66d3ec90650e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:39.703846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485d2ec-8195-439a-b29e-66d3ec90650e admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:39.708446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3d6ef-8af5-40ae-a1c4-1b72dd2223d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:39.709360 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3d6ef-8af5-40ae-a1c4-1b72dd2223d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:39.709648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3d6ef-8af5-40ae-a1c4-1b72dd2223d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:39.709926 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3d6ef-8af5-40ae-a1c4-1b72dd2223d0 admin admin] PATH_INFO: `/v3/users/2f3d39b0fa294e238cab405406986bc6` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:39.711141 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3d6ef-8af5-40ae-a1c4-1b72dd2223d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f3d39b0fa294e238cab405406986bc6)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:39.713372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3d6ef-8af5-40ae-a1c4-1b72dd2223d0 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:39.736089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:39.810780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-85deaf59-b395-4257-928b-2b4ff0537806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb57497f3d3e48a6b274a05359d7177f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:39.818153 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-85deaf59-b395-4257-928b-2b4ff0537806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb57497f3d3e48a6b274a05359d7177f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:39.818778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-85deaf59-b395-4257-928b-2b4ff0537806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb57497f3d3e48a6b274a05359d7177f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:39.830864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-85deaf59-b395-4257-928b-2b4ff0537806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb57497f3d3e48a6b274a05359d7177f'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:39.836729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 995/2010] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:39 2022] DELETE /identity/v3/users/cb57497f3d3e48a6b274a05359d7177f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:39.838693 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d62d6-1ff5-4797-9b24-ab03d2755b9f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:39.838693 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d62d6-1ff5-4797-9b24-ab03d2755b9f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:39.838996 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d62d6-1ff5-4797-9b24-ab03d2755b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:39.857038 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7c5d62d6-1ff5-4797-9b24-ab03d2755b9f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:39.858321 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7c5d62d6-1ff5-4797-9b24-ab03d2755b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:39.930234 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 996/2011] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:39.930234 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d8590-a25e-4e31-8611-7a8dbaf8688f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:39.930234 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d8590-a25e-4e31-8611-7a8dbaf8688f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:39.930234 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d8590-a25e-4e31-8611-7a8dbaf8688f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:39.936816 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-8d3d8590-a25e-4e31-8611-7a8dbaf8688f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:39.938139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8d3d8590-a25e-4e31-8611-7a8dbaf8688f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:39.945693 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 997/2012] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:39.946590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d8590-a25e-4e31-8611-7a8dbaf8688f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:39.947874 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8d3d8590-a25e-4e31-8611-7a8dbaf8688f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:40.003755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d8590-a25e-4e31-8611-7a8dbaf8688f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:40.007409 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c06a2-655c-46f6-8f17-6a7d62873555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:40.008058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c06a2-655c-46f6-8f17-6a7d62873555 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:40.008361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c06a2-655c-46f6-8f17-6a7d62873555 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:40.008623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c06a2-655c-46f6-8f17-6a7d62873555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:40.017949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c06a2-655c-46f6-8f17-6a7d62873555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:40.019456 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c06a2-655c-46f6-8f17-6a7d62873555 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:40.029900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 998/2013] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:40.030858 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c06a2-655c-46f6-8f17-6a7d62873555 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:40.039220 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c06a2-655c-46f6-8f17-6a7d62873555 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:40.043575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e86c5e-ca64-4f85-b536-b97fa443757f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:40.044327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e86c5e-ca64-4f85-b536-b97fa443757f service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:40.044610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e86c5e-ca64-4f85-b536-b97fa443757f service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:40.044890 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e86c5e-ca64-4f85-b536-b97fa443757f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:40.052187 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:40.054302 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e86c5e-ca64-4f85-b536-b97fa443757f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:40.055733 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e86c5e-ca64-4f85-b536-b97fa443757f service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:40.066795 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 999/2014] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:40.320876 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-d6a3d6ef-8af5-40ae-a1c4-1b72dd2223d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f3d39b0fa294e238cab405406986bc6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:40.464039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-d6a3d6ef-8af5-40ae-a1c4-1b72dd2223d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f3d39b0fa294e238cab405406986bc6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:40.476051 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-d6a3d6ef-8af5-40ae-a1c4-1b72dd2223d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f3d39b0fa294e238cab405406986bc6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:40.477713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-d6a3d6ef-8af5-40ae-a1c4-1b72dd2223d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f3d39b0fa294e238cab405406986bc6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:40.499502 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-d6a3d6ef-8af5-40ae-a1c4-1b72dd2223d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f3d39b0fa294e238cab405406986bc6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:40.509629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1016/2015] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:39 2022] DELETE /identity/v3/users/2f3d39b0fa294e238cab405406986bc6 => generated 0 bytes in 875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:40.515315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f18375-a6e9-40b9-afb1-95fe5a67d3e5 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:40.516212 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f18375-a6e9-40b9-afb1-95fe5a67d3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:40.516665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f18375-a6e9-40b9-afb1-95fe5a67d3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:40.539115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-31f18375-a6e9-40b9-afb1-95fe5a67d3e5 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:40.540452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-31f18375-a6e9-40b9-afb1-95fe5a67d3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:40.610629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3d6ef-8af5-40ae-a1c4-1b72dd2223d0 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:40.612560 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d6a3d6ef-8af5-40ae-a1c4-1b72dd2223d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:40.615897 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1000/2016] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:47:40.635194 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f18375-a6e9-40b9-afb1-95fe5a67d3e5 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:40.635194 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-31f18375-a6e9-40b9-afb1-95fe5a67d3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:40.677636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3d6ef-8af5-40ae-a1c4-1b72dd2223d0 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:40.682809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751e1c8-5a12-45b8-90e0-65406c57108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:40.684629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e1c8-5a12-45b8-90e0-65406c57108c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:40.684979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e1c8-5a12-45b8-90e0-65406c57108c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:40.685345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e1c8-5a12-45b8-90e0-65406c57108c admin admin] PATH_INFO: `/v3/projects/09e8e85ed38e4d48b9409c40ebf917ea` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:40.687284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751e1c8-5a12-45b8-90e0-65406c57108c admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e8e85ed38e4d48b9409c40ebf917ea)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:40.690752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751e1c8-5a12-45b8-90e0-65406c57108c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:40.756710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f18375-a6e9-40b9-afb1-95fe5a67d3e5 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:40.762218 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd77014-d281-4346-b7d4-ddefff03f9c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:40.763547 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd77014-d281-4346-b7d4-ddefff03f9c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:40.763941 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd77014-d281-4346-b7d4-ddefff03f9c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:40.765540 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd77014-d281-4346-b7d4-ddefff03f9c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:40.775495 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd77014-d281-4346-b7d4-ddefff03f9c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:40.778114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd77014-d281-4346-b7d4-ddefff03f9c0 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:40.794845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1001/2017] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:40.795864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd77014-d281-4346-b7d4-ddefff03f9c0 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:40.797550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8bd77014-d281-4346-b7d4-ddefff03f9c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:40.815640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd77014-d281-4346-b7d4-ddefff03f9c0 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:40.820477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46126560-8069-4de8-be44-61ba3ca71cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:40.822223 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46126560-8069-4de8-be44-61ba3ca71cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:40.822223 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46126560-8069-4de8-be44-61ba3ca71cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:40.822613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46126560-8069-4de8-be44-61ba3ca71cad admin admin] PATH_INFO: `/v3/projects/44390d7f50814689a0b6af5ecd132751` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:40.824116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46126560-8069-4de8-be44-61ba3ca71cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=44390d7f50814689a0b6af5ecd132751)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:40.827023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46126560-8069-4de8-be44-61ba3ca71cad admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:40.899947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-5751e1c8-5a12-45b8-90e0-65406c57108c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e8e85ed38e4d48b9409c40ebf917ea', 'request_id': 'req-5751e1c8-5a12-45b8-90e0-65406c57108c'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:40.908059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-5751e1c8-5a12-45b8-90e0-65406c57108c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e8e85ed38e4d48b9409c40ebf917ea', 'request_id': 'req-5751e1c8-5a12-45b8-90e0-65406c57108c'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:40.992399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-46126560-8069-4de8-be44-61ba3ca71cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44390d7f50814689a0b6af5ecd132751', 'request_id': 'req-46126560-8069-4de8-be44-61ba3ca71cad'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:40.999111 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-46126560-8069-4de8-be44-61ba3ca71cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44390d7f50814689a0b6af5ecd132751', 'request_id': 'req-46126560-8069-4de8-be44-61ba3ca71cad'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.039200 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-5751e1c8-5a12-45b8-90e0-65406c57108c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e8e85ed38e4d48b9409c40ebf917ea', 'request_id': 'req-5751e1c8-5a12-45b8-90e0-65406c57108c'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.050877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-5751e1c8-5a12-45b8-90e0-65406c57108c admin admin] The token cache is being invalidate because project 09e8e85ed38e4d48b9409c40ebf917ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:41.051323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-5751e1c8-5a12-45b8-90e0-65406c57108c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.052008 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-5751e1c8-5a12-45b8-90e0-65406c57108c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.053687 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1017/2018] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:40 2022] DELETE /identity/v3/projects/09e8e85ed38e4d48b9409c40ebf917ea => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:41.058107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751e1c8-5a12-45b8-90e0-65406c57108c admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:41.059860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-5751e1c8-5a12-45b8-90e0-65406c57108c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:41.130389 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751e1c8-5a12-45b8-90e0-65406c57108c admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:41.176147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-46126560-8069-4de8-be44-61ba3ca71cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44390d7f50814689a0b6af5ecd132751', 'request_id': 'req-46126560-8069-4de8-be44-61ba3ca71cad'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.188128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-46126560-8069-4de8-be44-61ba3ca71cad admin admin] The token cache is being invalidate because project 44390d7f50814689a0b6af5ecd132751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:41.188454 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-46126560-8069-4de8-be44-61ba3ca71cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.189114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-46126560-8069-4de8-be44-61ba3ca71cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.189291 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122b952-e9f7-4f68-91d2-1f412ba5498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:41.191107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b952-e9f7-4f68-91d2-1f412ba5498e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:41.191486 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b952-e9f7-4f68-91d2-1f412ba5498e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:41.191782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122b952-e9f7-4f68-91d2-1f412ba5498e admin admin] PATH_INFO: `/v3/users/506e4aa2311b4f2e9c82aeb8a1656842` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:41.193113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122b952-e9f7-4f68-91d2-1f412ba5498e admin admin] RBAC: Authorizing `identity:delete_user(user_id=506e4aa2311b4f2e9c82aeb8a1656842)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:41.194383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1002/2019] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:40 2022] DELETE /identity/v3/projects/44390d7f50814689a0b6af5ecd132751 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:41.198427 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46126560-8069-4de8-be44-61ba3ca71cad admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:41.199593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122b952-e9f7-4f68-91d2-1f412ba5498e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:41.200403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-46126560-8069-4de8-be44-61ba3ca71cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:41.216382 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46126560-8069-4de8-be44-61ba3ca71cad admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:41.222027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773a26f-37bd-4f8b-b9cc-bef5fd5b0f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:41.222934 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773a26f-37bd-4f8b-b9cc-bef5fd5b0f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:41.223221 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773a26f-37bd-4f8b-b9cc-bef5fd5b0f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:41.223554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773a26f-37bd-4f8b-b9cc-bef5fd5b0f74 admin admin] PATH_INFO: `/v3/users/18a50399114d4b84ba2d13dfb154169b` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:41.224835 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773a26f-37bd-4f8b-b9cc-bef5fd5b0f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a50399114d4b84ba2d13dfb154169b)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:41.227071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773a26f-37bd-4f8b-b9cc-bef5fd5b0f74 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:41.551309 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:41.708074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e773a26f-37bd-4f8b-b9cc-bef5fd5b0f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a50399114d4b84ba2d13dfb154169b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.746524 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8122b952-e9f7-4f68-91d2-1f412ba5498e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506e4aa2311b4f2e9c82aeb8a1656842'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.811103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e773a26f-37bd-4f8b-b9cc-bef5fd5b0f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a50399114d4b84ba2d13dfb154169b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.820343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e773a26f-37bd-4f8b-b9cc-bef5fd5b0f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a50399114d4b84ba2d13dfb154169b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.821159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e773a26f-37bd-4f8b-b9cc-bef5fd5b0f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a50399114d4b84ba2d13dfb154169b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.833454 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e773a26f-37bd-4f8b-b9cc-bef5fd5b0f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a50399114d4b84ba2d13dfb154169b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.840453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1003/2020] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:41 2022] DELETE /identity/v3/users/18a50399114d4b84ba2d13dfb154169b => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:41.843013 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773a26f-37bd-4f8b-b9cc-bef5fd5b0f74 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:41.843013 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e773a26f-37bd-4f8b-b9cc-bef5fd5b0f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:41.890135 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8122b952-e9f7-4f68-91d2-1f412ba5498e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506e4aa2311b4f2e9c82aeb8a1656842'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.897953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8122b952-e9f7-4f68-91d2-1f412ba5498e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506e4aa2311b4f2e9c82aeb8a1656842'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.900284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8122b952-e9f7-4f68-91d2-1f412ba5498e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506e4aa2311b4f2e9c82aeb8a1656842'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.912327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8122b952-e9f7-4f68-91d2-1f412ba5498e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506e4aa2311b4f2e9c82aeb8a1656842'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:41.920230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773a26f-37bd-4f8b-b9cc-bef5fd5b0f74 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:41.922692 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1018/2021] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:41 2022] DELETE /identity/v3/users/506e4aa2311b4f2e9c82aeb8a1656842 => generated 0 bytes in 863 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:41.922692 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122b952-e9f7-4f68-91d2-1f412ba5498e admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:41.925546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8122b952-e9f7-4f68-91d2-1f412ba5498e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:41.970047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:41.988826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6e922-d247-4b13-951c-c21f2040c9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:41.990181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6e922-d247-4b13-951c-c21f2040c9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:41.990616 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6e922-d247-4b13-951c-c21f2040c9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:41.990967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6e922-d247-4b13-951c-c21f2040c9a3 admin admin] PATH_INFO: `/v3/projects/0b198579e5474f7a9576da437b98f6c7` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:41.992390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6e922-d247-4b13-951c-c21f2040c9a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b198579e5474f7a9576da437b98f6c7)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:41.993766 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122b952-e9f7-4f68-91d2-1f412ba5498e admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:41.994978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6e922-d247-4b13-951c-c21f2040c9a3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:42.000213 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee3d0d-ac5f-4b1a-8ea8-66c28300ee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:42.001403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee3d0d-ac5f-4b1a-8ea8-66c28300ee70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:42.001869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee3d0d-ac5f-4b1a-8ea8-66c28300ee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:42.002312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee3d0d-ac5f-4b1a-8ea8-66c28300ee70 admin admin] PATH_INFO: `/v3/users/99c1a6461d5c47c7869f0cf45e98ef9a` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:42.004774 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee3d0d-ac5f-4b1a-8ea8-66c28300ee70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c1a6461d5c47c7869f0cf45e98ef9a)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:42.007288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee3d0d-ac5f-4b1a-8ea8-66c28300ee70 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:42.254730 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4ac6e922-d247-4b13-951c-c21f2040c9a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b198579e5474f7a9576da437b98f6c7', 'request_id': 'req-4ac6e922-d247-4b13-951c-c21f2040c9a3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.256913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e7ee3d0d-ac5f-4b1a-8ea8-66c28300ee70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c1a6461d5c47c7869f0cf45e98ef9a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.262087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4ac6e922-d247-4b13-951c-c21f2040c9a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b198579e5474f7a9576da437b98f6c7', 'request_id': 'req-4ac6e922-d247-4b13-951c-c21f2040c9a3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.388258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e7ee3d0d-ac5f-4b1a-8ea8-66c28300ee70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c1a6461d5c47c7869f0cf45e98ef9a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.396783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e7ee3d0d-ac5f-4b1a-8ea8-66c28300ee70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c1a6461d5c47c7869f0cf45e98ef9a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.397575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e7ee3d0d-ac5f-4b1a-8ea8-66c28300ee70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c1a6461d5c47c7869f0cf45e98ef9a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.411467 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e7ee3d0d-ac5f-4b1a-8ea8-66c28300ee70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c1a6461d5c47c7869f0cf45e98ef9a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.417577 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1019/2022] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:41 2022] DELETE /identity/v3/users/99c1a6461d5c47c7869f0cf45e98ef9a => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:42.419496 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee3d0d-ac5f-4b1a-8ea8-66c28300ee70 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:42.420672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e7ee3d0d-ac5f-4b1a-8ea8-66c28300ee70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:42.485079 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4ac6e922-d247-4b13-951c-c21f2040c9a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b198579e5474f7a9576da437b98f6c7', 'request_id': 'req-4ac6e922-d247-4b13-951c-c21f2040c9a3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.494837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee3d0d-ac5f-4b1a-8ea8-66c28300ee70 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:42.498275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4ac6e922-d247-4b13-951c-c21f2040c9a3 admin admin] The token cache is being invalidate because project 0b198579e5474f7a9576da437b98f6c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:42.498566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4ac6e922-d247-4b13-951c-c21f2040c9a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.499263 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4ac6e922-d247-4b13-951c-c21f2040c9a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.501120 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1004/2023] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:41 2022] DELETE /identity/v3/projects/0b198579e5474f7a9576da437b98f6c7 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:42.501245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a35166-7af0-45a1-ad4f-7af059737d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:42.501678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6e922-d247-4b13-951c-c21f2040c9a3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:42.502359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a35166-7af0-45a1-ad4f-7af059737d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:42.502653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a35166-7af0-45a1-ad4f-7af059737d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:42.502950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a35166-7af0-45a1-ad4f-7af059737d3d admin admin] PATH_INFO: `/v3/projects/4e5059535b3147e7933fa683f7d14bed` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:42.503120 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4ac6e922-d247-4b13-951c-c21f2040c9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:42.504514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a35166-7af0-45a1-ad4f-7af059737d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e5059535b3147e7933fa683f7d14bed)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:42.506547 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a35166-7af0-45a1-ad4f-7af059737d3d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:42.569431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6e922-d247-4b13-951c-c21f2040c9a3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:42.575115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51742f40-4d80-41e8-ade8-8893eae14578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:42.575690 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742f40-4d80-41e8-ade8-8893eae14578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:42.575985 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742f40-4d80-41e8-ade8-8893eae14578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:42.576268 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742f40-4d80-41e8-ade8-8893eae14578 admin admin] PATH_INFO: `/v3/projects/41e9383e8391491ebbb58c8c6eda956a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:42.577510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51742f40-4d80-41e8-ade8-8893eae14578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e9383e8391491ebbb58c8c6eda956a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:42.579465 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51742f40-4d80-41e8-ade8-8893eae14578 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:42.661099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-96a35166-7af0-45a1-ad4f-7af059737d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e5059535b3147e7933fa683f7d14bed', 'request_id': 'req-96a35166-7af0-45a1-ad4f-7af059737d3d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.667153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-96a35166-7af0-45a1-ad4f-7af059737d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e5059535b3147e7933fa683f7d14bed', 'request_id': 'req-96a35166-7af0-45a1-ad4f-7af059737d3d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.759013 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-51742f40-4d80-41e8-ade8-8893eae14578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e9383e8391491ebbb58c8c6eda956a', 'request_id': 'req-51742f40-4d80-41e8-ade8-8893eae14578'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.765865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-51742f40-4d80-41e8-ade8-8893eae14578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e9383e8391491ebbb58c8c6eda956a', 'request_id': 'req-51742f40-4d80-41e8-ade8-8893eae14578'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.821488 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-96a35166-7af0-45a1-ad4f-7af059737d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e5059535b3147e7933fa683f7d14bed', 'request_id': 'req-96a35166-7af0-45a1-ad4f-7af059737d3d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.834449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-96a35166-7af0-45a1-ad4f-7af059737d3d admin admin] The token cache is being invalidate because project 4e5059535b3147e7933fa683f7d14bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:42.834449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-96a35166-7af0-45a1-ad4f-7af059737d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.835085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-96a35166-7af0-45a1-ad4f-7af059737d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.841029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1020/2024] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:42 2022] DELETE /identity/v3/projects/4e5059535b3147e7933fa683f7d14bed => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:42.841029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a35166-7af0-45a1-ad4f-7af059737d3d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:42.841029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-96a35166-7af0-45a1-ad4f-7af059737d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:42.903731 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a35166-7af0-45a1-ad4f-7af059737d3d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:42.923737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-51742f40-4d80-41e8-ade8-8893eae14578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e9383e8391491ebbb58c8c6eda956a', 'request_id': 'req-51742f40-4d80-41e8-ade8-8893eae14578'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.929617 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-51742f40-4d80-41e8-ade8-8893eae14578 admin admin] The token cache is being invalidate because project 41e9383e8391491ebbb58c8c6eda956a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:42.929905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-51742f40-4d80-41e8-ade8-8893eae14578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.930563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-51742f40-4d80-41e8-ade8-8893eae14578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:42.932425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1005/2025] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:42 2022] DELETE /identity/v3/projects/41e9383e8391491ebbb58c8c6eda956a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:42.937013 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51742f40-4d80-41e8-ade8-8893eae14578 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:42.938363 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-51742f40-4d80-41e8-ade8-8893eae14578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:42.961359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29b715-d3e1-45fb-8bb4-b09678c96dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:42.962255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29b715-d3e1-45fb-8bb4-b09678c96dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:42.962544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29b715-d3e1-45fb-8bb4-b09678c96dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:42.963082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29b715-d3e1-45fb-8bb4-b09678c96dda admin admin] PATH_INFO: `/v3/users/dd9b4d3f9f354167a4f55275516f75c4` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:42.964726 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29b715-d3e1-45fb-8bb4-b09678c96dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9b4d3f9f354167a4f55275516f75c4)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:42.968098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29b715-d3e1-45fb-8bb4-b09678c96dda admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:43.021020 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51742f40-4d80-41e8-ade8-8893eae14578 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:43.026359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a263c18-7b27-4aa2-b234-7a2e257b9944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:43.027503 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a263c18-7b27-4aa2-b234-7a2e257b9944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:43.028123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a263c18-7b27-4aa2-b234-7a2e257b9944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:43.028469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a263c18-7b27-4aa2-b234-7a2e257b9944 admin admin] PATH_INFO: `/v3/projects/5510e48bc3c1405aa910de5b4f190f68` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:43.029874 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a263c18-7b27-4aa2-b234-7a2e257b9944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5510e48bc3c1405aa910de5b4f190f68)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:43.033736 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a263c18-7b27-4aa2-b234-7a2e257b9944 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:43.220157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:43.233215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a263c18-7b27-4aa2-b234-7a2e257b9944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5510e48bc3c1405aa910de5b4f190f68', 'request_id': 'req-7a263c18-7b27-4aa2-b234-7a2e257b9944'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:43.234208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6f29b715-d3e1-45fb-8bb4-b09678c96dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9b4d3f9f354167a4f55275516f75c4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:43.239530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a263c18-7b27-4aa2-b234-7a2e257b9944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5510e48bc3c1405aa910de5b4f190f68', 'request_id': 'req-7a263c18-7b27-4aa2-b234-7a2e257b9944'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:43.301627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6f29b715-d3e1-45fb-8bb4-b09678c96dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9b4d3f9f354167a4f55275516f75c4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:43.309868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6f29b715-d3e1-45fb-8bb4-b09678c96dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9b4d3f9f354167a4f55275516f75c4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:43.310517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6f29b715-d3e1-45fb-8bb4-b09678c96dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9b4d3f9f354167a4f55275516f75c4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:43.322492 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6f29b715-d3e1-45fb-8bb4-b09678c96dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9b4d3f9f354167a4f55275516f75c4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:43.328735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1021/2026] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:42 2022] DELETE /identity/v3/users/dd9b4d3f9f354167a4f55275516f75c4 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:43.330107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff44397-e4d1-4145-a31f-11ad075c9e66 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:43.345154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff44397-e4d1-4145-a31f-11ad075c9e66 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:43.345154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff44397-e4d1-4145-a31f-11ad075c9e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:43.348765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-8ff44397-e4d1-4145-a31f-11ad075c9e66 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:43.350009 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8ff44397-e4d1-4145-a31f-11ad075c9e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:43.369890 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a263c18-7b27-4aa2-b234-7a2e257b9944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5510e48bc3c1405aa910de5b4f190f68', 'request_id': 'req-7a263c18-7b27-4aa2-b234-7a2e257b9944'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:43.382813 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a263c18-7b27-4aa2-b234-7a2e257b9944 admin admin] The token cache is being invalidate because project 5510e48bc3c1405aa910de5b4f190f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:43.390344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a263c18-7b27-4aa2-b234-7a2e257b9944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:43.390344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a263c18-7b27-4aa2-b234-7a2e257b9944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:43.390344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1006/2027] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:42 2022] DELETE /identity/v3/projects/5510e48bc3c1405aa910de5b4f190f68 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:43.390344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16201ec-6f89-47bc-9ff1-a038d7a562d0 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:43.390344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16201ec-6f89-47bc-9ff1-a038d7a562d0 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:43.390344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16201ec-6f89-47bc-9ff1-a038d7a562d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:43.409545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e16201ec-6f89-47bc-9ff1-a038d7a562d0 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:43.410765 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e16201ec-6f89-47bc-9ff1-a038d7a562d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:43.414702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1022/2028] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:43.416279 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3aeb1-3bc9-47b1-b702-877c8d4a8651 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:43.416575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3aeb1-3bc9-47b1-b702-877c8d4a8651 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:43.416860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3aeb1-3bc9-47b1-b702-877c8d4a8651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:43.423056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1007/2029] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:43.431480 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60897466-dd69-435c-969c-47a649c2ceb2 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:43.431780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60897466-dd69-435c-969c-47a649c2ceb2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:43.432065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60897466-dd69-435c-969c-47a649c2ceb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:43.441279 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-91f3aeb1-3bc9-47b1-b702-877c8d4a8651 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:43.442556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-91f3aeb1-3bc9-47b1-b702-877c8d4a8651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:43.451457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:43.460323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1023/2030] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:43.460323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2962eb-7d60-4a8d-92da-198977600c2f None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:43.460323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2962eb-7d60-4a8d-92da-198977600c2f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:43.460323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2962eb-7d60-4a8d-92da-198977600c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:43.471085 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-60897466-dd69-435c-969c-47a649c2ceb2 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:43.471085 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-60897466-dd69-435c-969c-47a649c2ceb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:43.475174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1008/2031] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:43.478782 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c2d7c-a21c-4e77-ab6d-7324956cd830 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:43.479240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c2d7c-a21c-4e77-ab6d-7324956cd830 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:43.479722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c2d7c-a21c-4e77-ab6d-7324956cd830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:43.490351 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-0b2962eb-7d60-4a8d-92da-198977600c2f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:43.491557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0b2962eb-7d60-4a8d-92da-198977600c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:43.499696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7f0c2d7c-a21c-4e77-ab6d-7324956cd830 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:43.500872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7f0c2d7c-a21c-4e77-ab6d-7324956cd830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:43.504144 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1024/2032] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:43.505041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2962eb-7d60-4a8d-92da-198977600c2f None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:43.509319 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1009/2033] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:43.510199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c2d7c-a21c-4e77-ab6d-7324956cd830 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:43.515312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2962eb-7d60-4a8d-92da-198977600c2f None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:43.519923 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cafb7d-7e71-48da-a90d-9b2bf53428c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:43.520219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c2d7c-a21c-4e77-ab6d-7324956cd830 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:43.520583 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cafb7d-7e71-48da-a90d-9b2bf53428c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:43.520868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cafb7d-7e71-48da-a90d-9b2bf53428c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:43.521197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cafb7d-7e71-48da-a90d-9b2bf53428c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:43.521918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cafb7d-7e71-48da-a90d-9b2bf53428c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:47:43.522230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cafb7d-7e71-48da-a90d-9b2bf53428c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:43.523907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cafb7d-7e71-48da-a90d-9b2bf53428c7 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:43.525461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3efb2-93a6-46ef-a911-7a8b55545cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:43.526115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3efb2-93a6-46ef-a911-7a8b55545cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:43.526754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3efb2-93a6-46ef-a911-7a8b55545cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:43.526754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3efb2-93a6-46ef-a911-7a8b55545cf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:43.527454 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3efb2-93a6-46ef-a911-7a8b55545cf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:47:43.527769 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3efb2-93a6-46ef-a911-7a8b55545cf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:43.529623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3efb2-93a6-46ef-a911-7a8b55545cf6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:43.536616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1025/2034] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:47:43.541347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cafb7d-7e71-48da-a90d-9b2bf53428c7 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:43.547293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1010/2035] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:47:43.547293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3efb2-93a6-46ef-a911-7a8b55545cf6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:43.548470 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cafb7d-7e71-48da-a90d-9b2bf53428c7 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:43.553101 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a44e36-efee-4221-a954-e0eb67e195fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:43.553756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a44e36-efee-4221-a954-e0eb67e195fc admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:43.554040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a44e36-efee-4221-a954-e0eb67e195fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:43.554319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a44e36-efee-4221-a954-e0eb67e195fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:43.554830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3efb2-93a6-46ef-a911-7a8b55545cf6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:43.555037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a44e36-efee-4221-a954-e0eb67e195fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:47:43.555345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a44e36-efee-4221-a954-e0eb67e195fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:43.556961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a44e36-efee-4221-a954-e0eb67e195fc admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:43.560071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2a87d-baad-4dd4-9e83-35c04a2e1058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:43.560712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2a87d-baad-4dd4-9e83-35c04a2e1058 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:43.561023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2a87d-baad-4dd4-9e83-35c04a2e1058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:43.561300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2a87d-baad-4dd4-9e83-35c04a2e1058 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:43.561979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2a87d-baad-4dd4-9e83-35c04a2e1058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:43.563907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2a87d-baad-4dd4-9e83-35c04a2e1058 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:43.570088 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1026/2036] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:47:43.570876 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a44e36-efee-4221-a954-e0eb67e195fc admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:43.581426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a44e36-efee-4221-a954-e0eb67e195fc admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:43.586066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856e741-a409-4a90-931a-24fc758fa111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:43.586946 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856e741-a409-4a90-931a-24fc758fa111 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:43.587241 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856e741-a409-4a90-931a-24fc758fa111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:43.587524 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856e741-a409-4a90-931a-24fc758fa111 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:43.588474 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856e741-a409-4a90-931a-24fc758fa111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:43.590672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856e741-a409-4a90-931a-24fc758fa111 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:43.760522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1011/2037] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:43 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:43.760522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2a87d-baad-4dd4-9e83-35c04a2e1058 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:43.769373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1027/2038] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:43 2022] POST /identity/v3/projects => generated 401 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:43.769373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856e741-a409-4a90-931a-24fc758fa111 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:43.847692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2a87d-baad-4dd4-9e83-35c04a2e1058 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:43.852701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cc355-65a6-459f-b1e4-f4db4e198bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:43.853404 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cc355-65a6-459f-b1e4-f4db4e198bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:43.853695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cc355-65a6-459f-b1e4-f4db4e198bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:43.853871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856e741-a409-4a90-931a-24fc758fa111 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:43.853971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cc355-65a6-459f-b1e4-f4db4e198bd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:43.854662 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cc355-65a6-459f-b1e4-f4db4e198bd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:43.857153 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cc355-65a6-459f-b1e4-f4db4e198bd3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:43.859253 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbb737-972e-4d3f-9291-ee2e45385e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:43.859924 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbb737-972e-4d3f-9291-ee2e45385e54 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:43.860237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbb737-972e-4d3f-9291-ee2e45385e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:43.860515 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbb737-972e-4d3f-9291-ee2e45385e54 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:43.861254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbb737-972e-4d3f-9291-ee2e45385e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:43.863160 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbb737-972e-4d3f-9291-ee2e45385e54 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:43.987759 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1012/2039] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:43 2022] POST /identity/v3/projects => generated 383 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:43.988730 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cc355-65a6-459f-b1e4-f4db4e198bd3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:43.993747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1028/2040] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:43 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:43.994702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbb737-972e-4d3f-9291-ee2e45385e54 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:43.997367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d6cbb737-972e-4d3f-9291-ee2e45385e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:44.010062 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbb737-972e-4d3f-9291-ee2e45385e54 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:44.054841 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cc355-65a6-459f-b1e4-f4db4e198bd3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:44.060193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34bb12-33e4-4ece-a5d8-cdacddd4eb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:44.060874 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34bb12-33e4-4ece-a5d8-cdacddd4eb97 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.061192 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34bb12-33e4-4ece-a5d8-cdacddd4eb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.061474 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34bb12-33e4-4ece-a5d8-cdacddd4eb97 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.062174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34bb12-33e4-4ece-a5d8-cdacddd4eb97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:44.064203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34bb12-33e4-4ece-a5d8-cdacddd4eb97 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:44.073303 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72903436-7122-4fec-a762-cc27c022f629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:44.074768 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72903436-7122-4fec-a762-cc27c022f629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.075416 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72903436-7122-4fec-a762-cc27c022f629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.075416 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72903436-7122-4fec-a762-cc27c022f629 admin admin] PATH_INFO: `/v3/projects/4dfe4e5e9389486989171e21663af165` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.076539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72903436-7122-4fec-a762-cc27c022f629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dfe4e5e9389486989171e21663af165)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:44.078498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72903436-7122-4fec-a762-cc27c022f629 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:44.237565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1013/2041] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:43 2022] POST /identity/v3/users => generated 301 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:44.238391 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34bb12-33e4-4ece-a5d8-cdacddd4eb97 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:44.249207 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34bb12-33e4-4ece-a5d8-cdacddd4eb97 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:44.250610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-72903436-7122-4fec-a762-cc27c022f629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dfe4e5e9389486989171e21663af165', 'request_id': 'req-72903436-7122-4fec-a762-cc27c022f629'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:44.256861 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-72903436-7122-4fec-a762-cc27c022f629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dfe4e5e9389486989171e21663af165', 'request_id': 'req-72903436-7122-4fec-a762-cc27c022f629'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:44.307550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0533ac-646e-4f9c-a033-838f1d906d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:44.308320 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0533ac-646e-4f9c-a033-838f1d906d0a admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.308650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0533ac-646e-4f9c-a033-838f1d906d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.308959 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0533ac-646e-4f9c-a033-838f1d906d0a admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.309812 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0533ac-646e-4f9c-a033-838f1d906d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:44.314036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-72903436-7122-4fec-a762-cc27c022f629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dfe4e5e9389486989171e21663af165', 'request_id': 'req-72903436-7122-4fec-a762-cc27c022f629'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:44.314283 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0533ac-646e-4f9c-a033-838f1d906d0a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:44.325886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-72903436-7122-4fec-a762-cc27c022f629 admin admin] The token cache is being invalidate because project 4dfe4e5e9389486989171e21663af165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:44.326554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-72903436-7122-4fec-a762-cc27c022f629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:44.326895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-72903436-7122-4fec-a762-cc27c022f629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:44.328493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1029/2042] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:43 2022] DELETE /identity/v3/projects/4dfe4e5e9389486989171e21663af165 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:44.329309 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72903436-7122-4fec-a762-cc27c022f629 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:44.330600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-72903436-7122-4fec-a762-cc27c022f629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:44.343798 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72903436-7122-4fec-a762-cc27c022f629 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:44.348437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad93dd-6fbf-4eda-89e7-fbe6ea896f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:44.349559 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad93dd-6fbf-4eda-89e7-fbe6ea896f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.349559 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad93dd-6fbf-4eda-89e7-fbe6ea896f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.349736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad93dd-6fbf-4eda-89e7-fbe6ea896f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.350377 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad93dd-6fbf-4eda-89e7-fbe6ea896f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:44.351962 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad93dd-6fbf-4eda-89e7-fbe6ea896f5e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:44.361758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1030/2043] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:44.362518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad93dd-6fbf-4eda-89e7-fbe6ea896f5e admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:44.364032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-9bad93dd-6fbf-4eda-89e7-fbe6ea896f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:44.376576 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad93dd-6fbf-4eda-89e7-fbe6ea896f5e admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:44.381142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac7ea8-6c79-467a-bbff-1175d137f483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:44.381777 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac7ea8-6c79-467a-bbff-1175d137f483 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.382058 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac7ea8-6c79-467a-bbff-1175d137f483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.382329 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac7ea8-6c79-467a-bbff-1175d137f483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.383025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac7ea8-6c79-467a-bbff-1175d137f483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:44.384588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac7ea8-6c79-467a-bbff-1175d137f483 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:44.394828 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1031/2044] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:44.395976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9931c-2e1c-4cd6-816b-462e9343f054 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.396263 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9931c-2e1c-4cd6-816b-462e9343f054 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.396541 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9931c-2e1c-4cd6-816b-462e9343f054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.403423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1014/2045] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:44 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:44.404317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0533ac-646e-4f9c-a033-838f1d906d0a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:44.414971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0533ac-646e-4f9c-a033-838f1d906d0a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:44.419664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5d75d-c62b-4b67-b899-f2f05f159557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:44.420419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5d75d-c62b-4b67-b899-f2f05f159557 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.420710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5d75d-c62b-4b67-b899-f2f05f159557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.421026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5d75d-c62b-4b67-b899-f2f05f159557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.421762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5d75d-c62b-4b67-b899-f2f05f159557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:44.423365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5d75d-c62b-4b67-b899-f2f05f159557 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:44.436852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1015/2046] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:44.437065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-bae9931c-2e1c-4cd6-816b-462e9343f054 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:44.437166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5d75d-c62b-4b67-b899-f2f05f159557 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:44.437257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-bae9931c-2e1c-4cd6-816b-462e9343f054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:44.443467 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1032/2047] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:44.444317 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9931c-2e1c-4cd6-816b-462e9343f054 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:44.451633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5d75d-c62b-4b67-b899-f2f05f159557 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:44.451751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-bae9931c-2e1c-4cd6-816b-462e9343f054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:44.451887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a203be7-697b-4408-acd9-d05d1dd57604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:44.451887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a203be7-697b-4408-acd9-d05d1dd57604 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.451887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a203be7-697b-4408-acd9-d05d1dd57604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.451887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a203be7-697b-4408-acd9-d05d1dd57604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.452220 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a203be7-697b-4408-acd9-d05d1dd57604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:44.453329 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a203be7-697b-4408-acd9-d05d1dd57604 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:44.458309 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9931c-2e1c-4cd6-816b-462e9343f054 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:44.464280 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fd5dd-bdc6-475b-86c7-8d4a1fa7c34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:44.464783 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1016/2048] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:44.465147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fd5dd-bdc6-475b-86c7-8d4a1fa7c34f admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.465437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fd5dd-bdc6-475b-86c7-8d4a1fa7c34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.465634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a203be7-697b-4408-acd9-d05d1dd57604 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:44.465733 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fd5dd-bdc6-475b-86c7-8d4a1fa7c34f admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.466449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fd5dd-bdc6-475b-86c7-8d4a1fa7c34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:44.468064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fd5dd-bdc6-475b-86c7-8d4a1fa7c34f admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:44.477391 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a203be7-697b-4408-acd9-d05d1dd57604 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:44.481626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1033/2049] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:44.481626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff164d32-84b0-42c7-8ca5-75130bfb3c64 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.481626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff164d32-84b0-42c7-8ca5-75130bfb3c64 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.481626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff164d32-84b0-42c7-8ca5-75130bfb3c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.485557 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eae544-9a89-4b7d-8e37-51c4038944de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:44.486455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eae544-9a89-4b7d-8e37-51c4038944de admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.509154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eae544-9a89-4b7d-8e37-51c4038944de admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.509154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eae544-9a89-4b7d-8e37-51c4038944de admin admin] PATH_INFO: `/v3/projects/f9d1bc1c092340ea9fc7c6747ed66fb6/users/66e14c2387334eedbe8cd07fda431ac0/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.509427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-ff164d32-84b0-42c7-8ca5-75130bfb3c64 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:44.509427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ff164d32-84b0-42c7-8ca5-75130bfb3c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:44.509600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eae544-9a89-4b7d-8e37-51c4038944de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d1bc1c092340ea9fc7c6747ed66fb6, user_id=66e14c2387334eedbe8cd07fda431ac0, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:44.509600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eae544-9a89-4b7d-8e37-51c4038944de admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:44.510798 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1034/2050] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:44.512387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff164d32-84b0-42c7-8ca5-75130bfb3c64 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:44.521964 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff164d32-84b0-42c7-8ca5-75130bfb3c64 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:44.526723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0119f44-4fd1-4606-87ad-8c9f4d352b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:44.532115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0119f44-4fd1-4606-87ad-8c9f4d352b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.532115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0119f44-4fd1-4606-87ad-8c9f4d352b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.532115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0119f44-4fd1-4606-87ad-8c9f4d352b35 admin admin] PATH_INFO: `/v3/projects/03fac7708af141099a315b44ce5293e9/users/dc6fbc9974244c0fa37eab885f20c937/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.532115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:44.544025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0119f44-4fd1-4606-87ad-8c9f4d352b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03fac7708af141099a315b44ce5293e9, user_id=dc6fbc9974244c0fa37eab885f20c937, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:44.546725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0119f44-4fd1-4606-87ad-8c9f4d352b35 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:44.616062 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1017/2051] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:44 2022] PUT /identity/v3/projects/f9d1bc1c092340ea9fc7c6747ed66fb6/users/66e14c2387334eedbe8cd07fda431ac0/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:44.616962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eae544-9a89-4b7d-8e37-51c4038944de admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:44.629573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1035/2052] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:44 2022] PUT /identity/v3/projects/03fac7708af141099a315b44ce5293e9/users/dc6fbc9974244c0fa37eab885f20c937/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:44.630850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0119f44-4fd1-4606-87ad-8c9f4d352b35 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:44.681031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eae544-9a89-4b7d-8e37-51c4038944de admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:44.698792 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0119f44-4fd1-4606-87ad-8c9f4d352b35 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:44.704351 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92ad82-5231-4ffc-a55b-0cd4c09c036e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:44.707044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92ad82-5231-4ffc-a55b-0cd4c09c036e admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.707044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92ad82-5231-4ffc-a55b-0cd4c09c036e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.707044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92ad82-5231-4ffc-a55b-0cd4c09c036e admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.707044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92ad82-5231-4ffc-a55b-0cd4c09c036e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:47:44.707044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92ad82-5231-4ffc-a55b-0cd4c09c036e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:44.709086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92ad82-5231-4ffc-a55b-0cd4c09c036e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:44.725349 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1036/2053] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:47:44.725349 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b90d40-4788-498b-a4d0-1f6ffe9d43bb None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.725349 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b90d40-4788-498b-a4d0-1f6ffe9d43bb None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.725349 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b90d40-4788-498b-a4d0-1f6ffe9d43bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.742824 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1400a3-ea3c-4428-868c-af5b9aca4b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:44.743659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1400a3-ea3c-4428-868c-af5b9aca4b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.743942 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1400a3-ea3c-4428-868c-af5b9aca4b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.744213 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1400a3-ea3c-4428-868c-af5b9aca4b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.744987 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1400a3-ea3c-4428-868c-af5b9aca4b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:44.747350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1400a3-ea3c-4428-868c-af5b9aca4b40 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:44.753864 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-68b90d40-4788-498b-a4d0-1f6ffe9d43bb None None] MFA Rules not processed for user `66e14c2387334eedbe8cd07fda431ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:44.755086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-68b90d40-4788-498b-a4d0-1f6ffe9d43bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:44.757783 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1018/2054] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:44.759133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b21f0-7b32-4b09-867a-70f27f5cbafa None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.759407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b21f0-7b32-4b09-867a-70f27f5cbafa None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.759666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b21f0-7b32-4b09-867a-70f27f5cbafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.786135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7b7b21f0-7b32-4b09-867a-70f27f5cbafa None None] MFA Rules not processed for user `dc6fbc9974244c0fa37eab885f20c937`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:44.787404 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7b7b21f0-7b32-4b09-867a-70f27f5cbafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:44.825734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1037/2055] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:44.827014 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b90d40-4788-498b-a4d0-1f6ffe9d43bb None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:44.838257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b90d40-4788-498b-a4d0-1f6ffe9d43bb None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:44.838449 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:44.842955 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993470b3-2d0f-4a7e-b0a3-63c43b33bc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:44.844832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993470b3-2d0f-4a7e-b0a3-63c43b33bc37 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.844832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993470b3-2d0f-4a7e-b0a3-63c43b33bc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.844832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993470b3-2d0f-4a7e-b0a3-63c43b33bc37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.844832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993470b3-2d0f-4a7e-b0a3-63c43b33bc37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:44.846855 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993470b3-2d0f-4a7e-b0a3-63c43b33bc37 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:44.857183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1019/2056] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:44.858106 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b21f0-7b32-4b09-867a-70f27f5cbafa None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:44.875554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b21f0-7b32-4b09-867a-70f27f5cbafa None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:44.875554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7098ef8-671f-46b7-b947-3e39f19d3fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:44.875554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7098ef8-671f-46b7-b947-3e39f19d3fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:44.875916 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7098ef8-671f-46b7-b947-3e39f19d3fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:44.876085 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7098ef8-671f-46b7-b947-3e39f19d3fd9 admin admin] PATH_INFO: `/v3/projects/3e4006221f1b4ddda2e54fb2db4f88c9/users/eb6555ff5f3f4823aee38990265d3a29/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:44.890979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7098ef8-671f-46b7-b947-3e39f19d3fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4006221f1b4ddda2e54fb2db4f88c9, user_id=eb6555ff5f3f4823aee38990265d3a29, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:44.894040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7098ef8-671f-46b7-b947-3e39f19d3fd9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:44.932447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1038/2057] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:44 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:44.932447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993470b3-2d0f-4a7e-b0a3-63c43b33bc37 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:44.932447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-993470b3-2d0f-4a7e-b0a3-63c43b33bc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:45.004263 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993470b3-2d0f-4a7e-b0a3-63c43b33bc37 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:45.008731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1020/2058] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:44 2022] PUT /identity/v3/projects/3e4006221f1b4ddda2e54fb2db4f88c9/users/eb6555ff5f3f4823aee38990265d3a29/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:45.013005 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7098ef8-671f-46b7-b947-3e39f19d3fd9 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:45.053597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07195f-9387-4599-803e-ea3971030f66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:45.054256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07195f-9387-4599-803e-ea3971030f66 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:45.054542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07195f-9387-4599-803e-ea3971030f66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:45.054825 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07195f-9387-4599-803e-ea3971030f66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:45.074628 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7098ef8-671f-46b7-b947-3e39f19d3fd9 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:45.079274 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240fbf4-9ccd-4307-be66-4322fc5ea97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:45.116331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240fbf4-9ccd-4307-be66-4322fc5ea97a admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:45.116331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240fbf4-9ccd-4307-be66-4322fc5ea97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:45.116331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240fbf4-9ccd-4307-be66-4322fc5ea97a admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:45.116331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240fbf4-9ccd-4307-be66-4322fc5ea97a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:45.116331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240fbf4-9ccd-4307-be66-4322fc5ea97a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:45.116817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07195f-9387-4599-803e-ea3971030f66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:45.116817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07195f-9387-4599-803e-ea3971030f66 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:45.123077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1039/2059] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:45.123938 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07195f-9387-4599-803e-ea3971030f66 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:45.134216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07195f-9387-4599-803e-ea3971030f66 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:45.139292 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5753969-ca77-4859-ae48-1e5a16531f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:45.139988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753969-ca77-4859-ae48-1e5a16531f13 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:45.140273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753969-ca77-4859-ae48-1e5a16531f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:45.140637 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753969-ca77-4859-ae48-1e5a16531f13 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:45.141455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5753969-ca77-4859-ae48-1e5a16531f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:45.143367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5753969-ca77-4859-ae48-1e5a16531f13 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:45.238168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1021/2060] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:45 2022] POST /identity/v3/projects => generated 399 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:45.238168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3476f00-9e30-4c38-b5b6-ec197fa68056 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:45.238168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3476f00-9e30-4c38-b5b6-ec197fa68056 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:45.238168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3476f00-9e30-4c38-b5b6-ec197fa68056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:45.264755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1040/2061] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:45 2022] POST /identity/v3/users => generated 282 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:45.265065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c3476f00-9e30-4c38-b5b6-ec197fa68056 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:45.266003 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5753969-ca77-4859-ae48-1e5a16531f13 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:45.266134 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c3476f00-9e30-4c38-b5b6-ec197fa68056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:45.277394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5753969-ca77-4859-ae48-1e5a16531f13 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:45.335772 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1022/2062] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:45.342715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19538cba-8ff7-47f4-9fc1-acbe70a95681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:45.343417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538cba-8ff7-47f4-9fc1-acbe70a95681 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:45.343706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538cba-8ff7-47f4-9fc1-acbe70a95681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:45.343990 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538cba-8ff7-47f4-9fc1-acbe70a95681 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:45.344693 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19538cba-8ff7-47f4-9fc1-acbe70a95681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:45.347188 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3476f00-9e30-4c38-b5b6-ec197fa68056 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:45.349825 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19538cba-8ff7-47f4-9fc1-acbe70a95681 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:45.358464 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3476f00-9e30-4c38-b5b6-ec197fa68056 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:45.364693 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4e053-a475-466d-a276-f82f551b43d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:45.365420 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4e053-a475-466d-a276-f82f551b43d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:45.365710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4e053-a475-466d-a276-f82f551b43d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:45.366076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4e053-a475-466d-a276-f82f551b43d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:45.366814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4e053-a475-466d-a276-f82f551b43d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:45.368446 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4e053-a475-466d-a276-f82f551b43d3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:45.399018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1023/2063] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:45.399018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4e053-a475-466d-a276-f82f551b43d3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:45.399018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f5c4e053-a475-466d-a276-f82f551b43d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:45.459844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4e053-a475-466d-a276-f82f551b43d3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:45.463887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59a956-e281-4bae-9ef5-a5e9a9884316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:45.465237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59a956-e281-4bae-9ef5-a5e9a9884316 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:45.465609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59a956-e281-4bae-9ef5-a5e9a9884316 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:45.465896 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59a956-e281-4bae-9ef5-a5e9a9884316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:45.475074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59a956-e281-4bae-9ef5-a5e9a9884316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:45.476512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59a956-e281-4bae-9ef5-a5e9a9884316 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:45.486896 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1024/2064] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:45.487692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59a956-e281-4bae-9ef5-a5e9a9884316 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:45.498335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59a956-e281-4bae-9ef5-a5e9a9884316 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:45.503057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe6489-d4f6-472a-acbf-c1f5a2b3cbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:45.503767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe6489-d4f6-472a-acbf-c1f5a2b3cbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:45.504061 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe6489-d4f6-472a-acbf-c1f5a2b3cbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:45.504342 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe6489-d4f6-472a-acbf-c1f5a2b3cbc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:45.505100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe6489-d4f6-472a-acbf-c1f5a2b3cbc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:45.506700 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe6489-d4f6-472a-acbf-c1f5a2b3cbc5 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:45.517117 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1025/2065] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:45.521047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe6489-d4f6-472a-acbf-c1f5a2b3cbc5 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:45.531371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe6489-d4f6-472a-acbf-c1f5a2b3cbc5 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:45.535981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b66517-b965-4ae4-8131-77a5b9fe24d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:45.536822 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b66517-b965-4ae4-8131-77a5b9fe24d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:45.537156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b66517-b965-4ae4-8131-77a5b9fe24d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:45.537430 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b66517-b965-4ae4-8131-77a5b9fe24d7 admin admin] PATH_INFO: `/v3/projects/67db22e1a82745a7ab4fa935adc06a8c/users/0ef08f46c6254fe6b5bf7b1208b31016/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:45.552087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b66517-b965-4ae4-8131-77a5b9fe24d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67db22e1a82745a7ab4fa935adc06a8c, user_id=0ef08f46c6254fe6b5bf7b1208b31016, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:45.554839 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b66517-b965-4ae4-8131-77a5b9fe24d7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:45.666274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1041/2066] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:45 2022] POST /identity/v3/users => generated 306 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:45.670028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19538cba-8ff7-47f4-9fc1-acbe70a95681 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:45.681400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19538cba-8ff7-47f4-9fc1-acbe70a95681 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:45.687053 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8da54b-b445-4575-be53-42c9a8656891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:45.687836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8da54b-b445-4575-be53-42c9a8656891 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:45.688224 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8da54b-b445-4575-be53-42c9a8656891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:45.688600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8da54b-b445-4575-be53-42c9a8656891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:45.689551 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8da54b-b445-4575-be53-42c9a8656891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:45.691280 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8da54b-b445-4575-be53-42c9a8656891 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:45.702861 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1042/2067] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:47:45.707082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8da54b-b445-4575-be53-42c9a8656891 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:45.720186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8da54b-b445-4575-be53-42c9a8656891 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:45.723149 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1026/2068] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:45 2022] PUT /identity/v3/projects/67db22e1a82745a7ab4fa935adc06a8c/users/0ef08f46c6254fe6b5bf7b1208b31016/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:45.734127 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfeaaf-7c70-409b-9ea2-098e85d2fb81 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:45.734422 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfeaaf-7c70-409b-9ea2-098e85d2fb81 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:45.734707 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfeaaf-7c70-409b-9ea2-098e85d2fb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:45.767687 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-66dfeaaf-7c70-409b-9ea2-098e85d2fb81 None None] MFA Rules not processed for user `0ef08f46c6254fe6b5bf7b1208b31016`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:45.771026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-66dfeaaf-7c70-409b-9ea2-098e85d2fb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:45.794714 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:45.814695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db0d9c-a171-43f0-8f76-faf3fddc2fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:45.815630 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db0d9c-a171-43f0-8f76-faf3fddc2fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:45.815918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db0d9c-a171-43f0-8f76-faf3fddc2fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:45.816205 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db0d9c-a171-43f0-8f76-faf3fddc2fbb admin admin] PATH_INFO: `/v3/projects/95a4821c21324d11ae697c8f7ed58f0f/users/7d4917df69574e76a3d1452eee55195d/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:45.832536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db0d9c-a171-43f0-8f76-faf3fddc2fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a4821c21324d11ae697c8f7ed58f0f, user_id=7d4917df69574e76a3d1452eee55195d, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:45.835474 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db0d9c-a171-43f0-8f76-faf3fddc2fbb admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:45.859845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1027/2069] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:45.864268 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfeaaf-7c70-409b-9ea2-098e85d2fb81 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:45.875326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfeaaf-7c70-409b-9ea2-098e85d2fb81 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:45.879942 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961cd54-b906-45d6-aacd-5102e7cda665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:45.880600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961cd54-b906-45d6-aacd-5102e7cda665 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:45.880885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961cd54-b906-45d6-aacd-5102e7cda665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:45.881202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961cd54-b906-45d6-aacd-5102e7cda665 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:45.881892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961cd54-b906-45d6-aacd-5102e7cda665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:45.883798 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961cd54-b906-45d6-aacd-5102e7cda665 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:45.928198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:45.988406 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1043/2070] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:45 2022] PUT /identity/v3/projects/95a4821c21324d11ae697c8f7ed58f0f/users/7d4917df69574e76a3d1452eee55195d/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:45.992132 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db0d9c-a171-43f0-8f76-faf3fddc2fbb admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:46.039826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1028/2071] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:47:45 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:46.041202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961cd54-b906-45d6-aacd-5102e7cda665 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:46.062211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db0d9c-a171-43f0-8f76-faf3fddc2fbb admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:46.112568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961cd54-b906-45d6-aacd-5102e7cda665 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:46.117366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c81bb-7117-4532-829a-b2a1e2142e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:46.118015 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c81bb-7117-4532-829a-b2a1e2142e0a admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:46.118296 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c81bb-7117-4532-829a-b2a1e2142e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:46.118575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c81bb-7117-4532-829a-b2a1e2142e0a admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:46.119258 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c81bb-7117-4532-829a-b2a1e2142e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:46.121792 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c81bb-7117-4532-829a-b2a1e2142e0a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:46.123097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a70049-06ac-4f52-a91b-aa3aa4a34516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:46.123779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a70049-06ac-4f52-a91b-aa3aa4a34516 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:46.124066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a70049-06ac-4f52-a91b-aa3aa4a34516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:46.124348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a70049-06ac-4f52-a91b-aa3aa4a34516 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:46.125116 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a70049-06ac-4f52-a91b-aa3aa4a34516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:46.126722 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a70049-06ac-4f52-a91b-aa3aa4a34516 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:46.137518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1044/2072] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:46.141561 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a70049-06ac-4f52-a91b-aa3aa4a34516 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:46.150959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a70049-06ac-4f52-a91b-aa3aa4a34516 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:46.156009 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eadc4a-f7cf-4217-8125-0c88b1104b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:46.156888 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eadc4a-f7cf-4217-8125-0c88b1104b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:46.157328 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eadc4a-f7cf-4217-8125-0c88b1104b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:46.157575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eadc4a-f7cf-4217-8125-0c88b1104b92 admin admin] PATH_INFO: `/v3/projects/95a4821c21324d11ae697c8f7ed58f0f/users/7d4917df69574e76a3d1452eee55195d/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:46.159535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eadc4a-f7cf-4217-8125-0c88b1104b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a4821c21324d11ae697c8f7ed58f0f, user_id=7d4917df69574e76a3d1452eee55195d, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:46.162448 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eadc4a-f7cf-4217-8125-0c88b1104b92 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:46.184243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1045/2073] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:46 2022] PUT /identity/v3/projects/95a4821c21324d11ae697c8f7ed58f0f/users/7d4917df69574e76a3d1452eee55195d/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:46.193227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16055db6-9151-4b58-92e1-2ae88ee9b29b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:46.193517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16055db6-9151-4b58-92e1-2ae88ee9b29b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:46.193796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16055db6-9151-4b58-92e1-2ae88ee9b29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:46.222999 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-16055db6-9151-4b58-92e1-2ae88ee9b29b None None] MFA Rules not processed for user `7d4917df69574e76a3d1452eee55195d`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:46.224220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-16055db6-9151-4b58-92e1-2ae88ee9b29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:46.236010 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1029/2074] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:47:46 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:47:46.243663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c81bb-7117-4532-829a-b2a1e2142e0a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:46.255538 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c81bb-7117-4532-829a-b2a1e2142e0a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:46.310540 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1046/2075] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:46 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:47:46.322144 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16055db6-9151-4b58-92e1-2ae88ee9b29b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:46.322331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38de2f-e5df-4c50-83ba-2d2171c1405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:46.323157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38de2f-e5df-4c50-83ba-2d2171c1405d admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:46.323586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38de2f-e5df-4c50-83ba-2d2171c1405d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:46.324158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38de2f-e5df-4c50-83ba-2d2171c1405d admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:46.325208 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38de2f-e5df-4c50-83ba-2d2171c1405d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:46.326957 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38de2f-e5df-4c50-83ba-2d2171c1405d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:46.341106 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1030/2076] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:47:46.353094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38de2f-e5df-4c50-83ba-2d2171c1405d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:46.374525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38de2f-e5df-4c50-83ba-2d2171c1405d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:46.396248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609062e0-0e10-46af-b0d8-4815da5218df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:46.397217 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609062e0-0e10-46af-b0d8-4815da5218df admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:46.397501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609062e0-0e10-46af-b0d8-4815da5218df admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:46.397782 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609062e0-0e10-46af-b0d8-4815da5218df admin admin] PATH_INFO: `/v3/projects/4e0430437460442fae71c1e9649d1b7f/users/cb9306c73bcc4aadbc8df2c24c6e2e14/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:46.401011 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16055db6-9151-4b58-92e1-2ae88ee9b29b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:46.405486 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572403ec-61b7-400a-ae23-3dfa38fe4d27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:46.406145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572403ec-61b7-400a-ae23-3dfa38fe4d27 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:46.406433 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572403ec-61b7-400a-ae23-3dfa38fe4d27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:46.407227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572403ec-61b7-400a-ae23-3dfa38fe4d27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:46.413423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609062e0-0e10-46af-b0d8-4815da5218df admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0430437460442fae71c1e9649d1b7f, user_id=cb9306c73bcc4aadbc8df2c24c6e2e14, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:46.416158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609062e0-0e10-46af-b0d8-4815da5218df admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:46.418563 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572403ec-61b7-400a-ae23-3dfa38fe4d27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:46.420115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572403ec-61b7-400a-ae23-3dfa38fe4d27 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:46.431822 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1047/2077] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:46 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:47:46.548602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1031/2078] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:46 2022] PUT /identity/v3/projects/4e0430437460442fae71c1e9649d1b7f/users/cb9306c73bcc4aadbc8df2c24c6e2e14/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:46.552642 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572403ec-61b7-400a-ae23-3dfa38fe4d27 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:46.570427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572403ec-61b7-400a-ae23-3dfa38fe4d27 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:46.642583 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bc085-3e24-4f32-92a0-dde54e6b88b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:46.643393 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bc085-3e24-4f32-92a0-dde54e6b88b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:46.643745 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bc085-3e24-4f32-92a0-dde54e6b88b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:46.644123 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bc085-3e24-4f32-92a0-dde54e6b88b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:46.644923 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bc085-3e24-4f32-92a0-dde54e6b88b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:46.646682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bc085-3e24-4f32-92a0-dde54e6b88b7 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:46.658188 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1048/2079] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:47:46.667226 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609062e0-0e10-46af-b0d8-4815da5218df admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:46.678218 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bc085-3e24-4f32-92a0-dde54e6b88b7 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:46.678552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609062e0-0e10-46af-b0d8-4815da5218df admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:46.683843 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f7513-97b6-4bf4-b2b7-ee7bac41c55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:46.684803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f7513-97b6-4bf4-b2b7-ee7bac41c55b admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:46.685079 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f7513-97b6-4bf4-b2b7-ee7bac41c55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:46.685361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f7513-97b6-4bf4-b2b7-ee7bac41c55b admin admin] PATH_INFO: `/v3/projects/4e0430437460442fae71c1e9649d1b7f/users/cb9306c73bcc4aadbc8df2c24c6e2e14/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:46.687691 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f7513-97b6-4bf4-b2b7-ee7bac41c55b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0430437460442fae71c1e9649d1b7f, user_id=cb9306c73bcc4aadbc8df2c24c6e2e14, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:46.690370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:46.690533 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f7513-97b6-4bf4-b2b7-ee7bac41c55b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:46.701234 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1032/2080] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:47:46 2022] PUT /identity/v3/projects/4e0430437460442fae71c1e9649d1b7f/users/cb9306c73bcc4aadbc8df2c24c6e2e14/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:46.717497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e786de-6fcd-477e-a7e4-fed9b74c2ab2 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:46.717925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e786de-6fcd-477e-a7e4-fed9b74c2ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:46.718342 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e786de-6fcd-477e-a7e4-fed9b74c2ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:46.737681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bc085-3e24-4f32-92a0-dde54e6b88b7 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:46.755762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-78e786de-6fcd-477e-a7e4-fed9b74c2ab2 None None] MFA Rules not processed for user `cb9306c73bcc4aadbc8df2c24c6e2e14`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:46.757031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-78e786de-6fcd-477e-a7e4-fed9b74c2ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:46.796397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e768d-27be-4b8d-8f56-9c6ee0ce678c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:46.797309 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e768d-27be-4b8d-8f56-9c6ee0ce678c service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:46.797509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e768d-27be-4b8d-8f56-9c6ee0ce678c service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:46.797746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e768d-27be-4b8d-8f56-9c6ee0ce678c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:46.823402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:46.836660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1033/2081] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:47:46.848908 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e786de-6fcd-477e-a7e4-fed9b74c2ab2 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:46.850365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-78e786de-6fcd-477e-a7e4-fed9b74c2ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:46.860058 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e768d-27be-4b8d-8f56-9c6ee0ce678c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:46.861524 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e768d-27be-4b8d-8f56-9c6ee0ce678c service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:46.862768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e786de-6fcd-477e-a7e4-fed9b74c2ab2 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:46.866645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11550f3-595c-4dab-9567-65cc2e93c319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:46.867315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11550f3-595c-4dab-9567-65cc2e93c319 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:46.867607 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11550f3-595c-4dab-9567-65cc2e93c319 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:46.867892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11550f3-595c-4dab-9567-65cc2e93c319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:46.871450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1049/2082] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:47:46.878302 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11550f3-595c-4dab-9567-65cc2e93c319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:46.879893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11550f3-595c-4dab-9567-65cc2e93c319 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:46.892080 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1034/2083] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:47:47.142790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:47.148259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e768d-27be-4b8d-8f56-9c6ee0ce678c service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:47.158141 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e768d-27be-4b8d-8f56-9c6ee0ce678c service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:47.162866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1e5b1-97d9-4ad6-887c-4d69677377b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:47.168345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1e5b1-97d9-4ad6-887c-4d69677377b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:47.168345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1e5b1-97d9-4ad6-887c-4d69677377b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:47.168345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1e5b1-97d9-4ad6-887c-4d69677377b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:47.227539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1e5b1-97d9-4ad6-887c-4d69677377b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:47.228955 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1e5b1-97d9-4ad6-887c-4d69677377b9 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:47.238663 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1050/2084] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:47 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:47:47.315083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:47.614537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:47.757320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:48.296481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:48.633769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:50.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:51.211517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:51.836035 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fa267-a89b-446a-b728-3290894b1f45 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:51.836539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fa267-a89b-446a-b728-3290894b1f45 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:51.836629 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fa267-a89b-446a-b728-3290894b1f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:51.874362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-625fa267-a89b-446a-b728-3290894b1f45 None None] MFA Rules not processed for user `eb6555ff5f3f4823aee38990265d3a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:51.875597 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-625fa267-a89b-446a-b728-3290894b1f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:51.945542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:51.951771 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1035/2085] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:51.967180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1e5b1-97d9-4ad6-887c-4d69677377b9 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:51.968613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-30c1e5b1-97d9-4ad6-887c-4d69677377b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:52.050052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1e5b1-97d9-4ad6-887c-4d69677377b9 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:52.055774 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7b68c-ef78-4b46-bece-cf157487c1c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:52.056423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7b68c-ef78-4b46-bece-cf157487c1c8 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:52.056713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7b68c-ef78-4b46-bece-cf157487c1c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:52.057028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7b68c-ef78-4b46-bece-cf157487c1c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:52.066066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7b68c-ef78-4b46-bece-cf157487c1c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:52.068154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7b68c-ef78-4b46-bece-cf157487c1c8 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:52.078981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1051/2086] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:55.032227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e43ff3-7061-4702-bec2-c15f8aa943cf None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:55.032742 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e43ff3-7061-4702-bec2-c15f8aa943cf None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:55.032931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e43ff3-7061-4702-bec2-c15f8aa943cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:55.060062 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e5e43ff3-7061-4702-bec2-c15f8aa943cf None None] MFA Rules not processed for user `eb6555ff5f3f4823aee38990265d3a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:55.062214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e5e43ff3-7061-4702-bec2-c15f8aa943cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:55.070949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1036/2087] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:47:57.082336 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7b68c-ef78-4b46-bece-cf157487c1c8 service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:57.179862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:57.196439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7b68c-ef78-4b46-bece-cf157487c1c8 service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:57.201841 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ac7b5-230d-412a-b20d-da01ecd4706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:57.202768 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ac7b5-230d-412a-b20d-da01ecd4706a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:57.203051 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ac7b5-230d-412a-b20d-da01ecd4706a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:57.203329 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ac7b5-230d-412a-b20d-da01ecd4706a admin admin] PATH_INFO: `/v3/users/dc6fbc9974244c0fa37eab885f20c937` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:57.204536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ac7b5-230d-412a-b20d-da01ecd4706a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6fbc9974244c0fa37eab885f20c937)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:57.206668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ac7b5-230d-412a-b20d-da01ecd4706a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:57.489531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ae1ac7b5-230d-412a-b20d-da01ecd4706a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6fbc9974244c0fa37eab885f20c937'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:57.657842 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ae1ac7b5-230d-412a-b20d-da01ecd4706a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6fbc9974244c0fa37eab885f20c937'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:57.664113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ae1ac7b5-230d-412a-b20d-da01ecd4706a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6fbc9974244c0fa37eab885f20c937'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:57.668232 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ae1ac7b5-230d-412a-b20d-da01ecd4706a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6fbc9974244c0fa37eab885f20c937'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:57.677941 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ae1ac7b5-230d-412a-b20d-da01ecd4706a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6fbc9974244c0fa37eab885f20c937'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:57.683908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1052/2088] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:57 2022] DELETE /identity/v3/users/dc6fbc9974244c0fa37eab885f20c937 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:47:57.689095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f00a1-23f4-42cd-9db4-4b9baec73a0f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:57.689580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f00a1-23f4-42cd-9db4-4b9baec73a0f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:57.689659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f00a1-23f4-42cd-9db4-4b9baec73a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:57.707520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a88f00a1-23f4-42cd-9db4-4b9baec73a0f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:57.708738 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a88f00a1-23f4-42cd-9db4-4b9baec73a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:57.770436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1037/2089] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:47:57.780780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ac7b5-230d-412a-b20d-da01ecd4706a admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:57.782444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ae1ac7b5-230d-412a-b20d-da01ecd4706a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:57.850462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ac7b5-230d-412a-b20d-da01ecd4706a admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:57.854108 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901652db-8155-4f1a-a43c-51820a1cd513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:57.854860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901652db-8155-4f1a-a43c-51820a1cd513 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:57.855143 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901652db-8155-4f1a-a43c-51820a1cd513 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:57.855416 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901652db-8155-4f1a-a43c-51820a1cd513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:57.865025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901652db-8155-4f1a-a43c-51820a1cd513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:57.866580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901652db-8155-4f1a-a43c-51820a1cd513 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:57.877321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1053/2090] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:47:58.402152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f00a1-23f4-42cd-9db4-4b9baec73a0f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:58.403642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a88f00a1-23f4-42cd-9db4-4b9baec73a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:58.417109 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f00a1-23f4-42cd-9db4-4b9baec73a0f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:58.421402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:58.422272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:58.422562 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:58.422838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a admin admin] PATH_INFO: `/v3/projects/03fac7708af141099a315b44ce5293e9` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:58.424255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03fac7708af141099a315b44ce5293e9)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:58.426211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:58.560856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03fac7708af141099a315b44ce5293e9', 'request_id': 'req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:58.567594 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03fac7708af141099a315b44ce5293e9', 'request_id': 'req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:58.730114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03fac7708af141099a315b44ce5293e9', 'request_id': 'req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:58.743863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a admin admin] The token cache is being invalidate because project 03fac7708af141099a315b44ce5293e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:47:58.744154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:58.744868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:58.746927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1038/2091] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:58 2022] DELETE /identity/v3/projects/03fac7708af141099a315b44ce5293e9 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:58.751100 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901652db-8155-4f1a-a43c-51820a1cd513 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:58.765971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901652db-8155-4f1a-a43c-51820a1cd513 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:58.851396 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e500c4f-e751-4c6a-b20f-e4710f4af5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:58.852320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e500c4f-e751-4c6a-b20f-e4710f4af5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:58.852568 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e500c4f-e751-4c6a-b20f-e4710f4af5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:58.852845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e500c4f-e751-4c6a-b20f-e4710f4af5c8 admin admin] PATH_INFO: `/v3/users/7d4917df69574e76a3d1452eee55195d` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:58.854138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e500c4f-e751-4c6a-b20f-e4710f4af5c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d4917df69574e76a3d1452eee55195d)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:58.856873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e500c4f-e751-4c6a-b20f-e4710f4af5c8 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:58.883542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:59.067913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0e500c4f-e751-4c6a-b20f-e4710f4af5c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d4917df69574e76a3d1452eee55195d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:59.193246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0e500c4f-e751-4c6a-b20f-e4710f4af5c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d4917df69574e76a3d1452eee55195d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:59.208105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0e500c4f-e751-4c6a-b20f-e4710f4af5c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d4917df69574e76a3d1452eee55195d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:59.209323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0e500c4f-e751-4c6a-b20f-e4710f4af5c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d4917df69574e76a3d1452eee55195d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:59.229654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:59.232096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:59.233263 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-0e500c4f-e751-4c6a-b20f-e4710f4af5c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d4917df69574e76a3d1452eee55195d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:59.242280 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1054/2092] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:58 2022] DELETE /identity/v3/users/7d4917df69574e76a3d1452eee55195d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:59.250150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e4ae7-c37c-4867-8290-0b1a142c0c0a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:59.313172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de489b-b1ca-4813-9eb7-5106f3ec50f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:59.314121 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de489b-b1ca-4813-9eb7-5106f3ec50f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:59.314595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de489b-b1ca-4813-9eb7-5106f3ec50f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:59.314950 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de489b-b1ca-4813-9eb7-5106f3ec50f6 admin admin] PATH_INFO: `/v3/users/0ef08f46c6254fe6b5bf7b1208b31016` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:59.316223 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de489b-b1ca-4813-9eb7-5106f3ec50f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef08f46c6254fe6b5bf7b1208b31016)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:59.318351 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de489b-b1ca-4813-9eb7-5106f3ec50f6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:59.352832 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:47:59.515906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-92de489b-b1ca-4813-9eb7-5106f3ec50f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef08f46c6254fe6b5bf7b1208b31016'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:59.596403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-92de489b-b1ca-4813-9eb7-5106f3ec50f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef08f46c6254fe6b5bf7b1208b31016'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:59.607746 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-92de489b-b1ca-4813-9eb7-5106f3ec50f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef08f46c6254fe6b5bf7b1208b31016'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:59.608638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-92de489b-b1ca-4813-9eb7-5106f3ec50f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef08f46c6254fe6b5bf7b1208b31016'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:59.629570 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-92de489b-b1ca-4813-9eb7-5106f3ec50f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef08f46c6254fe6b5bf7b1208b31016'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:47:59.646166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1039/2093] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:59 2022] DELETE /identity/v3/users/0ef08f46c6254fe6b5bf7b1208b31016 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:47:59.648077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fee14e-a34b-40a0-a550-ccaf045f92fd None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:59.648843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fee14e-a34b-40a0-a550-ccaf045f92fd None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:59.648843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fee14e-a34b-40a0-a550-ccaf045f92fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:59.675779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-57fee14e-a34b-40a0-a550-ccaf045f92fd None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:47:59.675779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-57fee14e-a34b-40a0-a550-ccaf045f92fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:59.761702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1055/2094] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:47:59.771319 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de489b-b1ca-4813-9eb7-5106f3ec50f6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:59.773474 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fee14e-a34b-40a0-a550-ccaf045f92fd None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:59.773591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-92de489b-b1ca-4813-9eb7-5106f3ec50f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:59.773870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-57fee14e-a34b-40a0-a550-ccaf045f92fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:59.785702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de489b-b1ca-4813-9eb7-5106f3ec50f6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:59.790331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c20983-57d8-4159-b2ad-36a2db99d2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:59.791225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20983-57d8-4159-b2ad-36a2db99d2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:59.791503 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20983-57d8-4159-b2ad-36a2db99d2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:59.791775 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20983-57d8-4159-b2ad-36a2db99d2ed admin admin] PATH_INFO: `/v3/users/97b0709b4999468eab06708dad660d7d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:59.792957 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c20983-57d8-4159-b2ad-36a2db99d2ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b0709b4999468eab06708dad660d7d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:59.795442 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c20983-57d8-4159-b2ad-36a2db99d2ed admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:59.842395 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fee14e-a34b-40a0-a550-ccaf045f92fd None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:59.847051 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab576739-65ef-41c3-8a69-083a82d42c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:59.847827 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab576739-65ef-41c3-8a69-083a82d42c5d service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:59.848094 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab576739-65ef-41c3-8a69-083a82d42c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:59.848376 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab576739-65ef-41c3-8a69-083a82d42c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:59.858615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab576739-65ef-41c3-8a69-083a82d42c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:59.860306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab576739-65ef-41c3-8a69-083a82d42c5d service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:59.871408 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1056/2095] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:47:59.872147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab576739-65ef-41c3-8a69-083a82d42c5d service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:47:59.873708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ab576739-65ef-41c3-8a69-083a82d42c5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:47:59.900716 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab576739-65ef-41c3-8a69-083a82d42c5d service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:47:59.907592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9dee6-26dd-4f60-976b-52fbaa8b5fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:47:59.909660 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9dee6-26dd-4f60-976b-52fbaa8b5fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:47:59.909955 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9dee6-26dd-4f60-976b-52fbaa8b5fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:47:59.910250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9dee6-26dd-4f60-976b-52fbaa8b5fc3 admin admin] PATH_INFO: `/v3/projects/95a4821c21324d11ae697c8f7ed58f0f` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:47:59.911683 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9dee6-26dd-4f60-976b-52fbaa8b5fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a4821c21324d11ae697c8f7ed58f0f)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:47:59.914410 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9dee6-26dd-4f60-976b-52fbaa8b5fc3 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:47:59.993617 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b2c20983-57d8-4159-b2ad-36a2db99d2ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b0709b4999468eab06708dad660d7d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.046188 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:00.065125 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-44b9dee6-26dd-4f60-976b-52fbaa8b5fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a4821c21324d11ae697c8f7ed58f0f', 'request_id': 'req-44b9dee6-26dd-4f60-976b-52fbaa8b5fc3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.072292 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-44b9dee6-26dd-4f60-976b-52fbaa8b5fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a4821c21324d11ae697c8f7ed58f0f', 'request_id': 'req-44b9dee6-26dd-4f60-976b-52fbaa8b5fc3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.078544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b2c20983-57d8-4159-b2ad-36a2db99d2ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b0709b4999468eab06708dad660d7d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.087112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b2c20983-57d8-4159-b2ad-36a2db99d2ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b0709b4999468eab06708dad660d7d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.088539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b2c20983-57d8-4159-b2ad-36a2db99d2ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b0709b4999468eab06708dad660d7d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.117504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b2c20983-57d8-4159-b2ad-36a2db99d2ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b0709b4999468eab06708dad660d7d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.125039 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1040/2096] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:47:59 2022] DELETE /identity/v3/users/97b0709b4999468eab06708dad660d7d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:00.126140 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c20983-57d8-4159-b2ad-36a2db99d2ed admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:00.129538 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b2c20983-57d8-4159-b2ad-36a2db99d2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:00.179227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-44b9dee6-26dd-4f60-976b-52fbaa8b5fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a4821c21324d11ae697c8f7ed58f0f', 'request_id': 'req-44b9dee6-26dd-4f60-976b-52fbaa8b5fc3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.193865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-44b9dee6-26dd-4f60-976b-52fbaa8b5fc3 admin admin] The token cache is being invalidate because project 95a4821c21324d11ae697c8f7ed58f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:48:00.193865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-44b9dee6-26dd-4f60-976b-52fbaa8b5fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.194487 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-44b9dee6-26dd-4f60-976b-52fbaa8b5fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.196458 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1057/2097] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:47:59 2022] DELETE /identity/v3/projects/95a4821c21324d11ae697c8f7ed58f0f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:00.197969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864404b-5e3b-48f8-90b1-f0cd7c3f4b2d None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:00.198324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864404b-5e3b-48f8-90b1-f0cd7c3f4b2d None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:00.198669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864404b-5e3b-48f8-90b1-f0cd7c3f4b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:00.208002 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c20983-57d8-4159-b2ad-36a2db99d2ed admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:00.214899 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78137c7e-0083-46c1-932b-b68f32a02503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:00.216761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78137c7e-0083-46c1-932b-b68f32a02503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:00.217238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78137c7e-0083-46c1-932b-b68f32a02503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:00.217677 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78137c7e-0083-46c1-932b-b68f32a02503 admin admin] PATH_INFO: `/v3/users/66e14c2387334eedbe8cd07fda431ac0` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:00.219636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-9864404b-5e3b-48f8-90b1-f0cd7c3f4b2d None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:00.220170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78137c7e-0083-46c1-932b-b68f32a02503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e14c2387334eedbe8cd07fda431ac0)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:00.221016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-9864404b-5e3b-48f8-90b1-f0cd7c3f4b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:00.222469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78137c7e-0083-46c1-932b-b68f32a02503 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:00.238101 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1058/2098] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:00.239585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea1a07-5255-4e61-85e2-6e2d4a73adff None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:00.239900 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea1a07-5255-4e61-85e2-6e2d4a73adff None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:00.240174 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea1a07-5255-4e61-85e2-6e2d4a73adff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:00.242186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:00.277225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-87ea1a07-5255-4e61-85e2-6e2d4a73adff None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:00.279213 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-87ea1a07-5255-4e61-85e2-6e2d4a73adff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:00.295296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1059/2099] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:00.295296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea1a07-5255-4e61-85e2-6e2d4a73adff None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:00.295296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-87ea1a07-5255-4e61-85e2-6e2d4a73adff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:00.364605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea1a07-5255-4e61-85e2-6e2d4a73adff None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:00.368691 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae837fe-b8e6-47c7-8ff4-baee39c9b615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:00.369455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae837fe-b8e6-47c7-8ff4-baee39c9b615 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:00.369930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae837fe-b8e6-47c7-8ff4-baee39c9b615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:00.370289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae837fe-b8e6-47c7-8ff4-baee39c9b615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:00.380442 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae837fe-b8e6-47c7-8ff4-baee39c9b615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:00.382029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae837fe-b8e6-47c7-8ff4-baee39c9b615 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:00.395580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1060/2100] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:48:00.396977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60daab-13f9-4ddd-b030-9dec672285c9 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:00.397294 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60daab-13f9-4ddd-b030-9dec672285c9 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:00.397574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60daab-13f9-4ddd-b030-9dec672285c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:00.417694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-cc60daab-13f9-4ddd-b030-9dec672285c9 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:00.419818 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-cc60daab-13f9-4ddd-b030-9dec672285c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:00.428601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1061/2101] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:00.433494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60daab-13f9-4ddd-b030-9dec672285c9 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:00.443053 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60daab-13f9-4ddd-b030-9dec672285c9 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:00.447840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f066f-3f0c-493c-8e97-3e8467367b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:00.448785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f066f-3f0c-493c-8e97-3e8467367b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:00.449100 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f066f-3f0c-493c-8e97-3e8467367b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:00.449377 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f066f-3f0c-493c-8e97-3e8467367b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:00.450914 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f066f-3f0c-493c-8e97-3e8467367b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:48:00.451236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f066f-3f0c-493c-8e97-3e8467367b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:00.452818 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f066f-3f0c-493c-8e97-3e8467367b9c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:00.466158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1062/2102] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:48:00.470406 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f066f-3f0c-493c-8e97-3e8467367b9c admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:00.480285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f066f-3f0c-493c-8e97-3e8467367b9c admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:00.485136 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41add8-6206-4e18-96d6-9853ee3d77fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:00.485998 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41add8-6206-4e18-96d6-9853ee3d77fd admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:00.486466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41add8-6206-4e18-96d6-9853ee3d77fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:00.486746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41add8-6206-4e18-96d6-9853ee3d77fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:00.487445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41add8-6206-4e18-96d6-9853ee3d77fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:00.489629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41add8-6206-4e18-96d6-9853ee3d77fd admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:00.508089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-78137c7e-0083-46c1-932b-b68f32a02503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e14c2387334eedbe8cd07fda431ac0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.592220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1063/2103] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:48:00 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:48:00.592220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41add8-6206-4e18-96d6-9853ee3d77fd admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:00.592220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-de41add8-6206-4e18-96d6-9853ee3d77fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:00.611286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-78137c7e-0083-46c1-932b-b68f32a02503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e14c2387334eedbe8cd07fda431ac0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.623800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-78137c7e-0083-46c1-932b-b68f32a02503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e14c2387334eedbe8cd07fda431ac0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.624953 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-78137c7e-0083-46c1-932b-b68f32a02503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e14c2387334eedbe8cd07fda431ac0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.640862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-78137c7e-0083-46c1-932b-b68f32a02503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e14c2387334eedbe8cd07fda431ac0'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.648081 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1041/2104] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:48:00 2022] DELETE /identity/v3/users/66e14c2387334eedbe8cd07fda431ac0 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:00.649123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78137c7e-0083-46c1-932b-b68f32a02503 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:00.650665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-78137c7e-0083-46c1-932b-b68f32a02503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:00.668080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41add8-6206-4e18-96d6-9853ee3d77fd admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:00.729337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78137c7e-0083-46c1-932b-b68f32a02503 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:00.739418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8111299-d3ec-4103-81fb-d35524f0857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:00.740125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8111299-d3ec-4103-81fb-d35524f0857b admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:00.740420 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8111299-d3ec-4103-81fb-d35524f0857b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:00.740705 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8111299-d3ec-4103-81fb-d35524f0857b admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:00.741500 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8111299-d3ec-4103-81fb-d35524f0857b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:00.742615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c83b40-9389-47be-8f5b-1db1a32d73d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:00.743537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8111299-d3ec-4103-81fb-d35524f0857b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:00.743709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c83b40-9389-47be-8f5b-1db1a32d73d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:00.744375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c83b40-9389-47be-8f5b-1db1a32d73d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:00.744669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c83b40-9389-47be-8f5b-1db1a32d73d0 admin admin] PATH_INFO: `/v3/projects/67db22e1a82745a7ab4fa935adc06a8c` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:00.746053 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c83b40-9389-47be-8f5b-1db1a32d73d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67db22e1a82745a7ab4fa935adc06a8c)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:00.748204 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c83b40-9389-47be-8f5b-1db1a32d73d0 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:00.884569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1042/2105] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:48:00 2022] POST /identity/v3/users => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:00.886190 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56822e1-32cb-4a1e-b577-82ff34822279 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:00.888782 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56822e1-32cb-4a1e-b577-82ff34822279 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:00.890034 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56822e1-32cb-4a1e-b577-82ff34822279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:00.904196 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-88c83b40-9389-47be-8f5b-1db1a32d73d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67db22e1a82745a7ab4fa935adc06a8c', 'request_id': 'req-88c83b40-9389-47be-8f5b-1db1a32d73d0'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.913026 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-88c83b40-9389-47be-8f5b-1db1a32d73d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67db22e1a82745a7ab4fa935adc06a8c', 'request_id': 'req-88c83b40-9389-47be-8f5b-1db1a32d73d0'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:00.917661 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c56822e1-32cb-4a1e-b577-82ff34822279 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:00.918714 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c56822e1-32cb-4a1e-b577-82ff34822279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:00.997884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-88c83b40-9389-47be-8f5b-1db1a32d73d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67db22e1a82745a7ab4fa935adc06a8c', 'request_id': 'req-88c83b40-9389-47be-8f5b-1db1a32d73d0'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:01.008230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1043/2106] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:01.012650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56822e1-32cb-4a1e-b577-82ff34822279 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:01.015282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-88c83b40-9389-47be-8f5b-1db1a32d73d0 admin admin] The token cache is being invalidate because project 67db22e1a82745a7ab4fa935adc06a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:48:01.015679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-88c83b40-9389-47be-8f5b-1db1a32d73d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:01.016440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-88c83b40-9389-47be-8f5b-1db1a32d73d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:01.018475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1064/2107] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:48:00 2022] DELETE /identity/v3/projects/67db22e1a82745a7ab4fa935adc06a8c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:01.022138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c83b40-9389-47be-8f5b-1db1a32d73d0 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:01.023633 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-88c83b40-9389-47be-8f5b-1db1a32d73d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:01.024273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56822e1-32cb-4a1e-b577-82ff34822279 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:01.031397 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45582652-afdc-4141-82fe-92ebc177bd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:01.032143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45582652-afdc-4141-82fe-92ebc177bd86 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:01.032429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45582652-afdc-4141-82fe-92ebc177bd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:01.032705 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45582652-afdc-4141-82fe-92ebc177bd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:01.033500 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45582652-afdc-4141-82fe-92ebc177bd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:01.035303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45582652-afdc-4141-82fe-92ebc177bd86 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:01.046777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1044/2108] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:01.048292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45582652-afdc-4141-82fe-92ebc177bd86 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:01.050312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-45582652-afdc-4141-82fe-92ebc177bd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:01.084278 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45582652-afdc-4141-82fe-92ebc177bd86 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:01.107308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c83b40-9389-47be-8f5b-1db1a32d73d0 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:01.114367 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706f9d8-97ff-4a57-a8ce-5087f8581f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:01.115300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706f9d8-97ff-4a57-a8ce-5087f8581f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:01.115586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706f9d8-97ff-4a57-a8ce-5087f8581f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:01.115852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706f9d8-97ff-4a57-a8ce-5087f8581f09 admin admin] PATH_INFO: `/v3/users/cb9306c73bcc4aadbc8df2c24c6e2e14` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:01.117152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706f9d8-97ff-4a57-a8ce-5087f8581f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9306c73bcc4aadbc8df2c24c6e2e14)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:01.119076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706f9d8-97ff-4a57-a8ce-5087f8581f09 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:01.124367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c2abd-521b-4b56-98cb-44aac2eb1c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:01.125679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c2abd-521b-4b56-98cb-44aac2eb1c49 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:01.125993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c2abd-521b-4b56-98cb-44aac2eb1c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:01.126275 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c2abd-521b-4b56-98cb-44aac2eb1c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:01.128414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-cc7c2abd-521b-4b56-98cb-44aac2eb1c49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:01.142809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c2abd-521b-4b56-98cb-44aac2eb1c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:01.144769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c2abd-521b-4b56-98cb-44aac2eb1c49 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:01.154744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1065/2109] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:48:01.155499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c2abd-521b-4b56-98cb-44aac2eb1c49 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:01.156783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-cc7c2abd-521b-4b56-98cb-44aac2eb1c49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:01.168465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c2abd-521b-4b56-98cb-44aac2eb1c49 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:01.173460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7aac7-949e-4c8e-8f92-0da602664478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:01.174203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7aac7-949e-4c8e-8f92-0da602664478 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:01.174494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7aac7-949e-4c8e-8f92-0da602664478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:01.174775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7aac7-949e-4c8e-8f92-0da602664478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:01.179012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7aac7-949e-4c8e-8f92-0da602664478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:01.179012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7aac7-949e-4c8e-8f92-0da602664478 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:01.187961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1066/2110] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:01.188860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7aac7-949e-4c8e-8f92-0da602664478 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:01.190653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8ba7aac7-949e-4c8e-8f92-0da602664478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:01.205592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7aac7-949e-4c8e-8f92-0da602664478 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:01.207838 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:01.218346 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe014636-f608-4c2f-bfcb-5bcf68ea70bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:01.219235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe014636-f608-4c2f-bfcb-5bcf68ea70bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:01.219519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe014636-f608-4c2f-bfcb-5bcf68ea70bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:01.219799 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe014636-f608-4c2f-bfcb-5bcf68ea70bb admin admin] PATH_INFO: `/v3/projects/e09020c080d648dea21f96d3591c8a16` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:01.221026 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe014636-f608-4c2f-bfcb-5bcf68ea70bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09020c080d648dea21f96d3591c8a16)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:01.222978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe014636-f608-4c2f-bfcb-5bcf68ea70bb admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:01.402759 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c706f9d8-97ff-4a57-a8ce-5087f8581f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9306c73bcc4aadbc8df2c24c6e2e14'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:01.408388 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-fe014636-f608-4c2f-bfcb-5bcf68ea70bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09020c080d648dea21f96d3591c8a16', 'request_id': 'req-fe014636-f608-4c2f-bfcb-5bcf68ea70bb'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:01.416209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-fe014636-f608-4c2f-bfcb-5bcf68ea70bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09020c080d648dea21f96d3591c8a16', 'request_id': 'req-fe014636-f608-4c2f-bfcb-5bcf68ea70bb'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:01.467497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c706f9d8-97ff-4a57-a8ce-5087f8581f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9306c73bcc4aadbc8df2c24c6e2e14'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:01.476016 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c706f9d8-97ff-4a57-a8ce-5087f8581f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9306c73bcc4aadbc8df2c24c6e2e14'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:01.476853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c706f9d8-97ff-4a57-a8ce-5087f8581f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9306c73bcc4aadbc8df2c24c6e2e14'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:01.514259 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c706f9d8-97ff-4a57-a8ce-5087f8581f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9306c73bcc4aadbc8df2c24c6e2e14'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:01.520735 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1045/2111] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:48:01 2022] DELETE /identity/v3/users/cb9306c73bcc4aadbc8df2c24c6e2e14 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:01.521705 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706f9d8-97ff-4a57-a8ce-5087f8581f09 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:01.526095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c706f9d8-97ff-4a57-a8ce-5087f8581f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:01.539890 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:01.566284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-fe014636-f608-4c2f-bfcb-5bcf68ea70bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09020c080d648dea21f96d3591c8a16', 'request_id': 'req-fe014636-f608-4c2f-bfcb-5bcf68ea70bb'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:01.595987 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-fe014636-f608-4c2f-bfcb-5bcf68ea70bb admin admin] The token cache is being invalidate because project e09020c080d648dea21f96d3591c8a16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:48:01.596359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-fe014636-f608-4c2f-bfcb-5bcf68ea70bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:01.597670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-fe014636-f608-4c2f-bfcb-5bcf68ea70bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:01.599231 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1067/2112] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:48:01 2022] DELETE /identity/v3/projects/e09020c080d648dea21f96d3591c8a16 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:01.606676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5354b9-e792-43f2-b7a9-aa88f38facc3 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:01.606676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5354b9-e792-43f2-b7a9-aa88f38facc3 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:01.606676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5354b9-e792-43f2-b7a9-aa88f38facc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:01.636088 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-1c5354b9-e792-43f2-b7a9-aa88f38facc3 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:01.641632 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-1c5354b9-e792-43f2-b7a9-aa88f38facc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:01.666334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1068/2113] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:01.670440 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706f9d8-97ff-4a57-a8ce-5087f8581f09 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:01.676132 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dbeb8-80f2-435e-b37f-29bfcb778901 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:01.676132 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dbeb8-80f2-435e-b37f-29bfcb778901 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:01.676463 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dbeb8-80f2-435e-b37f-29bfcb778901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:01.676898 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e5f13-3972-4552-9d91-662fb9a1ecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:01.677970 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e5f13-3972-4552-9d91-662fb9a1ecc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:01.678335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e5f13-3972-4552-9d91-662fb9a1ecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:01.678719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e5f13-3972-4552-9d91-662fb9a1ecc5 admin admin] PATH_INFO: `/v3/projects/4102b5941c3f4b3ca0d821ceecc6f150/users/3d8739db4fbf4fd981b99ab829d33e72/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:01.697540 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e5f13-3972-4552-9d91-662fb9a1ecc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4102b5941c3f4b3ca0d821ceecc6f150, user_id=3d8739db4fbf4fd981b99ab829d33e72, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:01.700916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-ce3dbeb8-80f2-435e-b37f-29bfcb778901 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:01.701854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e5f13-3972-4552-9d91-662fb9a1ecc5 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:01.702152 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ce3dbeb8-80f2-435e-b37f-29bfcb778901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:01.712237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1069/2114] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:48:01.717076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dbeb8-80f2-435e-b37f-29bfcb778901 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:01.726672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3dbeb8-80f2-435e-b37f-29bfcb778901 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:01.734078 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14eeab9-9938-4ba1-97e0-70210f0a21dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:01.735106 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14eeab9-9938-4ba1-97e0-70210f0a21dd admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:01.735106 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14eeab9-9938-4ba1-97e0-70210f0a21dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:01.735305 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14eeab9-9938-4ba1-97e0-70210f0a21dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:01.736621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14eeab9-9938-4ba1-97e0-70210f0a21dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:48:01.736985 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14eeab9-9938-4ba1-97e0-70210f0a21dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:01.738979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14eeab9-9938-4ba1-97e0-70210f0a21dd admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:01.757252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1070/2115] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:48:01.758165 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14eeab9-9938-4ba1-97e0-70210f0a21dd admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:01.769091 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14eeab9-9938-4ba1-97e0-70210f0a21dd admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:01.774092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6b773-3bc2-4848-84b7-ab7014a79d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:01.774959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6b773-3bc2-4848-84b7-ab7014a79d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:01.775243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6b773-3bc2-4848-84b7-ab7014a79d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:01.775518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6b773-3bc2-4848-84b7-ab7014a79d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:01.776200 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6b773-3bc2-4848-84b7-ab7014a79d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:01.779111 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6b773-3bc2-4848-84b7-ab7014a79d3f admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:01.787058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1046/2116] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:48:01 2022] PUT /identity/v3/projects/4102b5941c3f4b3ca0d821ceecc6f150/users/3d8739db4fbf4fd981b99ab829d33e72/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:01.803774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33cba7-f0f3-4a16-b1f1-5bd386c80625 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:01.804067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33cba7-f0f3-4a16-b1f1-5bd386c80625 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:01.804407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33cba7-f0f3-4a16-b1f1-5bd386c80625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:01.834290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7f33cba7-f0f3-4a16-b1f1-5bd386c80625 None None] MFA Rules not processed for user `3d8739db4fbf4fd981b99ab829d33e72`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:01.835579 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7f33cba7-f0f3-4a16-b1f1-5bd386c80625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:01.912537 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1071/2117] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:48:01 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:01.913439 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1047/2118] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:01.913811 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6b773-3bc2-4848-84b7-ab7014a79d3f admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:01.913905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33cba7-f0f3-4a16-b1f1-5bd386c80625 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:01.913990 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-5bf6b773-3bc2-4848-84b7-ab7014a79d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:02.019281 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33cba7-f0f3-4a16-b1f1-5bd386c80625 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:02.037742 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6b773-3bc2-4848-84b7-ab7014a79d3f admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:02.043484 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83d74b-c82d-41e2-a2e8-578ca886f864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:02.044968 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83d74b-c82d-41e2-a2e8-578ca886f864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:02.045325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83d74b-c82d-41e2-a2e8-578ca886f864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:02.045678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83d74b-c82d-41e2-a2e8-578ca886f864 admin admin] PATH_INFO: `/v3/projects/f9d1bc1c092340ea9fc7c6747ed66fb6` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:02.046995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83d74b-c82d-41e2-a2e8-578ca886f864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d1bc1c092340ea9fc7c6747ed66fb6)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:02.049270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83d74b-c82d-41e2-a2e8-578ca886f864 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:02.121894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cdf58-b1e4-4ec6-8840-f930a90c5dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:02.122684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cdf58-b1e4-4ec6-8840-f930a90c5dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:02.122977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cdf58-b1e4-4ec6-8840-f930a90c5dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:02.123263 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cdf58-b1e4-4ec6-8840-f930a90c5dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:02.123966 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cdf58-b1e4-4ec6-8840-f930a90c5dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:02.126000 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cdf58-b1e4-4ec6-8840-f930a90c5dd1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:02.185211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ab83d74b-c82d-41e2-a2e8-578ca886f864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d1bc1c092340ea9fc7c6747ed66fb6', 'request_id': 'req-ab83d74b-c82d-41e2-a2e8-578ca886f864'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:02.191475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ab83d74b-c82d-41e2-a2e8-578ca886f864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d1bc1c092340ea9fc7c6747ed66fb6', 'request_id': 'req-ab83d74b-c82d-41e2-a2e8-578ca886f864'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:02.320847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1048/2119] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:48:01 2022] POST /identity/v3/users => generated 287 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:48:02.320847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cdf58-b1e4-4ec6-8840-f930a90c5dd1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:02.320847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-193cdf58-b1e4-4ec6-8840-f930a90c5dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:02.328991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cdf58-b1e4-4ec6-8840-f930a90c5dd1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:02.381901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ab83d74b-c82d-41e2-a2e8-578ca886f864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d1bc1c092340ea9fc7c6747ed66fb6', 'request_id': 'req-ab83d74b-c82d-41e2-a2e8-578ca886f864'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:02.395155 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ab83d74b-c82d-41e2-a2e8-578ca886f864 admin admin] The token cache is being invalidate because project f9d1bc1c092340ea9fc7c6747ed66fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:48:02.395602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ab83d74b-c82d-41e2-a2e8-578ca886f864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:02.396389 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-ab83d74b-c82d-41e2-a2e8-578ca886f864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:02.398444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1072/2120] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:48:01 2022] DELETE /identity/v3/projects/f9d1bc1c092340ea9fc7c6747ed66fb6 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:02.399535 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a840541-8261-4ca3-81f6-792d3df17822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:02.400254 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a840541-8261-4ca3-81f6-792d3df17822 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:02.400535 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a840541-8261-4ca3-81f6-792d3df17822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:02.400816 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a840541-8261-4ca3-81f6-792d3df17822 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:02.401663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a840541-8261-4ca3-81f6-792d3df17822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:02.402869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83d74b-c82d-41e2-a2e8-578ca886f864 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:02.404239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a840541-8261-4ca3-81f6-792d3df17822 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:02.404594 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ab83d74b-c82d-41e2-a2e8-578ca886f864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:02.417837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83d74b-c82d-41e2-a2e8-578ca886f864 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:02.423685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431bc73-eca2-42ad-ac45-b1426cedd9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:02.424715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431bc73-eca2-42ad-ac45-b1426cedd9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:02.425138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431bc73-eca2-42ad-ac45-b1426cedd9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:02.425570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431bc73-eca2-42ad-ac45-b1426cedd9ce admin admin] PATH_INFO: `/v3/projects/4e0430437460442fae71c1e9649d1b7f` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:02.426903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431bc73-eca2-42ad-ac45-b1426cedd9ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e0430437460442fae71c1e9649d1b7f)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:02.429057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431bc73-eca2-42ad-ac45-b1426cedd9ce admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:02.442471 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:02.518228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1049/2121] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:48:02 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:02.518228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a840541-8261-4ca3-81f6-792d3df17822 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:02.518228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9a840541-8261-4ca3-81f6-792d3df17822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:02.553453 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7431bc73-eca2-42ad-ac45-b1426cedd9ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e0430437460442fae71c1e9649d1b7f', 'request_id': 'req-7431bc73-eca2-42ad-ac45-b1426cedd9ce'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:02.561321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7431bc73-eca2-42ad-ac45-b1426cedd9ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e0430437460442fae71c1e9649d1b7f', 'request_id': 'req-7431bc73-eca2-42ad-ac45-b1426cedd9ce'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:02.588467 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a840541-8261-4ca3-81f6-792d3df17822 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:02.652457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a39139-cb62-4abb-8041-6d2b95d7cc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:02.653841 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a39139-cb62-4abb-8041-6d2b95d7cc16 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:02.654071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a39139-cb62-4abb-8041-6d2b95d7cc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:02.654515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a39139-cb62-4abb-8041-6d2b95d7cc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:02.657921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a39139-cb62-4abb-8041-6d2b95d7cc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:02.658375 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a39139-cb62-4abb-8041-6d2b95d7cc16 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:02.660838 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7431bc73-eca2-42ad-ac45-b1426cedd9ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e0430437460442fae71c1e9649d1b7f', 'request_id': 'req-7431bc73-eca2-42ad-ac45-b1426cedd9ce'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:02.678611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7431bc73-eca2-42ad-ac45-b1426cedd9ce admin admin] The token cache is being invalidate because project 4e0430437460442fae71c1e9649d1b7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:48:02.679061 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7431bc73-eca2-42ad-ac45-b1426cedd9ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:02.679628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7431bc73-eca2-42ad-ac45-b1426cedd9ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:02.685471 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1050/2123] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:02.685751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1073/2123] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:48:02 2022] DELETE /identity/v3/projects/4e0430437460442fae71c1e9649d1b7f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:02.685751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431bc73-eca2-42ad-ac45-b1426cedd9ce admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:02.685751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7431bc73-eca2-42ad-ac45-b1426cedd9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:02.685948 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43a851-18d9-4d1c-9787-658c8422b438 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:02.685948 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43a851-18d9-4d1c-9787-658c8422b438 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:02.685948 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43a851-18d9-4d1c-9787-658c8422b438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:02.713277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431bc73-eca2-42ad-ac45-b1426cedd9ce admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:02.718696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-5c43a851-18d9-4d1c-9787-658c8422b438 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:02.720022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5c43a851-18d9-4d1c-9787-658c8422b438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:02.721226 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e447fc-c1f5-4221-9898-9b68e3626c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:02.723711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e447fc-c1f5-4221-9898-9b68e3626c5c admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:02.725837 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:02.726989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e447fc-c1f5-4221-9898-9b68e3626c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:02.727587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e447fc-c1f5-4221-9898-9b68e3626c5c admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:02.728607 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e447fc-c1f5-4221-9898-9b68e3626c5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:02.731276 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e447fc-c1f5-4221-9898-9b68e3626c5c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:02.732238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1051/2124] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:02.738852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43a851-18d9-4d1c-9787-658c8422b438 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:02.741793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5c43a851-18d9-4d1c-9787-658c8422b438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:02.758570 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43a851-18d9-4d1c-9787-658c8422b438 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:02.765391 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3735c-cd8b-4d30-870e-f2ad185796a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:02.766175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3735c-cd8b-4d30-870e-f2ad185796a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:02.766551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3735c-cd8b-4d30-870e-f2ad185796a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:02.766893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3735c-cd8b-4d30-870e-f2ad185796a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:02.767717 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3735c-cd8b-4d30-870e-f2ad185796a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:02.769681 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3735c-cd8b-4d30-870e-f2ad185796a2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:02.781265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1052/2125] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:02.782698 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba80bf-803f-4c3d-b4f9-0a8e33ffeeac None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:02.782990 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba80bf-803f-4c3d-b4f9-0a8e33ffeeac None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:02.783270 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba80bf-803f-4c3d-b4f9-0a8e33ffeeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:02.802153 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-24ba80bf-803f-4c3d-b4f9-0a8e33ffeeac None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:02.803378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-24ba80bf-803f-4c3d-b4f9-0a8e33ffeeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:02.816868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1053/2126] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:02.816868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107505b-29ac-4af1-8b7b-05b0c9665134 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:02.816868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107505b-29ac-4af1-8b7b-05b0c9665134 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:02.816868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107505b-29ac-4af1-8b7b-05b0c9665134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:02.849978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-9107505b-29ac-4af1-8b7b-05b0c9665134 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:02.851122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9107505b-29ac-4af1-8b7b-05b0c9665134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:02.864089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1054/2127] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:02.864089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107505b-29ac-4af1-8b7b-05b0c9665134 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:02.868457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1074/2128] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:48:02 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:02.868457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349601d-fd1e-42c8-bb13-2cfab54b06f5 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:02.868457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349601d-fd1e-42c8-bb13-2cfab54b06f5 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:02.868743 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349601d-fd1e-42c8-bb13-2cfab54b06f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:02.876658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107505b-29ac-4af1-8b7b-05b0c9665134 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:02.881455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba50174-5727-4c89-8766-541f4fcf03c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:02.882396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba50174-5727-4c89-8766-541f4fcf03c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:02.882687 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba50174-5727-4c89-8766-541f4fcf03c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:02.883023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba50174-5727-4c89-8766-541f4fcf03c4 admin admin] PATH_INFO: `/v3/projects/b96b765dc2064f228aebae472b55fcbb/users/35445d12ade14ae09e904226ce6eab26/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:02.897398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-2349601d-fd1e-42c8-bb13-2cfab54b06f5 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:02.899773 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-2349601d-fd1e-42c8-bb13-2cfab54b06f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:02.902462 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba50174-5727-4c89-8766-541f4fcf03c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96b765dc2064f228aebae472b55fcbb, user_id=35445d12ade14ae09e904226ce6eab26, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:02.906277 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba50174-5727-4c89-8766-541f4fcf03c4 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:02.924910 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1075/2129] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:02.925941 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349601d-fd1e-42c8-bb13-2cfab54b06f5 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:02.941986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349601d-fd1e-42c8-bb13-2cfab54b06f5 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:02.947189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe6b2d-8137-4c32-8e85-eda81c817c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:02.947869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe6b2d-8137-4c32-8e85-eda81c817c04 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:02.948156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe6b2d-8137-4c32-8e85-eda81c817c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:02.948433 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe6b2d-8137-4c32-8e85-eda81c817c04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:02.950334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe6b2d-8137-4c32-8e85-eda81c817c04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:48:02.950334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe6b2d-8137-4c32-8e85-eda81c817c04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:02.952376 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe6b2d-8137-4c32-8e85-eda81c817c04 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:02.970160 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1076/2130] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:48:02.970160 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe6b2d-8137-4c32-8e85-eda81c817c04 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:02.974039 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1055/2131] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:48:02 2022] PUT /identity/v3/projects/b96b765dc2064f228aebae472b55fcbb/users/35445d12ade14ae09e904226ce6eab26/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:02.980417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe6b2d-8137-4c32-8e85-eda81c817c04 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:02.987589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba50174-5727-4c89-8766-541f4fcf03c4 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:03.066656 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc99d2-74ed-4375-95c3-96a476127508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:03.068020 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc99d2-74ed-4375-95c3-96a476127508 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.068273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc99d2-74ed-4375-95c3-96a476127508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.070932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc99d2-74ed-4375-95c3-96a476127508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.071513 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc99d2-74ed-4375-95c3-96a476127508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:03.073243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc99d2-74ed-4375-95c3-96a476127508 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:03.101045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1077/2132] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:03.101045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc99d2-74ed-4375-95c3-96a476127508 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:03.107822 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba50174-5727-4c89-8766-541f4fcf03c4 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:03.115092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc99d2-74ed-4375-95c3-96a476127508 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:03.115249 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837eee9-eb4e-427c-9c50-d15ef29f4722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:03.117111 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837eee9-eb4e-427c-9c50-d15ef29f4722 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.117330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837eee9-eb4e-427c-9c50-d15ef29f4722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.117617 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837eee9-eb4e-427c-9c50-d15ef29f4722 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.118366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837eee9-eb4e-427c-9c50-d15ef29f4722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:48:03.118681 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837eee9-eb4e-427c-9c50-d15ef29f4722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:03.120333 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837eee9-eb4e-427c-9c50-d15ef29f4722 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:03.121858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbca2c3-0ac6-4686-b1e7-125e05b9336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:03.122851 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbca2c3-0ac6-4686-b1e7-125e05b9336c admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.123230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbca2c3-0ac6-4686-b1e7-125e05b9336c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.123407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbca2c3-0ac6-4686-b1e7-125e05b9336c admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.124159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbca2c3-0ac6-4686-b1e7-125e05b9336c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:03.126293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbca2c3-0ac6-4686-b1e7-125e05b9336c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:03.134482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1056/2133] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:48:03.135861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ab18f-df17-4458-ae53-83cc0f6b5685 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.136159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ab18f-df17-4458-ae53-83cc0f6b5685 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.136436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ab18f-df17-4458-ae53-83cc0f6b5685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.167877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-133ab18f-df17-4458-ae53-83cc0f6b5685 None None] MFA Rules not processed for user `35445d12ade14ae09e904226ce6eab26`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:03.170370 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-133ab18f-df17-4458-ae53-83cc0f6b5685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:03.242320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1078/2134] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:48:03 2022] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:03.242320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbca2c3-0ac6-4686-b1e7-125e05b9336c admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:03.247483 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1057/2135] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:03.248463 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ab18f-df17-4458-ae53-83cc0f6b5685 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:03.267367 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ab18f-df17-4458-ae53-83cc0f6b5685 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:03.311439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbca2c3-0ac6-4686-b1e7-125e05b9336c admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:03.316293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8de4f6-d1b3-4452-ae49-c5710a0e005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:03.317003 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8de4f6-d1b3-4452-ae49-c5710a0e005d admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.317274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8de4f6-d1b3-4452-ae49-c5710a0e005d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.317556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8de4f6-d1b3-4452-ae49-c5710a0e005d admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.318624 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8de4f6-d1b3-4452-ae49-c5710a0e005d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:03.320726 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8de4f6-d1b3-4452-ae49-c5710a0e005d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:03.330577 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af7e5c-4270-4a34-9800-14c77d57c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:03.331255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af7e5c-4270-4a34-9800-14c77d57c60f admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.331539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af7e5c-4270-4a34-9800-14c77d57c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.331815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af7e5c-4270-4a34-9800-14c77d57c60f admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.332537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af7e5c-4270-4a34-9800-14c77d57c60f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:03.332868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1079/2136] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:03.333798 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8de4f6-d1b3-4452-ae49-c5710a0e005d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:03.338561 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af7e5c-4270-4a34-9800-14c77d57c60f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:03.345440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8de4f6-d1b3-4452-ae49-c5710a0e005d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:03.350472 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0113c5-e171-4bb1-813e-f192a1a19337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:03.352029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0113c5-e171-4bb1-813e-f192a1a19337 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.352029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0113c5-e171-4bb1-813e-f192a1a19337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.352029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0113c5-e171-4bb1-813e-f192a1a19337 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.352460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0113c5-e171-4bb1-813e-f192a1a19337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:03.355042 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0113c5-e171-4bb1-813e-f192a1a19337 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:03.358769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:03.431731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1058/2137] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:48:03 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:03.431731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af7e5c-4270-4a34-9800-14c77d57c60f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:03.431731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-85af7e5c-4270-4a34-9800-14c77d57c60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:03.440143 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1080/2138] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:48:03 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:03.440923 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0113c5-e171-4bb1-813e-f192a1a19337 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:03.456219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0113c5-e171-4bb1-813e-f192a1a19337 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:03.504442 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af7e5c-4270-4a34-9800-14c77d57c60f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:03.507324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:03.510479 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd47f7-493d-44c4-a9b7-3dd9449f049f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:03.511116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd47f7-493d-44c4-a9b7-3dd9449f049f service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.511413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd47f7-493d-44c4-a9b7-3dd9449f049f service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.511692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd47f7-493d-44c4-a9b7-3dd9449f049f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.530977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5afdc-6320-4596-876d-6ce3ea21e6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:03.532224 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5afdc-6320-4596-876d-6ce3ea21e6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.532564 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5afdc-6320-4596-876d-6ce3ea21e6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.532842 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5afdc-6320-4596-876d-6ce3ea21e6b5 admin admin] PATH_INFO: `/v3/projects/8398bd8ffe594438a8cfe53d513bfe30/users/91b88d99936947f3b03a89adf5550eb9/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.554109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5afdc-6320-4596-876d-6ce3ea21e6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8398bd8ffe594438a8cfe53d513bfe30, user_id=91b88d99936947f3b03a89adf5550eb9, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:03.556895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5afdc-6320-4596-876d-6ce3ea21e6b5 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:03.572675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd47f7-493d-44c4-a9b7-3dd9449f049f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:03.574315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd47f7-493d-44c4-a9b7-3dd9449f049f service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:03.586954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1059/2139] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:48:03.588025 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd47f7-493d-44c4-a9b7-3dd9449f049f service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:03.603948 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd47f7-493d-44c4-a9b7-3dd9449f049f service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:03.608741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d7eb1-9e66-48fc-89b7-47e4d5f2eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:03.610273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d7eb1-9e66-48fc-89b7-47e4d5f2eea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.610273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d7eb1-9e66-48fc-89b7-47e4d5f2eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.610273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d7eb1-9e66-48fc-89b7-47e4d5f2eea3 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.610844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d7eb1-9e66-48fc-89b7-47e4d5f2eea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:03.612776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d7eb1-9e66-48fc-89b7-47e4d5f2eea3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:03.641071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1081/2140] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:48:03 2022] PUT /identity/v3/projects/8398bd8ffe594438a8cfe53d513bfe30/users/91b88d99936947f3b03a89adf5550eb9/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:03.642099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5afdc-6320-4596-876d-6ce3ea21e6b5 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:03.694910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1060/2141] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:48:03 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:03.699973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f685b4b-421a-4c86-8d71-666f441afb88 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.700329 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f685b4b-421a-4c86-8d71-666f441afb88 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.700748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f685b4b-421a-4c86-8d71-666f441afb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.714546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5afdc-6320-4596-876d-6ce3ea21e6b5 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:03.721838 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e5c77-1617-4b19-917d-de4a2004a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:03.722974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e5c77-1617-4b19-917d-de4a2004a4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.723477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e5c77-1617-4b19-917d-de4a2004a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.723958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e5c77-1617-4b19-917d-de4a2004a4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.725088 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e5c77-1617-4b19-917d-de4a2004a4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:03.727114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e5c77-1617-4b19-917d-de4a2004a4b3 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:03.729343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-9f685b4b-421a-4c86-8d71-666f441afb88 None None] MFA Rules not processed for user `91b88d99936947f3b03a89adf5550eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:03.730556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9f685b4b-421a-4c86-8d71-666f441afb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:03.738567 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1082/2142] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:03.739383 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e5c77-1617-4b19-917d-de4a2004a4b3 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:03.750457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e5c77-1617-4b19-917d-de4a2004a4b3 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:03.755333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1f247-964b-49be-90a9-11a395570eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:03.755937 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1f247-964b-49be-90a9-11a395570eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.756230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1f247-964b-49be-90a9-11a395570eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.756509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1f247-964b-49be-90a9-11a395570eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.757268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1f247-964b-49be-90a9-11a395570eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:03.758912 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1f247-964b-49be-90a9-11a395570eb1 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:03.769455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1083/2143] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:03.770277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1f247-964b-49be-90a9-11a395570eb1 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:03.772064 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:03.780386 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1f247-964b-49be-90a9-11a395570eb1 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:03.785070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9943b0e-eb7b-4199-ae27-e880226b9d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:03.785728 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9943b0e-eb7b-4199-ae27-e880226b9d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.786016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9943b0e-eb7b-4199-ae27-e880226b9d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.786293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9943b0e-eb7b-4199-ae27-e880226b9d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.787017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9943b0e-eb7b-4199-ae27-e880226b9d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:03.788629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9943b0e-eb7b-4199-ae27-e880226b9d69 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:03.799108 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1061/2144] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:03.799519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1084/2145] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:03.800523 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f685b4b-421a-4c86-8d71-666f441afb88 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:03.803746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9943b0e-eb7b-4199-ae27-e880226b9d69 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:03.811325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f685b4b-421a-4c86-8d71-666f441afb88 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:03.813578 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9943b0e-eb7b-4199-ae27-e880226b9d69 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:03.816000 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c27102-8bb1-4e3b-89e2-8b62bb6b3375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:03.816671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27102-8bb1-4e3b-89e2-8b62bb6b3375 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.816999 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27102-8bb1-4e3b-89e2-8b62bb6b3375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.817289 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27102-8bb1-4e3b-89e2-8b62bb6b3375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.818027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c27102-8bb1-4e3b-89e2-8b62bb6b3375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:03.819660 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29678146-7b0e-4d9f-88dd-beeafd2e031b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:03.819927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c27102-8bb1-4e3b-89e2-8b62bb6b3375 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:03.820319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29678146-7b0e-4d9f-88dd-beeafd2e031b admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.820605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29678146-7b0e-4d9f-88dd-beeafd2e031b admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.820883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29678146-7b0e-4d9f-88dd-beeafd2e031b admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.821605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29678146-7b0e-4d9f-88dd-beeafd2e031b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:03.823926 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29678146-7b0e-4d9f-88dd-beeafd2e031b admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:03.834972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1062/2146] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:03.834972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c27102-8bb1-4e3b-89e2-8b62bb6b3375 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:03.846702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c27102-8bb1-4e3b-89e2-8b62bb6b3375 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:03.851883 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc2df8-e9d5-485f-9973-cf4866638ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:03.852794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc2df8-e9d5-485f-9973-cf4866638ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:03.853189 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc2df8-e9d5-485f-9973-cf4866638ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:03.853507 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc2df8-e9d5-485f-9973-cf4866638ac9 admin admin] PATH_INFO: `/v3/projects/bc56082b919a41f58d36fa6265d60101/users/5c217bd8fd374f3088f0fe3f89bf0d88/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:03.868781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc2df8-e9d5-485f-9973-cf4866638ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc56082b919a41f58d36fa6265d60101, user_id=5c217bd8fd374f3088f0fe3f89bf0d88, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:03.870687 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:03.872544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc2df8-e9d5-485f-9973-cf4866638ac9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:04.025987 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1063/2147] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:48:03 2022] PUT /identity/v3/projects/bc56082b919a41f58d36fa6265d60101/users/5c217bd8fd374f3088f0fe3f89bf0d88/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:04.026520 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1085/2148] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:48:03 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:48:04.026866 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc2df8-e9d5-485f-9973-cf4866638ac9 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:04.026944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29678146-7b0e-4d9f-88dd-beeafd2e031b admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:04.091402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc2df8-e9d5-485f-9973-cf4866638ac9 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:04.092805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29678146-7b0e-4d9f-88dd-beeafd2e031b admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:04.096309 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d69930-ceab-45fd-aff4-827e69577d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:04.097243 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d69930-ceab-45fd-aff4-827e69577d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:04.097532 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d69930-ceab-45fd-aff4-827e69577d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:04.097630 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179a70f-f3b0-44b8-8d69-030ad7ff849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:04.097816 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d69930-ceab-45fd-aff4-827e69577d52 admin admin] PATH_INFO: `/v3/projects/e78f360954c5412d9636f8290dfa65b5/users/cec217d1c4644b2cae5fe14c44fd8f12/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:04.098263 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179a70f-f3b0-44b8-8d69-030ad7ff849e admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:04.098552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179a70f-f3b0-44b8-8d69-030ad7ff849e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:04.098836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179a70f-f3b0-44b8-8d69-030ad7ff849e admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:04.099621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179a70f-f3b0-44b8-8d69-030ad7ff849e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:04.101691 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179a70f-f3b0-44b8-8d69-030ad7ff849e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:04.113629 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d69930-ceab-45fd-aff4-827e69577d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78f360954c5412d9636f8290dfa65b5, user_id=cec217d1c4644b2cae5fe14c44fd8f12, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:04.116334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d69930-ceab-45fd-aff4-827e69577d52 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:04.210644 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1086/2149] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:48:04 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:04.211951 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0439c43-bc48-4df8-a714-379384aa8f3c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:04.212249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0439c43-bc48-4df8-a714-379384aa8f3c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:04.213195 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0439c43-bc48-4df8-a714-379384aa8f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:04.244653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-a0439c43-bc48-4df8-a714-379384aa8f3c None None] MFA Rules not processed for user `5c217bd8fd374f3088f0fe3f89bf0d88`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:04.245932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a0439c43-bc48-4df8-a714-379384aa8f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:04.262371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1064/2150] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:48:04 2022] PUT /identity/v3/projects/e78f360954c5412d9636f8290dfa65b5/users/cec217d1c4644b2cae5fe14c44fd8f12/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:04.267667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d69930-ceab-45fd-aff4-827e69577d52 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:04.308857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:04.318423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1087/2151] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:04.319995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca9ed1-c51b-4835-8ce2-fdaa4cb0a98f None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:04.320532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca9ed1-c51b-4835-8ce2-fdaa4cb0a98f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:04.320815 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca9ed1-c51b-4835-8ce2-fdaa4cb0a98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:04.329732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d69930-ceab-45fd-aff4-827e69577d52 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:04.336071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a1659-599e-47ef-8fc7-60fd09445a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:04.336771 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a1659-599e-47ef-8fc7-60fd09445a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:04.337147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a1659-599e-47ef-8fc7-60fd09445a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:04.337385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a1659-599e-47ef-8fc7-60fd09445a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:04.338418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a1659-599e-47ef-8fc7-60fd09445a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:04.340154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a1659-599e-47ef-8fc7-60fd09445a9e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:04.353003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1065/2152] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:04.353003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a1659-599e-47ef-8fc7-60fd09445a9e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:04.359973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c30a1659-599e-47ef-8fc7-60fd09445a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:04.364868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-7dca9ed1-c51b-4835-8ce2-fdaa4cb0a98f None None] MFA Rules not processed for user `cec217d1c4644b2cae5fe14c44fd8f12`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:04.366230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7dca9ed1-c51b-4835-8ce2-fdaa4cb0a98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:04.427205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a1659-599e-47ef-8fc7-60fd09445a9e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:04.431478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb160ed-ff73-4c26-8e0d-ca21683ea798 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b34d05889f3c4d469f4661061457cb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:04.432209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb160ed-ff73-4c26-8e0d-ca21683ea798 service glance] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:04.432595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb160ed-ff73-4c26-8e0d-ca21683ea798 service glance] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:04.433091 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb160ed-ff73-4c26-8e0d-ca21683ea798 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:04.462883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1088/2153] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:04.464019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca9ed1-c51b-4835-8ce2-fdaa4cb0a98f None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:04.479263 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca9ed1-c51b-4835-8ce2-fdaa4cb0a98f None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:04.485129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1fdde-6eff-446d-afb5-41d7f2643472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:04.486039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1fdde-6eff-446d-afb5-41d7f2643472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:04.486325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1fdde-6eff-446d-afb5-41d7f2643472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:04.486603 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1fdde-6eff-446d-afb5-41d7f2643472 admin admin] PATH_INFO: `/v3/projects/ca2cc987196f4e12819acf9de6a54423/users/5e0fd45738df4944879579d715aaa875/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:04.501751 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb160ed-ff73-4c26-8e0d-ca21683ea798 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:04.503099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1fdde-6eff-446d-afb5-41d7f2643472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2cc987196f4e12819acf9de6a54423, user_id=5e0fd45738df4944879579d715aaa875, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:04.505118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb160ed-ff73-4c26-8e0d-ca21683ea798 service glance] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:04.505819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1fdde-6eff-446d-afb5-41d7f2643472 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:04.512698 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1066/2154] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:48:04.513701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb160ed-ff73-4c26-8e0d-ca21683ea798 service glance] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:04.523906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb160ed-ff73-4c26-8e0d-ca21683ea798 service glance] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:04.529429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d222e48-68a0-45bb-a54e-534afd2055eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:04.530083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d222e48-68a0-45bb-a54e-534afd2055eb admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:04.530371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d222e48-68a0-45bb-a54e-534afd2055eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:04.530648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d222e48-68a0-45bb-a54e-534afd2055eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:04.531335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d222e48-68a0-45bb-a54e-534afd2055eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:04.533375 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d222e48-68a0-45bb-a54e-534afd2055eb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:04.591347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1089/2155] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:48:04 2022] PUT /identity/v3/projects/ca2cc987196f4e12819acf9de6a54423/users/5e0fd45738df4944879579d715aaa875/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:04.592697 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1fdde-6eff-446d-afb5-41d7f2643472 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:04.612703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:04.620360 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1067/2156] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:48:04 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:04.622059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d222e48-68a0-45bb-a54e-534afd2055eb admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:04.665542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1fdde-6eff-446d-afb5-41d7f2643472 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:04.691962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d222e48-68a0-45bb-a54e-534afd2055eb admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:04.697128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efb811-25df-4d50-8ed6-a8b953482af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:04.697932 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efb811-25df-4d50-8ed6-a8b953482af3 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:04.698350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efb811-25df-4d50-8ed6-a8b953482af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:04.698633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efb811-25df-4d50-8ed6-a8b953482af3 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:04.699342 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efb811-25df-4d50-8ed6-a8b953482af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:04.702072 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efb811-25df-4d50-8ed6-a8b953482af3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:04.735596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:04.750452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a1142-9ef3-4b66-836d-3c8ad4cecd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:04.751143 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a1142-9ef3-4b66-836d-3c8ad4cecd30 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:04.751435 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a1142-9ef3-4b66-836d-3c8ad4cecd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:04.751715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a1142-9ef3-4b66-836d-3c8ad4cecd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:04.752455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a1142-9ef3-4b66-836d-3c8ad4cecd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:04.754811 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a1142-9ef3-4b66-836d-3c8ad4cecd30 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:04.769312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1090/2157] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:04.812209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a1142-9ef3-4b66-836d-3c8ad4cecd30 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:04.812209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a1142-9ef3-4b66-836d-3c8ad4cecd30 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:04.812209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235b990-c86d-43fc-85df-b613c360c211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:04.812209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235b990-c86d-43fc-85df-b613c360c211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:04.812827 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235b990-c86d-43fc-85df-b613c360c211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:04.812827 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235b990-c86d-43fc-85df-b613c360c211 admin admin] PATH_INFO: `/v3/projects/ca2cc987196f4e12819acf9de6a54423/users/5e0fd45738df4944879579d715aaa875/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:04.812827 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235b990-c86d-43fc-85df-b613c360c211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2cc987196f4e12819acf9de6a54423, user_id=5e0fd45738df4944879579d715aaa875, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:04.812827 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235b990-c86d-43fc-85df-b613c360c211 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:04.812827 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1091/2158] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:48:04 2022] PUT /identity/v3/projects/ca2cc987196f4e12819acf9de6a54423/users/5e0fd45738df4944879579d715aaa875/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:48:04.839460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1068/2159] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:48:04 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:04.848134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235b990-c86d-43fc-85df-b613c360c211 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:04.881070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b4c20-c009-4dc2-8629-6ed0f0b0b598 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:04.881382 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b4c20-c009-4dc2-8629-6ed0f0b0b598 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:04.881666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b4c20-c009-4dc2-8629-6ed0f0b0b598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:04.913094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-bd9b4c20-c009-4dc2-8629-6ed0f0b0b598 None None] MFA Rules not processed for user `5e0fd45738df4944879579d715aaa875`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:04.914354 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-bd9b4c20-c009-4dc2-8629-6ed0f0b0b598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:04.918431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235b990-c86d-43fc-85df-b613c360c211 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:04.923283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0452a-a05d-44af-9a90-60f53fe2a28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:04.923955 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0452a-a05d-44af-9a90-60f53fe2a28e admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:04.924242 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0452a-a05d-44af-9a90-60f53fe2a28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:04.924521 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0452a-a05d-44af-9a90-60f53fe2a28e admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:04.925294 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0452a-a05d-44af-9a90-60f53fe2a28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:04.926898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0452a-a05d-44af-9a90-60f53fe2a28e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:04.937466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1092/2160] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:04.941510 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0452a-a05d-44af-9a90-60f53fe2a28e admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:04.952486 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0452a-a05d-44af-9a90-60f53fe2a28e admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:04.957795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3d965-57c4-4be7-aed9-5bc42d308d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:04.958688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3d965-57c4-4be7-aed9-5bc42d308d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:04.958973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3d965-57c4-4be7-aed9-5bc42d308d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:04.959249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3d965-57c4-4be7-aed9-5bc42d308d0d admin admin] PATH_INFO: `/v3/projects/f933fc8e23744824ab1126015398ecd5/users/d8c32942ae3c4efd860a2e06aa8728c8/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:04.964307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:04.975795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3d965-57c4-4be7-aed9-5bc42d308d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f933fc8e23744824ab1126015398ecd5, user_id=d8c32942ae3c4efd860a2e06aa8728c8, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:04.978495 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3d965-57c4-4be7-aed9-5bc42d308d0d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:04.988123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1069/2161] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:05.000133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b4c20-c009-4dc2-8629-6ed0f0b0b598 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:05.004976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-bd9b4c20-c009-4dc2-8629-6ed0f0b0b598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:05.051472 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:05.065206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b4c20-c009-4dc2-8629-6ed0f0b0b598 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:05.068833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e01a9-4831-4b1c-b7ec-76699bb0d22c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:05.069522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e01a9-4831-4b1c-b7ec-76699bb0d22c service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:05.069809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e01a9-4831-4b1c-b7ec-76699bb0d22c service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:05.070087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e01a9-4831-4b1c-b7ec-76699bb0d22c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:05.071880 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-371e01a9-4831-4b1c-b7ec-76699bb0d22c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:05.101862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1093/2162] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:48:04 2022] PUT /identity/v3/projects/f933fc8e23744824ab1126015398ecd5/users/d8c32942ae3c4efd860a2e06aa8728c8/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:48:05.107545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3d965-57c4-4be7-aed9-5bc42d308d0d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:05.146767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e01a9-4831-4b1c-b7ec-76699bb0d22c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:05.148262 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e01a9-4831-4b1c-b7ec-76699bb0d22c service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:05.162123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1070/2163] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:48:05.181127 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3d965-57c4-4be7-aed9-5bc42d308d0d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:05.189194 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82727237-7779-4cbc-b3a0-4c0cb12df649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:05.189889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82727237-7779-4cbc-b3a0-4c0cb12df649 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:05.190221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82727237-7779-4cbc-b3a0-4c0cb12df649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:05.190554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82727237-7779-4cbc-b3a0-4c0cb12df649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:05.191296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82727237-7779-4cbc-b3a0-4c0cb12df649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:05.192903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82727237-7779-4cbc-b3a0-4c0cb12df649 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:05.204982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1094/2164] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:05.208281 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e01a9-4831-4b1c-b7ec-76699bb0d22c service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:05.219642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e01a9-4831-4b1c-b7ec-76699bb0d22c service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:05.224290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ae851-95b7-4ce0-94f6-8beeb5c814dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:05.225228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ae851-95b7-4ce0-94f6-8beeb5c814dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:05.225517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ae851-95b7-4ce0-94f6-8beeb5c814dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:05.225796 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ae851-95b7-4ce0-94f6-8beeb5c814dc admin admin] PATH_INFO: `/v3/projects/f933fc8e23744824ab1126015398ecd5/users/d8c32942ae3c4efd860a2e06aa8728c8/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:05.227767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ae851-95b7-4ce0-94f6-8beeb5c814dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f933fc8e23744824ab1126015398ecd5, user_id=d8c32942ae3c4efd860a2e06aa8728c8, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:05.230457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ae851-95b7-4ce0-94f6-8beeb5c814dc admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:05.241131 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1071/2165] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:48:05 2022] PUT /identity/v3/projects/f933fc8e23744824ab1126015398ecd5/users/d8c32942ae3c4efd860a2e06aa8728c8/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:05.251574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d00f2-f002-47f8-a587-1f12697ac5ca None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:05.251872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d00f2-f002-47f8-a587-1f12697ac5ca None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:05.252160 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d00f2-f002-47f8-a587-1f12697ac5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:05.280872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-cb8d00f2-f002-47f8-a587-1f12697ac5ca None None] MFA Rules not processed for user `d8c32942ae3c4efd860a2e06aa8728c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:05.282119 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-cb8d00f2-f002-47f8-a587-1f12697ac5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:05.354046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1095/2166] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:05.438430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:05.540879 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ae851-95b7-4ce0-94f6-8beeb5c814dc admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:05.597540 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ae851-95b7-4ce0-94f6-8beeb5c814dc admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:05.601173 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abaaa35-86d8-427f-803d-bb41f193e44c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:05.601813 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaaa35-86d8-427f-803d-bb41f193e44c service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:05.602102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaaa35-86d8-427f-803d-bb41f193e44c service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:05.602379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaaa35-86d8-427f-803d-bb41f193e44c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:05.611467 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abaaa35-86d8-427f-803d-bb41f193e44c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:05.612887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abaaa35-86d8-427f-803d-bb41f193e44c service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:05.622987 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1072/2167] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:48:05.644329 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:05.970615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d00f2-f002-47f8-a587-1f12697ac5ca None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:05.981307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d00f2-f002-47f8-a587-1f12697ac5ca None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:05.985016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace4ed3-1eaf-40c1-b7c7-fe0e23367f9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:05.985667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace4ed3-1eaf-40c1-b7c7-fe0e23367f9a service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:05.985951 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace4ed3-1eaf-40c1-b7c7-fe0e23367f9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:05.986228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace4ed3-1eaf-40c1-b7c7-fe0e23367f9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:06.048444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace4ed3-1eaf-40c1-b7c7-fe0e23367f9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:06.050129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace4ed3-1eaf-40c1-b7c7-fe0e23367f9a service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:06.060534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1096/2168] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:48:06.091107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:06.670971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abaaa35-86d8-427f-803d-bb41f193e44c service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:06.736953 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abaaa35-86d8-427f-803d-bb41f193e44c service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:06.741628 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acced9-42e2-421a-a844-76de2d94d62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:06.742493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acced9-42e2-421a-a844-76de2d94d62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:06.742786 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acced9-42e2-421a-a844-76de2d94d62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:06.743071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acced9-42e2-421a-a844-76de2d94d62c admin admin] PATH_INFO: `/v3/users/cec217d1c4644b2cae5fe14c44fd8f12` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:06.745043 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acced9-42e2-421a-a844-76de2d94d62c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec217d1c4644b2cae5fe14c44fd8f12)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:06.747058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acced9-42e2-421a-a844-76de2d94d62c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:06.970882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-73acced9-42e2-421a-a844-76de2d94d62c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec217d1c4644b2cae5fe14c44fd8f12'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:07.035781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-73acced9-42e2-421a-a844-76de2d94d62c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec217d1c4644b2cae5fe14c44fd8f12'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:07.043352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-73acced9-42e2-421a-a844-76de2d94d62c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec217d1c4644b2cae5fe14c44fd8f12'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:07.046930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-73acced9-42e2-421a-a844-76de2d94d62c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec217d1c4644b2cae5fe14c44fd8f12'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:07.046930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:07.056578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-73acced9-42e2-421a-a844-76de2d94d62c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec217d1c4644b2cae5fe14c44fd8f12'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:07.063707 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1073/2169] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:48:06 2022] DELETE /identity/v3/users/cec217d1c4644b2cae5fe14c44fd8f12 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:07.068298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12917a1d-d84f-472e-b778-5b482d3a343c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:07.068791 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12917a1d-d84f-472e-b778-5b482d3a343c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:07.068879 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12917a1d-d84f-472e-b778-5b482d3a343c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:07.091944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-12917a1d-d84f-472e-b778-5b482d3a343c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:07.093194 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-12917a1d-d84f-472e-b778-5b482d3a343c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:07.154615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1097/2170] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:07.174907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acced9-42e2-421a-a844-76de2d94d62c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:07.174907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-73acced9-42e2-421a-a844-76de2d94d62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:07.229551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acced9-42e2-421a-a844-76de2d94d62c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:07.234943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b57c41-e90e-4f7d-8a6e-791e54bb56b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:07.235722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b57c41-e90e-4f7d-8a6e-791e54bb56b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:07.236084 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b57c41-e90e-4f7d-8a6e-791e54bb56b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:07.236454 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b57c41-e90e-4f7d-8a6e-791e54bb56b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:07.246088 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b57c41-e90e-4f7d-8a6e-791e54bb56b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:07.248337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b57c41-e90e-4f7d-8a6e-791e54bb56b1 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:07.257850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1074/2171] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:48:07.619885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12917a1d-d84f-472e-b778-5b482d3a343c None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:07.621384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-12917a1d-d84f-472e-b778-5b482d3a343c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:07.692469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12917a1d-d84f-472e-b778-5b482d3a343c None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:07.696054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b984977-34e7-4ed0-b298-8da54b0a6a21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:07.696711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b984977-34e7-4ed0-b298-8da54b0a6a21 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:07.697027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b984977-34e7-4ed0-b298-8da54b0a6a21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:07.697339 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b984977-34e7-4ed0-b298-8da54b0a6a21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:07.699219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3b984977-34e7-4ed0-b298-8da54b0a6a21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:07.768330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b984977-34e7-4ed0-b298-8da54b0a6a21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:07.769863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b984977-34e7-4ed0-b298-8da54b0a6a21 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:07.784068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1098/2172] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:48:07.786090 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b57c41-e90e-4f7d-8a6e-791e54bb56b1 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:07.787966 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c8b57c41-e90e-4f7d-8a6e-791e54bb56b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:07.802716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b57c41-e90e-4f7d-8a6e-791e54bb56b1 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:07.813229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:07.813229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:07.813229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:07.813229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591 admin admin] PATH_INFO: `/v3/projects/e78f360954c5412d9636f8290dfa65b5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:07.813585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78f360954c5412d9636f8290dfa65b5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:07.814017 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:07.979104 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78f360954c5412d9636f8290dfa65b5', 'request_id': 'req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:07.985520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78f360954c5412d9636f8290dfa65b5', 'request_id': 'req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:08.054894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78f360954c5412d9636f8290dfa65b5', 'request_id': 'req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:08.066912 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591 admin admin] The token cache is being invalidate because project e78f360954c5412d9636f8290dfa65b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:48:08.067211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:08.067867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:08.069475 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1075/2173] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:48:07 2022] DELETE /identity/v3/projects/e78f360954c5412d9636f8290dfa65b5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:08.073625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b984977-34e7-4ed0-b298-8da54b0a6a21 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:08.085689 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b984977-34e7-4ed0-b298-8da54b0a6a21 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:08.107772 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:08.151642 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f3682-1e1e-4c28-b9b3-b710a7e714b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:08.154006 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f3682-1e1e-4c28-b9b3-b710a7e714b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:08.154892 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f3682-1e1e-4c28-b9b3-b710a7e714b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:08.154892 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f3682-1e1e-4c28-b9b3-b710a7e714b3 admin admin] PATH_INFO: `/v3/users/d8c32942ae3c4efd860a2e06aa8728c8` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:08.156176 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f3682-1e1e-4c28-b9b3-b710a7e714b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c32942ae3c4efd860a2e06aa8728c8)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:08.158224 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f3682-1e1e-4c28-b9b3-b710a7e714b3 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:08.348244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:08.349773 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:08.362696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c97f2-f2e8-4d0a-a343-ec269c75b591 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:08.367281 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ef05d-5403-4b77-b05f-59e3989a166f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:08.368194 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ef05d-5403-4b77-b05f-59e3989a166f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:08.368481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ef05d-5403-4b77-b05f-59e3989a166f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:08.368760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ef05d-5403-4b77-b05f-59e3989a166f admin admin] PATH_INFO: `/v3/users/35445d12ade14ae09e904226ce6eab26` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:08.370093 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ef05d-5403-4b77-b05f-59e3989a166f admin admin] RBAC: Authorizing `identity:delete_user(user_id=35445d12ade14ae09e904226ce6eab26)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:08.372604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ef05d-5403-4b77-b05f-59e3989a166f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:08.425326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-980f3682-1e1e-4c28-b9b3-b710a7e714b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c32942ae3c4efd860a2e06aa8728c8'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:08.502072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-980f3682-1e1e-4c28-b9b3-b710a7e714b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c32942ae3c4efd860a2e06aa8728c8'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:08.520293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-980f3682-1e1e-4c28-b9b3-b710a7e714b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c32942ae3c4efd860a2e06aa8728c8'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:08.521317 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-980f3682-1e1e-4c28-b9b3-b710a7e714b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c32942ae3c4efd860a2e06aa8728c8'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:08.538407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-980f3682-1e1e-4c28-b9b3-b710a7e714b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c32942ae3c4efd860a2e06aa8728c8'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:08.554161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1099/2174] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:48:08 2022] DELETE /identity/v3/users/d8c32942ae3c4efd860a2e06aa8728c8 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:08.579178 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e06ef05d-5403-4b77-b05f-59e3989a166f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35445d12ade14ae09e904226ce6eab26'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:08.695258 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e06ef05d-5403-4b77-b05f-59e3989a166f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35445d12ade14ae09e904226ce6eab26'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:08.704001 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e06ef05d-5403-4b77-b05f-59e3989a166f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35445d12ade14ae09e904226ce6eab26'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:08.704706 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e06ef05d-5403-4b77-b05f-59e3989a166f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35445d12ade14ae09e904226ce6eab26'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:08.721411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-e06ef05d-5403-4b77-b05f-59e3989a166f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35445d12ade14ae09e904226ce6eab26'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:08.729339 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1076/2175] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:48:08 2022] DELETE /identity/v3/users/35445d12ade14ae09e904226ce6eab26 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:48:08.735060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdfa9b-9ab8-4526-a982-748dfe793066 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:08.735353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdfa9b-9ab8-4526-a982-748dfe793066 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:08.735631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdfa9b-9ab8-4526-a982-748dfe793066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:08.761518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-51cdfa9b-9ab8-4526-a982-748dfe793066 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:08.763880 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-51cdfa9b-9ab8-4526-a982-748dfe793066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:08.836953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1100/2176] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:08.871181 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ef05d-5403-4b77-b05f-59e3989a166f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:08.874474 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:08.875654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e06ef05d-5403-4b77-b05f-59e3989a166f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:08.960025 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ef05d-5403-4b77-b05f-59e3989a166f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:08.966018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2bce1-520f-414d-a869-ca39b0aa85a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:08.966636 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2bce1-520f-414d-a869-ca39b0aa85a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:08.966920 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2bce1-520f-414d-a869-ca39b0aa85a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:08.967202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2bce1-520f-414d-a869-ca39b0aa85a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:08.976787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2bce1-520f-414d-a869-ca39b0aa85a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:08.978401 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2bce1-520f-414d-a869-ca39b0aa85a4 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:08.989672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1077/2177] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:48:09.134812 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdfa9b-9ab8-4526-a982-748dfe793066 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:09.136270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-51cdfa9b-9ab8-4526-a982-748dfe793066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:09.149107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdfa9b-9ab8-4526-a982-748dfe793066 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:09.155226 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e5946-f26e-4a6c-8fef-c431654eca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:09.156105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e5946-f26e-4a6c-8fef-c431654eca19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:09.156390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e5946-f26e-4a6c-8fef-c431654eca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:09.156673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e5946-f26e-4a6c-8fef-c431654eca19 admin admin] PATH_INFO: `/v3/projects/f933fc8e23744824ab1126015398ecd5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:09.157925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e5946-f26e-4a6c-8fef-c431654eca19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f933fc8e23744824ab1126015398ecd5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:09.159840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e5946-f26e-4a6c-8fef-c431654eca19 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:09.276416 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:09.285622 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e06e5946-f26e-4a6c-8fef-c431654eca19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f933fc8e23744824ab1126015398ecd5', 'request_id': 'req-e06e5946-f26e-4a6c-8fef-c431654eca19'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:09.292531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e06e5946-f26e-4a6c-8fef-c431654eca19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f933fc8e23744824ab1126015398ecd5', 'request_id': 'req-e06e5946-f26e-4a6c-8fef-c431654eca19'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:09.350369 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e06e5946-f26e-4a6c-8fef-c431654eca19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f933fc8e23744824ab1126015398ecd5', 'request_id': 'req-e06e5946-f26e-4a6c-8fef-c431654eca19'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:09.362979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e06e5946-f26e-4a6c-8fef-c431654eca19 admin admin] The token cache is being invalidate because project f933fc8e23744824ab1126015398ecd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:48:09.363356 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e06e5946-f26e-4a6c-8fef-c431654eca19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:09.363980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e06e5946-f26e-4a6c-8fef-c431654eca19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:09.365731 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1101/2178] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:48:09 2022] DELETE /identity/v3/projects/f933fc8e23744824ab1126015398ecd5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:09.371322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30865936-6687-4b6e-ae53-e10e642da8eb None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:09.372061 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30865936-6687-4b6e-ae53-e10e642da8eb None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:09.372061 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30865936-6687-4b6e-ae53-e10e642da8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:09.389991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-30865936-6687-4b6e-ae53-e10e642da8eb None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:09.391198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-30865936-6687-4b6e-ae53-e10e642da8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:09.415153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e5946-f26e-4a6c-8fef-c431654eca19 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:09.416605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e06e5946-f26e-4a6c-8fef-c431654eca19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:09.479670 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1078/2179] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:09.487884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ddf48-4d21-46e5-88f7-96b3c5b2b41e None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:09.488187 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ddf48-4d21-46e5-88f7-96b3c5b2b41e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:09.490861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ddf48-4d21-46e5-88f7-96b3c5b2b41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:09.510327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e5946-f26e-4a6c-8fef-c431654eca19 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:09.515299 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-525ddf48-4d21-46e5-88f7-96b3c5b2b41e None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:09.516383 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6f718-5be2-4041-a932-606ec4bb9b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:09.516552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-525ddf48-4d21-46e5-88f7-96b3c5b2b41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:09.517309 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6f718-5be2-4041-a932-606ec4bb9b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:09.517627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6f718-5be2-4041-a932-606ec4bb9b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:09.517962 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6f718-5be2-4041-a932-606ec4bb9b19 admin admin] PATH_INFO: `/v3/projects/b96b765dc2064f228aebae472b55fcbb` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:09.519092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6f718-5be2-4041-a932-606ec4bb9b19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b96b765dc2064f228aebae472b55fcbb)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:09.521218 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6f718-5be2-4041-a932-606ec4bb9b19 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:09.524280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1079/2180] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:48:09.525103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ddf48-4d21-46e5-88f7-96b3c5b2b41e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:09.526337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-525ddf48-4d21-46e5-88f7-96b3c5b2b41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:09.584797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ddf48-4d21-46e5-88f7-96b3c5b2b41e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:09.594886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be1831-61c5-4789-a49e-b3fbfdf1a5ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:09.594886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1831-61c5-4789-a49e-b3fbfdf1a5ec service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:09.594886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1831-61c5-4789-a49e-b3fbfdf1a5ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:09.594886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1831-61c5-4789-a49e-b3fbfdf1a5ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:09.595375 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-11be1831-61c5-4789-a49e-b3fbfdf1a5ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:09.636298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2df6f718-5be2-4041-a932-606ec4bb9b19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b96b765dc2064f228aebae472b55fcbb', 'request_id': 'req-2df6f718-5be2-4041-a932-606ec4bb9b19'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:09.643819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2df6f718-5be2-4041-a932-606ec4bb9b19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b96b765dc2064f228aebae472b55fcbb', 'request_id': 'req-2df6f718-5be2-4041-a932-606ec4bb9b19'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:09.660742 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be1831-61c5-4789-a49e-b3fbfdf1a5ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:09.662238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be1831-61c5-4789-a49e-b3fbfdf1a5ec service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:09.672095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1080/2181] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:48:09.672886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be1831-61c5-4789-a49e-b3fbfdf1a5ec service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:09.682559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be1831-61c5-4789-a49e-b3fbfdf1a5ec service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:09.740334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7cb79-e94f-44cd-9fb2-9e59847fa7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:09.741058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7cb79-e94f-44cd-9fb2-9e59847fa7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:09.741339 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7cb79-e94f-44cd-9fb2-9e59847fa7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:09.741614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7cb79-e94f-44cd-9fb2-9e59847fa7c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:09.742333 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7cb79-e94f-44cd-9fb2-9e59847fa7c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:48:09.742725 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7cb79-e94f-44cd-9fb2-9e59847fa7c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:09.744346 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7cb79-e94f-44cd-9fb2-9e59847fa7c9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:09.750283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2df6f718-5be2-4041-a932-606ec4bb9b19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b96b765dc2064f228aebae472b55fcbb', 'request_id': 'req-2df6f718-5be2-4041-a932-606ec4bb9b19'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:09.755517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1081/2182] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:48:09.761008 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7cb79-e94f-44cd-9fb2-9e59847fa7c9 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:09.764371 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2df6f718-5be2-4041-a932-606ec4bb9b19 admin admin] The token cache is being invalidate because project b96b765dc2064f228aebae472b55fcbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:48:09.764921 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2df6f718-5be2-4041-a932-606ec4bb9b19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:09.765867 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2df6f718-5be2-4041-a932-606ec4bb9b19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:09.767898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1102/2183] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:48:09 2022] DELETE /identity/v3/projects/b96b765dc2064f228aebae472b55fcbb => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:48:09.772752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c6b8-cb9a-4d17-8a5f-a0b87d435838 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:09.772986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c6b8-cb9a-4d17-8a5f-a0b87d435838 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:09.773264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c6b8-cb9a-4d17-8a5f-a0b87d435838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:09.776199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7cb79-e94f-44cd-9fb2-9e59847fa7c9 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:09.784351 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141144f1-c574-431a-857f-84bd84bf6203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:09.784857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141144f1-c574-431a-857f-84bd84bf6203 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:09.786466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141144f1-c574-431a-857f-84bd84bf6203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:09.786466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141144f1-c574-431a-857f-84bd84bf6203 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:09.786466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141144f1-c574-431a-857f-84bd84bf6203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:09.788364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141144f1-c574-431a-857f-84bd84bf6203 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:09.794190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-edd3c6b8-cb9a-4d17-8a5f-a0b87d435838 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:09.795419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-edd3c6b8-cb9a-4d17-8a5f-a0b87d435838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:09.803422 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1103/2184] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:48:09.815307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34577b5-4ae8-482b-89d7-a8195b649f8f None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:09.815698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34577b5-4ae8-482b-89d7-a8195b649f8f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:09.816100 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34577b5-4ae8-482b-89d7-a8195b649f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:09.839678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-d34577b5-4ae8-482b-89d7-a8195b649f8f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:09.841735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d34577b5-4ae8-482b-89d7-a8195b649f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:09.849810 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1104/2185] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:48:09.854171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34577b5-4ae8-482b-89d7-a8195b649f8f None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:09.866337 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34577b5-4ae8-482b-89d7-a8195b649f8f None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:09.871643 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f0fbf-166b-4fc9-a877-131bd982b520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:09.872537 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f0fbf-166b-4fc9-a877-131bd982b520 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:09.872829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f0fbf-166b-4fc9-a877-131bd982b520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:09.873138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f0fbf-166b-4fc9-a877-131bd982b520 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:09.873865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f0fbf-166b-4fc9-a877-131bd982b520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:48:09.874179 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f0fbf-166b-4fc9-a877-131bd982b520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:09.875784 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f0fbf-166b-4fc9-a877-131bd982b520 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:09.889091 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1105/2186] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 17:48:09.893346 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f0fbf-166b-4fc9-a877-131bd982b520 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:09.905032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f0fbf-166b-4fc9-a877-131bd982b520 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:09.906250 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1082/2187] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:48:09 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:09.910016 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141144f1-c574-431a-857f-84bd84bf6203 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:09.911814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-141144f1-c574-431a-857f-84bd84bf6203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:09.993713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a32800-669c-4d88-9bc9-078949cba944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:09.995584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a32800-669c-4d88-9bc9-078949cba944 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:09.995870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a32800-669c-4d88-9bc9-078949cba944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:09.997094 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a32800-669c-4d88-9bc9-078949cba944 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:09.997958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a32800-669c-4d88-9bc9-078949cba944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:10.009004 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a32800-669c-4d88-9bc9-078949cba944 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:10.035882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141144f1-c574-431a-857f-84bd84bf6203 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:10.041051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e9a13-7b03-4b26-8291-0c8e4b21473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:10.042093 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e9a13-7b03-4b26-8291-0c8e4b21473b admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:10.042226 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e9a13-7b03-4b26-8291-0c8e4b21473b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:10.043422 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e9a13-7b03-4b26-8291-0c8e4b21473b admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:10.043422 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e9a13-7b03-4b26-8291-0c8e4b21473b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:10.045293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e9a13-7b03-4b26-8291-0c8e4b21473b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:10.093840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1106/2188] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:48:09 2022] POST /identity/v3/projects => generated 367 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:48:10.097256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a32800-669c-4d88-9bc9-078949cba944 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:10.171480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a32800-669c-4d88-9bc9-078949cba944 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:10.176452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072801ad-2899-4df6-b886-c32854cff7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:10.177164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072801ad-2899-4df6-b886-c32854cff7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:10.177602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072801ad-2899-4df6-b886-c32854cff7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:10.177891 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072801ad-2899-4df6-b886-c32854cff7a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:10.178595 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072801ad-2899-4df6-b886-c32854cff7a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:10.180742 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072801ad-2899-4df6-b886-c32854cff7a7 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:10.188451 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1083/2189] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:48:09 2022] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:10.193045 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e9a13-7b03-4b26-8291-0c8e4b21473b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:10.213062 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e9a13-7b03-4b26-8291-0c8e4b21473b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:10.220403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63904e-3864-4f1d-909e-07e5f1a637e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:10.221808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63904e-3864-4f1d-909e-07e5f1a637e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:10.222191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63904e-3864-4f1d-909e-07e5f1a637e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:10.222492 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63904e-3864-4f1d-909e-07e5f1a637e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:10.223217 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63904e-3864-4f1d-909e-07e5f1a637e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:10.225395 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63904e-3864-4f1d-909e-07e5f1a637e4 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:10.238520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1084/2190] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:10.242086 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63904e-3864-4f1d-909e-07e5f1a637e4 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:10.252979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63904e-3864-4f1d-909e-07e5f1a637e4 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:10.257856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6133390-f525-46a8-b080-40f1b6a4a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:10.258525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6133390-f525-46a8-b080-40f1b6a4a13b admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:10.258815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6133390-f525-46a8-b080-40f1b6a4a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:10.259403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6133390-f525-46a8-b080-40f1b6a4a13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:10.260269 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6133390-f525-46a8-b080-40f1b6a4a13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:10.262322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6133390-f525-46a8-b080-40f1b6a4a13b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:10.281539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1085/2191] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:48:10.285602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6133390-f525-46a8-b080-40f1b6a4a13b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:10.301785 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6133390-f525-46a8-b080-40f1b6a4a13b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:10.306462 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9b0df-f54f-489c-abe2-95489aae9696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:10.307355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9b0df-f54f-489c-abe2-95489aae9696 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:10.307639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9b0df-f54f-489c-abe2-95489aae9696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:10.307913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9b0df-f54f-489c-abe2-95489aae9696 admin admin] PATH_INFO: `/v3/projects/ac70662930bf4cdd8a0c9fd66963eb17/users/15c2632a7c7b496bb09bff45397be94b/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:10.325526 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9b0df-f54f-489c-abe2-95489aae9696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac70662930bf4cdd8a0c9fd66963eb17, user_id=15c2632a7c7b496bb09bff45397be94b, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:10.328214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9b0df-f54f-489c-abe2-95489aae9696 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:10.369641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1107/2192] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:48:10 2022] POST /identity/v3/users => generated 284 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:10.370974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072801ad-2899-4df6-b886-c32854cff7a7 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:10.383434 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072801ad-2899-4df6-b886-c32854cff7a7 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:10.389316 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677edb9-4ad2-42b0-acb0-71c39b473db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:10.389997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677edb9-4ad2-42b0-acb0-71c39b473db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:10.390285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677edb9-4ad2-42b0-acb0-71c39b473db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:10.390567 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677edb9-4ad2-42b0-acb0-71c39b473db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:10.391323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677edb9-4ad2-42b0-acb0-71c39b473db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:10.393147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677edb9-4ad2-42b0-acb0-71c39b473db4 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:10.406493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1108/2193] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:48:10.408800 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677edb9-4ad2-42b0-acb0-71c39b473db4 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:10.417902 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677edb9-4ad2-42b0-acb0-71c39b473db4 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:10.427360 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01225540-6c9b-4e66-b476-ec235de1ff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:10.428437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:10.428707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01225540-6c9b-4e66-b476-ec235de1ff85 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:10.429086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01225540-6c9b-4e66-b476-ec235de1ff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:10.429455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01225540-6c9b-4e66-b476-ec235de1ff85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:10.431795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01225540-6c9b-4e66-b476-ec235de1ff85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:10.432521 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01225540-6c9b-4e66-b476-ec235de1ff85 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:10.452776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1086/2194] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:48:10 2022] PUT /identity/v3/projects/ac70662930bf4cdd8a0c9fd66963eb17/users/15c2632a7c7b496bb09bff45397be94b/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:10.454831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcdc72-20d8-406b-86fb-3c1cba99e35f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:10.455009 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcdc72-20d8-406b-86fb-3c1cba99e35f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:10.455369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcdc72-20d8-406b-86fb-3c1cba99e35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:10.464165 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1109/2195] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:48:10.468841 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01225540-6c9b-4e66-b476-ec235de1ff85 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:10.489139 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01225540-6c9b-4e66-b476-ec235de1ff85 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:10.518209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c7bcdc72-20d8-406b-86fb-3c1cba99e35f None None] MFA Rules not processed for user `15c2632a7c7b496bb09bff45397be94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:10.519561 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c7bcdc72-20d8-406b-86fb-3c1cba99e35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:10.557369 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadf600-7c24-4fd7-9d21-04da3d08cb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:10.558626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadf600-7c24-4fd7-9d21-04da3d08cb17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:10.559545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadf600-7c24-4fd7-9d21-04da3d08cb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:10.559943 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadf600-7c24-4fd7-9d21-04da3d08cb17 admin admin] PATH_INFO: `/v3/projects/5c846582d6fe4d8698d1a3846d074131/users/3d4555804e404bc6a18745ab1a12349b/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:10.577725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadf600-7c24-4fd7-9d21-04da3d08cb17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c846582d6fe4d8698d1a3846d074131, user_id=3d4555804e404bc6a18745ab1a12349b, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:10.580597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadf600-7c24-4fd7-9d21-04da3d08cb17 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:10.610324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1087/2196] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:48:10.619276 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcdc72-20d8-406b-86fb-3c1cba99e35f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:10.620770 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c7bcdc72-20d8-406b-86fb-3c1cba99e35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:10.691689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcdc72-20d8-406b-86fb-3c1cba99e35f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:10.696046 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317ee51-4901-4389-aaca-10aff3169faa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:10.696701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317ee51-4901-4389-aaca-10aff3169faa service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:10.697022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317ee51-4901-4389-aaca-10aff3169faa service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:10.697314 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317ee51-4901-4389-aaca-10aff3169faa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:10.702457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:10.707041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317ee51-4901-4389-aaca-10aff3169faa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:10.708514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317ee51-4901-4389-aaca-10aff3169faa service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:10.711849 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1110/2197] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:48:10 2022] PUT /identity/v3/projects/5c846582d6fe4d8698d1a3846d074131/users/3d4555804e404bc6a18745ab1a12349b/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:48:10.724019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be12ede-8786-4a8f-a09a-2b8f6f8ec2af None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:10.724762 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be12ede-8786-4a8f-a09a-2b8f6f8ec2af None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:10.725094 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be12ede-8786-4a8f-a09a-2b8f6f8ec2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:10.725201 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1088/2198] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:48:10.749250 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317ee51-4901-4389-aaca-10aff3169faa service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:10.759102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-7be12ede-8786-4a8f-a09a-2b8f6f8ec2af None None] MFA Rules not processed for user `3d4555804e404bc6a18745ab1a12349b`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:10.760695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7be12ede-8786-4a8f-a09a-2b8f6f8ec2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:10.762586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317ee51-4901-4389-aaca-10aff3169faa service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:10.828822 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611a1f8-4524-4508-8eec-05aacba9b0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:10.829545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611a1f8-4524-4508-8eec-05aacba9b0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:10.829878 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611a1f8-4524-4508-8eec-05aacba9b0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:10.830171 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611a1f8-4524-4508-8eec-05aacba9b0f4 admin admin] PATH_INFO: `/v3/users/15c2632a7c7b496bb09bff45397be94b` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:10.835664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611a1f8-4524-4508-8eec-05aacba9b0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c2632a7c7b496bb09bff45397be94b)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:10.836845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1111/2199] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:10.842202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611a1f8-4524-4508-8eec-05aacba9b0f4 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:10.849299 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be12ede-8786-4a8f-a09a-2b8f6f8ec2af None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:10.850788 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7be12ede-8786-4a8f-a09a-2b8f6f8ec2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:10.911044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be12ede-8786-4a8f-a09a-2b8f6f8ec2af None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:10.914675 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe740850-f556-4fb2-8ab0-e7ecc12552fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b34d05889f3c4d469f4661061457cb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:10.915326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe740850-f556-4fb2-8ab0-e7ecc12552fe service glance] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:10.915643 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe740850-f556-4fb2-8ab0-e7ecc12552fe service glance] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:10.915924 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe740850-f556-4fb2-8ab0-e7ecc12552fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:10.924908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe740850-f556-4fb2-8ab0-e7ecc12552fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:10.926361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe740850-f556-4fb2-8ab0-e7ecc12552fe service glance] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:10.935584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1112/2200] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:48:11.014235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7611a1f8-4524-4508-8eec-05aacba9b0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c2632a7c7b496bb09bff45397be94b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:11.100701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7611a1f8-4524-4508-8eec-05aacba9b0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c2632a7c7b496bb09bff45397be94b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:11.109231 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7611a1f8-4524-4508-8eec-05aacba9b0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c2632a7c7b496bb09bff45397be94b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:11.109978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7611a1f8-4524-4508-8eec-05aacba9b0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c2632a7c7b496bb09bff45397be94b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:11.132983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7611a1f8-4524-4508-8eec-05aacba9b0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c2632a7c7b496bb09bff45397be94b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:11.136666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:11.145536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1089/2201] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:48:10 2022] DELETE /identity/v3/users/15c2632a7c7b496bb09bff45397be94b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:11.150368 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e529bd1-a569-4baf-b3fa-2c5cbda60b0e None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:11.150734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e529bd1-a569-4baf-b3fa-2c5cbda60b0e None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:11.151487 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e529bd1-a569-4baf-b3fa-2c5cbda60b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:11.179191 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-7e529bd1-a569-4baf-b3fa-2c5cbda60b0e None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:11.180574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7e529bd1-a569-4baf-b3fa-2c5cbda60b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:11.280089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1113/2202] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:11.303616 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611a1f8-4524-4508-8eec-05aacba9b0f4 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:11.305510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7611a1f8-4524-4508-8eec-05aacba9b0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:11.396502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611a1f8-4524-4508-8eec-05aacba9b0f4 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:11.398938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d305c20-4a11-4f78-9c17-205622efaa29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:11.399628 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d305c20-4a11-4f78-9c17-205622efaa29 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:11.400169 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d305c20-4a11-4f78-9c17-205622efaa29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:11.400278 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d305c20-4a11-4f78-9c17-205622efaa29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:11.411370 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d305c20-4a11-4f78-9c17-205622efaa29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:11.412859 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d305c20-4a11-4f78-9c17-205622efaa29 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:11.423907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1090/2203] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:48:11.857437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:11.901872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:12.114831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e529bd1-a569-4baf-b3fa-2c5cbda60b0e None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:12.117220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7e529bd1-a569-4baf-b3fa-2c5cbda60b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:12.135460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e529bd1-a569-4baf-b3fa-2c5cbda60b0e None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:12.142296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d682eb-34ee-497b-b089-7b10d64d3a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:12.143382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d682eb-34ee-497b-b089-7b10d64d3a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:12.143656 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d682eb-34ee-497b-b089-7b10d64d3a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:12.144011 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d682eb-34ee-497b-b089-7b10d64d3a5d admin admin] PATH_INFO: `/v3/projects/ac70662930bf4cdd8a0c9fd66963eb17` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:12.145310 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d682eb-34ee-497b-b089-7b10d64d3a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac70662930bf4cdd8a0c9fd66963eb17)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:12.147468 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d682eb-34ee-497b-b089-7b10d64d3a5d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:12.278133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:12.290788 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-47d682eb-34ee-497b-b089-7b10d64d3a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac70662930bf4cdd8a0c9fd66963eb17', 'request_id': 'req-47d682eb-34ee-497b-b089-7b10d64d3a5d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:12.297709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-47d682eb-34ee-497b-b089-7b10d64d3a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac70662930bf4cdd8a0c9fd66963eb17', 'request_id': 'req-47d682eb-34ee-497b-b089-7b10d64d3a5d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:12.610061 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-47d682eb-34ee-497b-b089-7b10d64d3a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac70662930bf4cdd8a0c9fd66963eb17', 'request_id': 'req-47d682eb-34ee-497b-b089-7b10d64d3a5d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:12.623373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-47d682eb-34ee-497b-b089-7b10d64d3a5d admin admin] The token cache is being invalidate because project ac70662930bf4cdd8a0c9fd66963eb17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:48:12.623668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-47d682eb-34ee-497b-b089-7b10d64d3a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:12.625378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-47d682eb-34ee-497b-b089-7b10d64d3a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:12.640968 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1114/2204] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:48:12 2022] DELETE /identity/v3/projects/ac70662930bf4cdd8a0c9fd66963eb17 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:15.916854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d305c20-4a11-4f78-9c17-205622efaa29 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:15.918387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5d305c20-4a11-4f78-9c17-205622efaa29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:15.936714 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d305c20-4a11-4f78-9c17-205622efaa29 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:16.002927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90727ba-c621-41a5-b3d3-90e6a8d27895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:16.003807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90727ba-c621-41a5-b3d3-90e6a8d27895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:16.004086 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90727ba-c621-41a5-b3d3-90e6a8d27895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:16.004358 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90727ba-c621-41a5-b3d3-90e6a8d27895 admin admin] PATH_INFO: `/v3/users/3d8739db4fbf4fd981b99ab829d33e72` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:16.005571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90727ba-c621-41a5-b3d3-90e6a8d27895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8739db4fbf4fd981b99ab829d33e72)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:16.007560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90727ba-c621-41a5-b3d3-90e6a8d27895 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:16.195315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:16.204949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f90727ba-c621-41a5-b3d3-90e6a8d27895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8739db4fbf4fd981b99ab829d33e72'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:16.278327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f90727ba-c621-41a5-b3d3-90e6a8d27895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8739db4fbf4fd981b99ab829d33e72'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:16.286606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f90727ba-c621-41a5-b3d3-90e6a8d27895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8739db4fbf4fd981b99ab829d33e72'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:16.288448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f90727ba-c621-41a5-b3d3-90e6a8d27895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8739db4fbf4fd981b99ab829d33e72'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:16.301120 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f90727ba-c621-41a5-b3d3-90e6a8d27895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8739db4fbf4fd981b99ab829d33e72'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:16.308341 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1091/2205] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:48:15 2022] DELETE /identity/v3/users/3d8739db4fbf4fd981b99ab829d33e72 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:16.314018 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fb618-bec9-4689-810f-b9e36e1dcf0d None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:16.314418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fb618-bec9-4689-810f-b9e36e1dcf0d None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:16.314605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fb618-bec9-4689-810f-b9e36e1dcf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:16.334568 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-641fb618-bec9-4689-810f-b9e36e1dcf0d None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:16.335423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-641fb618-bec9-4689-810f-b9e36e1dcf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:16.415374 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1115/2206] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:16.426888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90727ba-c621-41a5-b3d3-90e6a8d27895 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:16.428453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f90727ba-c621-41a5-b3d3-90e6a8d27895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:16.507865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90727ba-c621-41a5-b3d3-90e6a8d27895 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:16.511582 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19093743-0282-4dc4-8503-e9282e6d005e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:16.512227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19093743-0282-4dc4-8503-e9282e6d005e service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:16.512519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19093743-0282-4dc4-8503-e9282e6d005e service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:16.512797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19093743-0282-4dc4-8503-e9282e6d005e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:16.523639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19093743-0282-4dc4-8503-e9282e6d005e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:16.525160 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19093743-0282-4dc4-8503-e9282e6d005e service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:16.535830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1092/2207] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:48:17.014694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fb618-bec9-4689-810f-b9e36e1dcf0d None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:17.016327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-641fb618-bec9-4689-810f-b9e36e1dcf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:17.031098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fb618-bec9-4689-810f-b9e36e1dcf0d None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:17.044656 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:17.045673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:17.046081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:17.046408 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6 admin admin] PATH_INFO: `/v3/projects/4102b5941c3f4b3ca0d821ceecc6f150` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:17.048471 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4102b5941c3f4b3ca0d821ceecc6f150)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:17.050603 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:17.183789 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4102b5941c3f4b3ca0d821ceecc6f150', 'request_id': 'req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:17.190873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4102b5941c3f4b3ca0d821ceecc6f150', 'request_id': 'req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:17.272178 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4102b5941c3f4b3ca0d821ceecc6f150', 'request_id': 'req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:17.284975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6 admin admin] The token cache is being invalidate because project 4102b5941c3f4b3ca0d821ceecc6f150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:48:17.285833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:17.286082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:17.287675 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1116/2208] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:48:17 2022] DELETE /identity/v3/projects/4102b5941c3f4b3ca0d821ceecc6f150 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:17.292247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19093743-0282-4dc4-8503-e9282e6d005e service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:17.303449 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19093743-0282-4dc4-8503-e9282e6d005e service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:17.367156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac5ebb-0dc9-47e2-8600-275e6c4e3d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:17.368041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac5ebb-0dc9-47e2-8600-275e6c4e3d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:17.368325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac5ebb-0dc9-47e2-8600-275e6c4e3d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:17.368599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac5ebb-0dc9-47e2-8600-275e6c4e3d48 admin admin] PATH_INFO: `/v3/users/91b88d99936947f3b03a89adf5550eb9` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:17.369838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac5ebb-0dc9-47e2-8600-275e6c4e3d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b88d99936947f3b03a89adf5550eb9)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:17.371814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac5ebb-0dc9-47e2-8600-275e6c4e3d48 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:17.603711 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4aac5ebb-0dc9-47e2-8600-275e6c4e3d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b88d99936947f3b03a89adf5550eb9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:17.683490 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4aac5ebb-0dc9-47e2-8600-275e6c4e3d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b88d99936947f3b03a89adf5550eb9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:17.690587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:17.692761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4aac5ebb-0dc9-47e2-8600-275e6c4e3d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b88d99936947f3b03a89adf5550eb9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:17.693623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4aac5ebb-0dc9-47e2-8600-275e6c4e3d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b88d99936947f3b03a89adf5550eb9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:17.706605 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4aac5ebb-0dc9-47e2-8600-275e6c4e3d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b88d99936947f3b03a89adf5550eb9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:17.713009 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1093/2209] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:48:17 2022] DELETE /identity/v3/users/91b88d99936947f3b03a89adf5550eb9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 17:48:18.223685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:18.225347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:18.239801 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8efbb3-b6db-417d-8ddd-b421cda76cc6 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:18.294447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:18.309573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3761e-c28d-498c-b009-ce915c2386be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:18.310484 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3761e-c28d-498c-b009-ce915c2386be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:18.310770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3761e-c28d-498c-b009-ce915c2386be admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:18.311122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3761e-c28d-498c-b009-ce915c2386be admin admin] PATH_INFO: `/v3/projects/8398bd8ffe594438a8cfe53d513bfe30` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:18.312496 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3761e-c28d-498c-b009-ce915c2386be admin admin] RBAC: Authorizing `identity:delete_project(project_id=8398bd8ffe594438a8cfe53d513bfe30)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:18.315839 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3761e-c28d-498c-b009-ce915c2386be admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:18.432752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2ba3761e-c28d-498c-b009-ce915c2386be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8398bd8ffe594438a8cfe53d513bfe30', 'request_id': 'req-2ba3761e-c28d-498c-b009-ce915c2386be'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:18.439046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2ba3761e-c28d-498c-b009-ce915c2386be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8398bd8ffe594438a8cfe53d513bfe30', 'request_id': 'req-2ba3761e-c28d-498c-b009-ce915c2386be'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:18.516608 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2ba3761e-c28d-498c-b009-ce915c2386be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8398bd8ffe594438a8cfe53d513bfe30', 'request_id': 'req-2ba3761e-c28d-498c-b009-ce915c2386be'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:18.538906 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2ba3761e-c28d-498c-b009-ce915c2386be admin admin] The token cache is being invalidate because project 8398bd8ffe594438a8cfe53d513bfe30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:48:18.539137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2ba3761e-c28d-498c-b009-ce915c2386be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:18.539819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2ba3761e-c28d-498c-b009-ce915c2386be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:18.541414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1117/2210] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:48:18 2022] DELETE /identity/v3/projects/8398bd8ffe594438a8cfe53d513bfe30 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:18.546071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac5ebb-0dc9-47e2-8600-275e6c4e3d48 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:18.548596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4aac5ebb-0dc9-47e2-8600-275e6c4e3d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:18.567892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac5ebb-0dc9-47e2-8600-275e6c4e3d48 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:18.641275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7cae4-73d4-4365-b7e6-818c30d9f24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:18.642132 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7cae4-73d4-4365-b7e6-818c30d9f24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:18.642417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7cae4-73d4-4365-b7e6-818c30d9f24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:18.642699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7cae4-73d4-4365-b7e6-818c30d9f24c admin admin] PATH_INFO: `/v3/users/5e0fd45738df4944879579d715aaa875` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:18.643904 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7cae4-73d4-4365-b7e6-818c30d9f24c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0fd45738df4944879579d715aaa875)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:18.645909 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7cae4-73d4-4365-b7e6-818c30d9f24c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:18.807228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a4f7cae4-73d4-4365-b7e6-818c30d9f24c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0fd45738df4944879579d715aaa875'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:18.872035 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a4f7cae4-73d4-4365-b7e6-818c30d9f24c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0fd45738df4944879579d715aaa875'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:18.880237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a4f7cae4-73d4-4365-b7e6-818c30d9f24c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0fd45738df4944879579d715aaa875'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:18.881592 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a4f7cae4-73d4-4365-b7e6-818c30d9f24c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0fd45738df4944879579d715aaa875'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:18.893683 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a4f7cae4-73d4-4365-b7e6-818c30d9f24c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0fd45738df4944879579d715aaa875'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:18.899925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1094/2211] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:48:18 2022] DELETE /identity/v3/users/5e0fd45738df4944879579d715aaa875 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:19.340480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3761e-c28d-498c-b009-ce915c2386be admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:19.342121 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-2ba3761e-c28d-498c-b009-ce915c2386be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:19.356642 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3761e-c28d-498c-b009-ce915c2386be admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:19.433337 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b436cc-e7bf-4b1e-ae85-6eaaaca2d05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:19.434418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b436cc-e7bf-4b1e-ae85-6eaaaca2d05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:19.434698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b436cc-e7bf-4b1e-ae85-6eaaaca2d05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:19.434977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b436cc-e7bf-4b1e-ae85-6eaaaca2d05d admin admin] PATH_INFO: `/v3/projects/ca2cc987196f4e12819acf9de6a54423` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:19.436182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b436cc-e7bf-4b1e-ae85-6eaaaca2d05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2cc987196f4e12819acf9de6a54423)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:19.438965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b436cc-e7bf-4b1e-ae85-6eaaaca2d05d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:19.564667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-a0b436cc-e7bf-4b1e-ae85-6eaaaca2d05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2cc987196f4e12819acf9de6a54423', 'request_id': 'req-a0b436cc-e7bf-4b1e-ae85-6eaaaca2d05d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:19.571567 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-a0b436cc-e7bf-4b1e-ae85-6eaaaca2d05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2cc987196f4e12819acf9de6a54423', 'request_id': 'req-a0b436cc-e7bf-4b1e-ae85-6eaaaca2d05d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:19.654624 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-a0b436cc-e7bf-4b1e-ae85-6eaaaca2d05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2cc987196f4e12819acf9de6a54423', 'request_id': 'req-a0b436cc-e7bf-4b1e-ae85-6eaaaca2d05d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:19.666720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-a0b436cc-e7bf-4b1e-ae85-6eaaaca2d05d admin admin] The token cache is being invalidate because project ca2cc987196f4e12819acf9de6a54423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:48:19.667004 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-a0b436cc-e7bf-4b1e-ae85-6eaaaca2d05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:19.667638 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-a0b436cc-e7bf-4b1e-ae85-6eaaaca2d05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:48:19.669237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1118/2212] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:48:19 2022] DELETE /identity/v3/projects/ca2cc987196f4e12819acf9de6a54423 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:19.675296 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c30eb-cd45-461e-b4cb-637b9bdd99bc None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:19.676201 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c30eb-cd45-461e-b4cb-637b9bdd99bc None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:19.676490 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c30eb-cd45-461e-b4cb-637b9bdd99bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:19.702458 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0f5c30eb-cd45-461e-b4cb-637b9bdd99bc None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:19.703719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0f5c30eb-cd45-461e-b4cb-637b9bdd99bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:19.758805 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:19.769808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1095/2213] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:19.777466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c83092-ddbf-4f9e-bb12-a543a60cbb0d None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:19.777700 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c83092-ddbf-4f9e-bb12-a543a60cbb0d None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:19.778007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c83092-ddbf-4f9e-bb12-a543a60cbb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:19.785473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:19.796289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-e2c83092-ddbf-4f9e-bb12-a543a60cbb0d None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:19.798348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e2c83092-ddbf-4f9e-bb12-a543a60cbb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:19.806745 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1119/2214] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:19.811343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c30eb-cd45-461e-b4cb-637b9bdd99bc None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:19.822856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c30eb-cd45-461e-b4cb-637b9bdd99bc None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:19.827568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25047fd2-b2bb-4e3f-afc6-49a52cf0a4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:19.828248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25047fd2-b2bb-4e3f-afc6-49a52cf0a4ee admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:19.828518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25047fd2-b2bb-4e3f-afc6-49a52cf0a4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:19.828855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25047fd2-b2bb-4e3f-afc6-49a52cf0a4ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:19.829763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25047fd2-b2bb-4e3f-afc6-49a52cf0a4ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:48:19.830075 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25047fd2-b2bb-4e3f-afc6-49a52cf0a4ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:19.831696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25047fd2-b2bb-4e3f-afc6-49a52cf0a4ee admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:19.845741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1096/2215] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:48:19.849922 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c83092-ddbf-4f9e-bb12-a543a60cbb0d None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:19.859452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c83092-ddbf-4f9e-bb12-a543a60cbb0d None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:19.864620 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761b040-e061-4237-9f89-f00b80014f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:19.865475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761b040-e061-4237-9f89-f00b80014f2d admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:19.865760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761b040-e061-4237-9f89-f00b80014f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:19.866054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761b040-e061-4237-9f89-f00b80014f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:19.866745 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761b040-e061-4237-9f89-f00b80014f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:19.868637 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761b040-e061-4237-9f89-f00b80014f2d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:19.965138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1120/2216] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:48:19 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:19.969192 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25047fd2-b2bb-4e3f-afc6-49a52cf0a4ee admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:19.979852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25047fd2-b2bb-4e3f-afc6-49a52cf0a4ee admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:20.036093 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeff900-d826-46e9-a534-4834e325c517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:20.036691 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff900-d826-46e9-a534-4834e325c517 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:20.037008 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff900-d826-46e9-a534-4834e325c517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:20.037289 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff900-d826-46e9-a534-4834e325c517 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:20.037985 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeff900-d826-46e9-a534-4834e325c517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:20.039911 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeff900-d826-46e9-a534-4834e325c517 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:20.119481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1097/2217] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:48:19 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:20.123678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761b040-e061-4237-9f89-f00b80014f2d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:20.134021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761b040-e061-4237-9f89-f00b80014f2d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:20.138605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8ae26-3d75-451c-9b2e-2f7397079401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:20.139299 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8ae26-3d75-451c-9b2e-2f7397079401 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:20.139815 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8ae26-3d75-451c-9b2e-2f7397079401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:20.140269 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8ae26-3d75-451c-9b2e-2f7397079401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:20.144539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8ae26-3d75-451c-9b2e-2f7397079401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:20.144539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8ae26-3d75-451c-9b2e-2f7397079401 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:20.154262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1121/2218] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:20.159083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeff900-d826-46e9-a534-4834e325c517 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:20.169126 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeff900-d826-46e9-a534-4834e325c517 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:20.174370 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9fc5e-30a5-4780-8d89-90855d6ed7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:20.175047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9fc5e-30a5-4780-8d89-90855d6ed7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:20.175315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9fc5e-30a5-4780-8d89-90855d6ed7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:20.175596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9fc5e-30a5-4780-8d89-90855d6ed7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:20.176325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9fc5e-30a5-4780-8d89-90855d6ed7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:20.177956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9fc5e-30a5-4780-8d89-90855d6ed7f8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:20.187706 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1098/2219] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:20.192081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8ae26-3d75-451c-9b2e-2f7397079401 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:20.202164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8ae26-3d75-451c-9b2e-2f7397079401 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:20.207358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa36342-c280-42f9-8dec-fe983f11c089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:20.208247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa36342-c280-42f9-8dec-fe983f11c089 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:20.208525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa36342-c280-42f9-8dec-fe983f11c089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:20.208798 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa36342-c280-42f9-8dec-fe983f11c089 admin admin] PATH_INFO: `/v3/projects/889878507fdb4e6791348f4f989b0932/users/fb4a1cae173c4793a49032181d6417af/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:20.224752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa36342-c280-42f9-8dec-fe983f11c089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=889878507fdb4e6791348f4f989b0932, user_id=fb4a1cae173c4793a49032181d6417af, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:20.235076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa36342-c280-42f9-8dec-fe983f11c089 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:20.349938 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1122/2220] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:48:20 2022] PUT /identity/v3/projects/889878507fdb4e6791348f4f989b0932/users/fb4a1cae173c4793a49032181d6417af/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:20.352482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1b5b0-ed01-4da5-8989-e22f9b8b5fe2 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:20.352780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1b5b0-ed01-4da5-8989-e22f9b8b5fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:20.353094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1b5b0-ed01-4da5-8989-e22f9b8b5fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:20.372488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-63f1b5b0-ed01-4da5-8989-e22f9b8b5fe2 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:20.373737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-63f1b5b0-ed01-4da5-8989-e22f9b8b5fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:20.437821 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1099/2221] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:20.447511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa36342-c280-42f9-8dec-fe983f11c089 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:20.449326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-aaa36342-c280-42f9-8dec-fe983f11c089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:20.514853 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa36342-c280-42f9-8dec-fe983f11c089 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:20.518705 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009df93-54a4-4f2f-9826-4b89bb8f777c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:20.519365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009df93-54a4-4f2f-9826-4b89bb8f777c service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:20.519651 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009df93-54a4-4f2f-9826-4b89bb8f777c service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:20.519932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009df93-54a4-4f2f-9826-4b89bb8f777c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:20.529609 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009df93-54a4-4f2f-9826-4b89bb8f777c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:20.542569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009df93-54a4-4f2f-9826-4b89bb8f777c service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:20.542569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1123/2222] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:48:26.353035 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a4a99-8b92-49c8-806c-cc14b6ed31a7 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:26.353572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a4a99-8b92-49c8-806c-cc14b6ed31a7 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:26.353684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a4a99-8b92-49c8-806c-cc14b6ed31a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:26.393236 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1c4a4a99-8b92-49c8-806c-cc14b6ed31a7 None None] MFA Rules not processed for user `6863a714f4cf4350940d638c82fbc650`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:26.394904 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1c4a4a99-8b92-49c8-806c-cc14b6ed31a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:26.498309 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1100/2223] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:26.601854 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5970b-5408-45a3-93cc-3d2c75f94e11 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:26.602714 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5970b-5408-45a3-93cc-3d2c75f94e11 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:26.603159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5970b-5408-45a3-93cc-3d2c75f94e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:26.645172 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-fcc5970b-5408-45a3-93cc-3d2c75f94e11 None None] MFA Rules not processed for user `fb4a1cae173c4793a49032181d6417af`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:26.649541 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-fcc5970b-5408-45a3-93cc-3d2c75f94e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:26.759426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1124/2224] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:26.770809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a4a99-8b92-49c8-806c-cc14b6ed31a7 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:26.786843 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a4a99-8b92-49c8-806c-cc14b6ed31a7 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:26.795912 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b11f7-3686-4a76-87d1-d54886945031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:26.796862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b11f7-3686-4a76-87d1-d54886945031 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:26.797337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b11f7-3686-4a76-87d1-d54886945031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:26.798454 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b11f7-3686-4a76-87d1-d54886945031 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:26.798792 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b11f7-3686-4a76-87d1-d54886945031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:26.801020 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b11f7-3686-4a76-87d1-d54886945031 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:26.806031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:26.920568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1101/2225] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:48:26 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:48:26.926100 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5970b-5408-45a3-93cc-3d2c75f94e11 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:26.938881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5970b-5408-45a3-93cc-3d2c75f94e11 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:26.992784 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:27.032591 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac31675-17ae-4655-bd82-67445db160fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:27.033308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac31675-17ae-4655-bd82-67445db160fc admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:27.033589 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac31675-17ae-4655-bd82-67445db160fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:27.033866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac31675-17ae-4655-bd82-67445db160fc admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:27.034565 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac31675-17ae-4655-bd82-67445db160fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:27.036561 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac31675-17ae-4655-bd82-67445db160fc admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:27.131893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1125/2226] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:48:26 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:48:27.136339 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b11f7-3686-4a76-87d1-d54886945031 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:27.149370 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b11f7-3686-4a76-87d1-d54886945031 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:27.154842 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f09ab9-99f4-4726-bd06-c67e37c904f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:27.155560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09ab9-99f4-4726-bd06-c67e37c904f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:27.155847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09ab9-99f4-4726-bd06-c67e37c904f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:27.156125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09ab9-99f4-4726-bd06-c67e37c904f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:27.157536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f09ab9-99f4-4726-bd06-c67e37c904f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:27.159214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f09ab9-99f4-4726-bd06-c67e37c904f3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:27.170130 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1102/2227] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:27.176372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac31675-17ae-4655-bd82-67445db160fc admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:27.187785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac31675-17ae-4655-bd82-67445db160fc admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:27.194155 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef6331-0db3-460b-bf47-fad37b541b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:27.195062 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef6331-0db3-460b-bf47-fad37b541b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:27.195353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef6331-0db3-460b-bf47-fad37b541b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:27.195622 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef6331-0db3-460b-bf47-fad37b541b8d admin admin] PATH_INFO: `/v3/projects/b5796adc2c9747be90ca88f4bec0ab27/users/5e60341f1bec4ee981fc9b6e6ec4384d/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:27.214012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef6331-0db3-460b-bf47-fad37b541b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5796adc2c9747be90ca88f4bec0ab27, user_id=5e60341f1bec4ee981fc9b6e6ec4384d, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:27.216791 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef6331-0db3-460b-bf47-fad37b541b8d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:27.306150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1126/2228] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:48:27 2022] PUT /identity/v3/projects/b5796adc2c9747be90ca88f4bec0ab27/users/5e60341f1bec4ee981fc9b6e6ec4384d/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:27.310510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f09ab9-99f4-4726-bd06-c67e37c904f3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:27.323876 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f09ab9-99f4-4726-bd06-c67e37c904f3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:27.389662 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f849c1-9359-41e8-86c2-2b3066a35f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:27.390364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f849c1-9359-41e8-86c2-2b3066a35f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:27.390737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f849c1-9359-41e8-86c2-2b3066a35f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:27.391133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f849c1-9359-41e8-86c2-2b3066a35f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:27.392878 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f849c1-9359-41e8-86c2-2b3066a35f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:27.394561 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f849c1-9359-41e8-86c2-2b3066a35f9b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:27.405478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1103/2229] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:48:27.410344 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef6331-0db3-460b-bf47-fad37b541b8d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:27.424123 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef6331-0db3-460b-bf47-fad37b541b8d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:27.430301 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf080ad-4cdb-4392-9f93-87537174ab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:27.431034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf080ad-4cdb-4392-9f93-87537174ab63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:27.431389 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf080ad-4cdb-4392-9f93-87537174ab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:27.431805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf080ad-4cdb-4392-9f93-87537174ab63 admin admin] PATH_INFO: `/v3/projects/b5796adc2c9747be90ca88f4bec0ab27/users/5e60341f1bec4ee981fc9b6e6ec4384d/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:27.434962 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf080ad-4cdb-4392-9f93-87537174ab63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5796adc2c9747be90ca88f4bec0ab27, user_id=5e60341f1bec4ee981fc9b6e6ec4384d, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:27.438422 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf080ad-4cdb-4392-9f93-87537174ab63 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:27.451312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1127/2230] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:48:27 2022] PUT /identity/v3/projects/b5796adc2c9747be90ca88f4bec0ab27/users/5e60341f1bec4ee981fc9b6e6ec4384d/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:48:34.742866 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c4f79-0a95-4b15-9cef-cec491bd7b54 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:34.743344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c4f79-0a95-4b15-9cef-cec491bd7b54 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:34.743344 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c4f79-0a95-4b15-9cef-cec491bd7b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:34.773932 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ba7c4f79-0a95-4b15-9cef-cec491bd7b54 None None] MFA Rules not processed for user `5e60341f1bec4ee981fc9b6e6ec4384d`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:48:34.775175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ba7c4f79-0a95-4b15-9cef-cec491bd7b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:34.848782 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1104/2231] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:48:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:48:34.862675 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf080ad-4cdb-4392-9f93-87537174ab63 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:48:34.864471 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-acf080ad-4cdb-4392-9f93-87537174ab63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:48:34.976960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf080ad-4cdb-4392-9f93-87537174ab63 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:48:34.982592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72469c-6d75-479e-9056-a599b2f4d5a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:48:34.983249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72469c-6d75-479e-9056-a599b2f4d5a0 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:48:34.983532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72469c-6d75-479e-9056-a599b2f4d5a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:48:34.983846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72469c-6d75-479e-9056-a599b2f4d5a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:48:35.039942 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:35.042202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72469c-6d75-479e-9056-a599b2f4d5a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:48:35.043805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72469c-6d75-479e-9056-a599b2f4d5a0 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:48:35.052768 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1128/2232] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:48:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:48:44.845651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=73,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:48:45.097813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:49:07.615408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c4f79-0a95-4b15-9cef-cec491bd7b54 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:07.616888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ba7c4f79-0a95-4b15-9cef-cec491bd7b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:07.682458 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c4f79-0a95-4b15-9cef-cec491bd7b54 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:07.687026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c2ad2-899b-4ce7-ab69-018bc85e7cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:07.691563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c2ad2-899b-4ce7-ab69-018bc85e7cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:07.691563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c2ad2-899b-4ce7-ab69-018bc85e7cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:07.691563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c2ad2-899b-4ce7-ab69-018bc85e7cee admin admin] PATH_INFO: `/v3/users/5c217bd8fd374f3088f0fe3f89bf0d88` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:07.691563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c2ad2-899b-4ce7-ab69-018bc85e7cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c217bd8fd374f3088f0fe3f89bf0d88)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:07.692438 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c2ad2-899b-4ce7-ab69-018bc85e7cee admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:07.893382 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d58c2ad2-899b-4ce7-ab69-018bc85e7cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c217bd8fd374f3088f0fe3f89bf0d88'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:07.956020 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d58c2ad2-899b-4ce7-ab69-018bc85e7cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c217bd8fd374f3088f0fe3f89bf0d88'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:07.964001 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d58c2ad2-899b-4ce7-ab69-018bc85e7cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c217bd8fd374f3088f0fe3f89bf0d88'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:07.964636 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d58c2ad2-899b-4ce7-ab69-018bc85e7cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c217bd8fd374f3088f0fe3f89bf0d88'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:07.977627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d58c2ad2-899b-4ce7-ab69-018bc85e7cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c217bd8fd374f3088f0fe3f89bf0d88'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:07.983609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1105/2233] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:49:07 2022] DELETE /identity/v3/users/5c217bd8fd374f3088f0fe3f89bf0d88 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:49:07.988909 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08176fab-8e09-47fc-8f88-08bee8b01e32 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:07.989465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08176fab-8e09-47fc-8f88-08bee8b01e32 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:07.989548 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08176fab-8e09-47fc-8f88-08bee8b01e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:08.006479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-08176fab-8e09-47fc-8f88-08bee8b01e32 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:08.007680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-08176fab-8e09-47fc-8f88-08bee8b01e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:08.066091 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1129/2234] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:08.075715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c2ad2-899b-4ce7-ab69-018bc85e7cee admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:08.077178 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d58c2ad2-899b-4ce7-ab69-018bc85e7cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:08.136395 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c2ad2-899b-4ce7-ab69-018bc85e7cee admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:08.140062 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04054885-c987-4998-900f-a15ac3a90177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:08.140709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04054885-c987-4998-900f-a15ac3a90177 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:08.141040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04054885-c987-4998-900f-a15ac3a90177 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:08.141321 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04054885-c987-4998-900f-a15ac3a90177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:08.150514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04054885-c987-4998-900f-a15ac3a90177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:08.151925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04054885-c987-4998-900f-a15ac3a90177 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:08.161986 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1106/2235] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:49:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:49:08.592407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08176fab-8e09-47fc-8f88-08bee8b01e32 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:08.594498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-08176fab-8e09-47fc-8f88-08bee8b01e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:08.606370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08176fab-8e09-47fc-8f88-08bee8b01e32 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:08.611654 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff6624-c599-42c6-a1ac-9355497050b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:08.612522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff6624-c599-42c6-a1ac-9355497050b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:08.612806 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff6624-c599-42c6-a1ac-9355497050b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:08.613259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff6624-c599-42c6-a1ac-9355497050b9 admin admin] PATH_INFO: `/v3/projects/bc56082b919a41f58d36fa6265d60101` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:08.614457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff6624-c599-42c6-a1ac-9355497050b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc56082b919a41f58d36fa6265d60101)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:08.616503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff6624-c599-42c6-a1ac-9355497050b9 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:08.728401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-64ff6624-c599-42c6-a1ac-9355497050b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc56082b919a41f58d36fa6265d60101', 'request_id': 'req-64ff6624-c599-42c6-a1ac-9355497050b9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:08.734602 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-64ff6624-c599-42c6-a1ac-9355497050b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc56082b919a41f58d36fa6265d60101', 'request_id': 'req-64ff6624-c599-42c6-a1ac-9355497050b9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:08.847877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-64ff6624-c599-42c6-a1ac-9355497050b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc56082b919a41f58d36fa6265d60101', 'request_id': 'req-64ff6624-c599-42c6-a1ac-9355497050b9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:08.858830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-64ff6624-c599-42c6-a1ac-9355497050b9 admin admin] The token cache is being invalidate because project bc56082b919a41f58d36fa6265d60101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:49:08.859121 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-64ff6624-c599-42c6-a1ac-9355497050b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:08.859826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-64ff6624-c599-42c6-a1ac-9355497050b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:08.861463 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1130/2236] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:49:08 2022] DELETE /identity/v3/projects/bc56082b919a41f58d36fa6265d60101 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:49:08.866388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ad17f-2ac1-4bf5-8293-1eec55a8d8c9 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:08.866870 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ad17f-2ac1-4bf5-8293-1eec55a8d8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:08.866985 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ad17f-2ac1-4bf5-8293-1eec55a8d8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:08.885569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e68ad17f-2ac1-4bf5-8293-1eec55a8d8c9 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:08.886788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e68ad17f-2ac1-4bf5-8293-1eec55a8d8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:08.904004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:49:08.946312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1107/2237] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:08.954540 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278df1ad-2f90-4457-9a41-3c22c431dca2 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:08.954836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278df1ad-2f90-4457-9a41-3c22c431dca2 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:08.955116 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278df1ad-2f90-4457-9a41-3c22c431dca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:08.973610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-278df1ad-2f90-4457-9a41-3c22c431dca2 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:08.974816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-278df1ad-2f90-4457-9a41-3c22c431dca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:08.982719 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1131/2238] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:08.986926 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ad17f-2ac1-4bf5-8293-1eec55a8d8c9 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:08.996663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ad17f-2ac1-4bf5-8293-1eec55a8d8c9 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:09.001910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073dff6-0c4d-4a10-b8a9-f8fea45f7a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:09.002558 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073dff6-0c4d-4a10-b8a9-f8fea45f7a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:09.002836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073dff6-0c4d-4a10-b8a9-f8fea45f7a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:09.003111 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073dff6-0c4d-4a10-b8a9-f8fea45f7a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:09.003831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073dff6-0c4d-4a10-b8a9-f8fea45f7a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:49:09.004138 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073dff6-0c4d-4a10-b8a9-f8fea45f7a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:09.005888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073dff6-0c4d-4a10-b8a9-f8fea45f7a00 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:09.018377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1108/2239] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:49:09.024009 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278df1ad-2f90-4457-9a41-3c22c431dca2 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:09.033221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278df1ad-2f90-4457-9a41-3c22c431dca2 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:09.037999 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dec82a-071d-49ca-adc1-97b5f7a875a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:09.038713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dec82a-071d-49ca-adc1-97b5f7a875a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:09.038997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dec82a-071d-49ca-adc1-97b5f7a875a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:09.039382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dec82a-071d-49ca-adc1-97b5f7a875a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:09.040100 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dec82a-071d-49ca-adc1-97b5f7a875a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:09.042048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dec82a-071d-49ca-adc1-97b5f7a875a2 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:09.128012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1132/2240] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:49:09 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:49:09.132158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073dff6-0c4d-4a10-b8a9-f8fea45f7a00 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:09.142214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073dff6-0c4d-4a10-b8a9-f8fea45f7a00 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:09.199215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c920b80-11ff-4672-ae1e-83a33c8c25a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:09.199884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c920b80-11ff-4672-ae1e-83a33c8c25a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:09.200168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c920b80-11ff-4672-ae1e-83a33c8c25a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:09.200448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c920b80-11ff-4672-ae1e-83a33c8c25a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:09.201166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c920b80-11ff-4672-ae1e-83a33c8c25a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:09.203131 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c920b80-11ff-4672-ae1e-83a33c8c25a8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:09.304794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1109/2241] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:49:09 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:49:09.309124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dec82a-071d-49ca-adc1-97b5f7a875a2 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:09.320369 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dec82a-071d-49ca-adc1-97b5f7a875a2 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:09.325373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954b2f0-ab52-49ef-8e5f-fa316f72e1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:09.326112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b2f0-ab52-49ef-8e5f-fa316f72e1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:09.326399 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b2f0-ab52-49ef-8e5f-fa316f72e1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:09.326678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b2f0-ab52-49ef-8e5f-fa316f72e1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:09.327414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954b2f0-ab52-49ef-8e5f-fa316f72e1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:09.329360 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954b2f0-ab52-49ef-8e5f-fa316f72e1f9 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:09.340244 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1133/2242] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:49:09.344417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c920b80-11ff-4672-ae1e-83a33c8c25a8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:09.354467 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c920b80-11ff-4672-ae1e-83a33c8c25a8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:09.359718 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c676abb-2faa-4a8f-8c0e-021db8df346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:09.360362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c676abb-2faa-4a8f-8c0e-021db8df346a admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:09.360645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c676abb-2faa-4a8f-8c0e-021db8df346a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:09.360972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c676abb-2faa-4a8f-8c0e-021db8df346a admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:09.361712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c676abb-2faa-4a8f-8c0e-021db8df346a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:09.363359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c676abb-2faa-4a8f-8c0e-021db8df346a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:09.373227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1110/2243] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:49:09.377916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954b2f0-ab52-49ef-8e5f-fa316f72e1f9 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:09.388378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954b2f0-ab52-49ef-8e5f-fa316f72e1f9 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:09.393729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ed5c8-afe0-458c-9a08-6fc789a1f671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:09.394639 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ed5c8-afe0-458c-9a08-6fc789a1f671 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:09.394923 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ed5c8-afe0-458c-9a08-6fc789a1f671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:09.395350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ed5c8-afe0-458c-9a08-6fc789a1f671 admin admin] PATH_INFO: `/v3/projects/576af908c44544d6a5088438e2cea05d/users/51e9536c6c764a08928cf995a3b0ef95/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:09.413071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ed5c8-afe0-458c-9a08-6fc789a1f671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=576af908c44544d6a5088438e2cea05d, user_id=51e9536c6c764a08928cf995a3b0ef95, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:09.415762 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ed5c8-afe0-458c-9a08-6fc789a1f671 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:09.505403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1134/2244] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:49:09 2022] PUT /identity/v3/projects/576af908c44544d6a5088438e2cea05d/users/51e9536c6c764a08928cf995a3b0ef95/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:49:09.515709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7ff01-0d88-44f4-96ff-5906fdc745a1 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:09.516023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7ff01-0d88-44f4-96ff-5906fdc745a1 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:09.516118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7ff01-0d88-44f4-96ff-5906fdc745a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:09.543911 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f1c7ff01-0d88-44f4-96ff-5906fdc745a1 None None] MFA Rules not processed for user `51e9536c6c764a08928cf995a3b0ef95`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:09.545162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f1c7ff01-0d88-44f4-96ff-5906fdc745a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:09.612442 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1111/2245] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:49:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:09.623112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ed5c8-afe0-458c-9a08-6fc789a1f671 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:09.624863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-106ed5c8-afe0-458c-9a08-6fc789a1f671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:09.648835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:49:09.703924 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ed5c8-afe0-458c-9a08-6fc789a1f671 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:09.707745 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5924ba-730a-43e8-b861-aeb662459e06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:09.708385 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5924ba-730a-43e8-b861-aeb662459e06 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:09.708665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5924ba-730a-43e8-b861-aeb662459e06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:09.708963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5924ba-730a-43e8-b861-aeb662459e06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:09.717524 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5924ba-730a-43e8-b861-aeb662459e06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:09.719595 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5924ba-730a-43e8-b861-aeb662459e06 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:09.728292 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1135/2246] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:49:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:49:15.450389 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7ff01-0d88-44f4-96ff-5906fdc745a1 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:15.451785 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f1c7ff01-0d88-44f4-96ff-5906fdc745a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:15.474582 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:49:15.543435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7ff01-0d88-44f4-96ff-5906fdc745a1 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:15.549053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06937b07-a13e-4e0d-87b0-4e8ed17da3dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:15.549703 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06937b07-a13e-4e0d-87b0-4e8ed17da3dd service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:15.549988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06937b07-a13e-4e0d-87b0-4e8ed17da3dd service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:15.550267 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06937b07-a13e-4e0d-87b0-4e8ed17da3dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:15.552045 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-06937b07-a13e-4e0d-87b0-4e8ed17da3dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:15.564380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06937b07-a13e-4e0d-87b0-4e8ed17da3dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:15.566294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06937b07-a13e-4e0d-87b0-4e8ed17da3dd service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:15.578693 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1112/2247] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:49:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:49:17.807884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb0822-cf2a-4e89-bcfd-2ddbfe501e7f None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:17.808306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb0822-cf2a-4e89-bcfd-2ddbfe501e7f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:17.808441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb0822-cf2a-4e89-bcfd-2ddbfe501e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:17.827014 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-26fb0822-cf2a-4e89-bcfd-2ddbfe501e7f None None] MFA Rules not processed for user `51e9536c6c764a08928cf995a3b0ef95`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:17.828216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-26fb0822-cf2a-4e89-bcfd-2ddbfe501e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:17.835999 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1136/2248] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:49:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:22.120904 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30118045-e664-4a22-994c-1459c2de6008 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:22.121491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30118045-e664-4a22-994c-1459c2de6008 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:22.121491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30118045-e664-4a22-994c-1459c2de6008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:22.141001 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-30118045-e664-4a22-994c-1459c2de6008 None None] MFA Rules not processed for user `fb4a1cae173c4793a49032181d6417af`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:22.143070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-30118045-e664-4a22-994c-1459c2de6008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:22.206126 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1113/2249] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:49:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:25.051804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb0822-cf2a-4e89-bcfd-2ddbfe501e7f None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:25.053336 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-26fb0822-cf2a-4e89-bcfd-2ddbfe501e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:25.119637 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb0822-cf2a-4e89-bcfd-2ddbfe501e7f None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:25.124135 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717e4cf-a0ef-47ab-abd0-ccab5bb3f5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:25.125044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e4cf-a0ef-47ab-abd0-ccab5bb3f5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:25.125330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e4cf-a0ef-47ab-abd0-ccab5bb3f5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:25.125609 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e4cf-a0ef-47ab-abd0-ccab5bb3f5c1 admin admin] PATH_INFO: `/v3/users/3d4555804e404bc6a18745ab1a12349b` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:25.127758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717e4cf-a0ef-47ab-abd0-ccab5bb3f5c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d4555804e404bc6a18745ab1a12349b)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:25.129731 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717e4cf-a0ef-47ab-abd0-ccab5bb3f5c1 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:25.335050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7717e4cf-a0ef-47ab-abd0-ccab5bb3f5c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d4555804e404bc6a18745ab1a12349b'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:25.430280 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7717e4cf-a0ef-47ab-abd0-ccab5bb3f5c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d4555804e404bc6a18745ab1a12349b'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:25.438077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7717e4cf-a0ef-47ab-abd0-ccab5bb3f5c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d4555804e404bc6a18745ab1a12349b'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:25.438795 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7717e4cf-a0ef-47ab-abd0-ccab5bb3f5c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d4555804e404bc6a18745ab1a12349b'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:25.451258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7717e4cf-a0ef-47ab-abd0-ccab5bb3f5c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d4555804e404bc6a18745ab1a12349b'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:25.460925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1137/2250] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:49:25 2022] DELETE /identity/v3/users/3d4555804e404bc6a18745ab1a12349b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:49:25.463081 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac879ded-4669-48e2-9565-5886e1ad048e None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:25.463992 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac879ded-4669-48e2-9565-5886e1ad048e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:25.464352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac879ded-4669-48e2-9565-5886e1ad048e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:25.483777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ac879ded-4669-48e2-9565-5886e1ad048e None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:25.485284 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ac879ded-4669-48e2-9565-5886e1ad048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:25.550300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1114/2251] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:25.560461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717e4cf-a0ef-47ab-abd0-ccab5bb3f5c1 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:25.561901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7717e4cf-a0ef-47ab-abd0-ccab5bb3f5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:25.582692 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:49:25.625244 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717e4cf-a0ef-47ab-abd0-ccab5bb3f5c1 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:25.629314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a0406-dc2b-4ee3-b4c6-9f3141e8307d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:25.630120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a0406-dc2b-4ee3-b4c6-9f3141e8307d service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:25.630404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a0406-dc2b-4ee3-b4c6-9f3141e8307d service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:25.630689 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a0406-dc2b-4ee3-b4c6-9f3141e8307d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:25.643533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a0406-dc2b-4ee3-b4c6-9f3141e8307d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:25.645069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a0406-dc2b-4ee3-b4c6-9f3141e8307d service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:25.661974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1138/2252] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:49:26.196046 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac879ded-4669-48e2-9565-5886e1ad048e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:26.197795 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ac879ded-4669-48e2-9565-5886e1ad048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:26.213910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac879ded-4669-48e2-9565-5886e1ad048e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:26.219461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1151e7-0a68-4c4a-b81c-9cd1c2c0f257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:26.221150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1151e7-0a68-4c4a-b81c-9cd1c2c0f257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:26.221583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1151e7-0a68-4c4a-b81c-9cd1c2c0f257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:26.222071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1151e7-0a68-4c4a-b81c-9cd1c2c0f257 admin admin] PATH_INFO: `/v3/projects/5c846582d6fe4d8698d1a3846d074131` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:26.223509 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1151e7-0a68-4c4a-b81c-9cd1c2c0f257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c846582d6fe4d8698d1a3846d074131)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:26.225539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1151e7-0a68-4c4a-b81c-9cd1c2c0f257 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:26.347132 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:49:26.362099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fe1151e7-0a68-4c4a-b81c-9cd1c2c0f257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c846582d6fe4d8698d1a3846d074131', 'request_id': 'req-fe1151e7-0a68-4c4a-b81c-9cd1c2c0f257'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:26.368414 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fe1151e7-0a68-4c4a-b81c-9cd1c2c0f257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c846582d6fe4d8698d1a3846d074131', 'request_id': 'req-fe1151e7-0a68-4c4a-b81c-9cd1c2c0f257'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:26.435764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fe1151e7-0a68-4c4a-b81c-9cd1c2c0f257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c846582d6fe4d8698d1a3846d074131', 'request_id': 'req-fe1151e7-0a68-4c4a-b81c-9cd1c2c0f257'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:26.447774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fe1151e7-0a68-4c4a-b81c-9cd1c2c0f257 admin admin] The token cache is being invalidate because project 5c846582d6fe4d8698d1a3846d074131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:49:26.448355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fe1151e7-0a68-4c4a-b81c-9cd1c2c0f257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:26.449049 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-fe1151e7-0a68-4c4a-b81c-9cd1c2c0f257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:26.450660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1115/2253] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:49:26 2022] DELETE /identity/v3/projects/5c846582d6fe4d8698d1a3846d074131 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:49:26.455717 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c225f-71a9-4658-92da-e579f49ac838 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:26.456180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c225f-71a9-4658-92da-e579f49ac838 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:26.456291 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c225f-71a9-4658-92da-e579f49ac838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:26.474185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-892c225f-71a9-4658-92da-e579f49ac838 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:26.475417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-892c225f-71a9-4658-92da-e579f49ac838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:26.538573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1139/2254] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:26.546579 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91148a-54f0-4aaa-8345-910ca8679539 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:26.547057 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91148a-54f0-4aaa-8345-910ca8679539 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:26.547161 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91148a-54f0-4aaa-8345-910ca8679539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:26.566537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2e91148a-54f0-4aaa-8345-910ca8679539 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:26.567737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2e91148a-54f0-4aaa-8345-910ca8679539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:26.575976 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1116/2255] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:26.580158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c225f-71a9-4658-92da-e579f49ac838 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:26.590982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c225f-71a9-4658-92da-e579f49ac838 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:26.598294 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa7602-8800-454a-9fbf-3e48663a79e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:26.599234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa7602-8800-454a-9fbf-3e48663a79e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:26.599638 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa7602-8800-454a-9fbf-3e48663a79e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:26.600025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa7602-8800-454a-9fbf-3e48663a79e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:26.601181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa7602-8800-454a-9fbf-3e48663a79e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 17:49:26.601627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa7602-8800-454a-9fbf-3e48663a79e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:26.604146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa7602-8800-454a-9fbf-3e48663a79e0 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:26.622499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1140/2256] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 17:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 17:49:26.627246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91148a-54f0-4aaa-8345-910ca8679539 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:26.636476 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91148a-54f0-4aaa-8345-910ca8679539 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:26.641208 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364dfed-8bf1-4b65-81ee-7857738b6912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:26.642260 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364dfed-8bf1-4b65-81ee-7857738b6912 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:26.642569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364dfed-8bf1-4b65-81ee-7857738b6912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:26.642846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364dfed-8bf1-4b65-81ee-7857738b6912 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:26.643557 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364dfed-8bf1-4b65-81ee-7857738b6912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:26.645511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364dfed-8bf1-4b65-81ee-7857738b6912 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:26.778179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1117/2257] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 17:49:26 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 17:49:26.779589 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa7602-8800-454a-9fbf-3e48663a79e0 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:26.790651 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa7602-8800-454a-9fbf-3e48663a79e0 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:26.849919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117ca81-a994-4c7e-831a-a9f335e314f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:26.850600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117ca81-a994-4c7e-831a-a9f335e314f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:26.850888 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117ca81-a994-4c7e-831a-a9f335e314f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:26.851169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117ca81-a994-4c7e-831a-a9f335e314f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:26.851854 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117ca81-a994-4c7e-831a-a9f335e314f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:26.853807 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117ca81-a994-4c7e-831a-a9f335e314f7 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:26.985104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1141/2258] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 17:49:26 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 17:49:26.989792 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364dfed-8bf1-4b65-81ee-7857738b6912 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:26.999823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364dfed-8bf1-4b65-81ee-7857738b6912 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:27.005458 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb210c8c-beaa-419a-84fa-de337c2da756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:27.006115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb210c8c-beaa-419a-84fa-de337c2da756 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:27.006402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb210c8c-beaa-419a-84fa-de337c2da756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:27.006679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb210c8c-beaa-419a-84fa-de337c2da756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:27.007407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb210c8c-beaa-419a-84fa-de337c2da756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:27.009040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb210c8c-beaa-419a-84fa-de337c2da756 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:27.021081 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1118/2259] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 17:49:27.025809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117ca81-a994-4c7e-831a-a9f335e314f7 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:27.035957 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117ca81-a994-4c7e-831a-a9f335e314f7 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:27.040976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea3e36-32e9-4ea0-a7f6-124d0b8af377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:27.041647 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea3e36-32e9-4ea0-a7f6-124d0b8af377 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:27.041936 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea3e36-32e9-4ea0-a7f6-124d0b8af377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:27.042217 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea3e36-32e9-4ea0-a7f6-124d0b8af377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:27.042982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea3e36-32e9-4ea0-a7f6-124d0b8af377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:27.044576 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea3e36-32e9-4ea0-a7f6-124d0b8af377 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:27.055351 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1142/2260] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 17:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 17:49:27.059360 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb210c8c-beaa-419a-84fa-de337c2da756 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:27.070311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb210c8c-beaa-419a-84fa-de337c2da756 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:27.074892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c5013-6c83-4399-88d1-f0e87334c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:27.075763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c5013-6c83-4399-88d1-f0e87334c87c admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:27.076041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c5013-6c83-4399-88d1-f0e87334c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:27.076316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c5013-6c83-4399-88d1-f0e87334c87c admin admin] PATH_INFO: `/v3/projects/6f5d0a17ce8d4584ada21257eea2abfa/users/62fcfe1e52ca41b78ea48626dafbd1b9/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:27.091457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c5013-6c83-4399-88d1-f0e87334c87c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f5d0a17ce8d4584ada21257eea2abfa, user_id=62fcfe1e52ca41b78ea48626dafbd1b9, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:27.094378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c5013-6c83-4399-88d1-f0e87334c87c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:27.191365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1119/2261] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 17:49:27 2022] PUT /identity/v3/projects/6f5d0a17ce8d4584ada21257eea2abfa/users/62fcfe1e52ca41b78ea48626dafbd1b9/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:49:27.196545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb403a3-dda0-4473-a905-6f221dc98c1f None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:27.196845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb403a3-dda0-4473-a905-6f221dc98c1f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:27.197159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb403a3-dda0-4473-a905-6f221dc98c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:27.215217 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-4fb403a3-dda0-4473-a905-6f221dc98c1f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:27.216421 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4fb403a3-dda0-4473-a905-6f221dc98c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:27.236082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:49:27.277489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1143/2262] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:27.287396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c5013-6c83-4399-88d1-f0e87334c87c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:27.289462 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a66c5013-6c83-4399-88d1-f0e87334c87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:27.349133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c5013-6c83-4399-88d1-f0e87334c87c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:27.352745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd60b5-d0b1-4fc2-9907-e359e3ab6241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:27.353432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd60b5-d0b1-4fc2-9907-e359e3ab6241 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:27.353718 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd60b5-d0b1-4fc2-9907-e359e3ab6241 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:27.353998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd60b5-d0b1-4fc2-9907-e359e3ab6241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:27.363879 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd60b5-d0b1-4fc2-9907-e359e3ab6241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:27.365350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd60b5-d0b1-4fc2-9907-e359e3ab6241 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:27.375046 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1120/2263] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:49:28.859680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6648dbf-8012-4dba-81cd-d99b4dd2dda3 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:28.859680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6648dbf-8012-4dba-81cd-d99b4dd2dda3 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:28.859680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6648dbf-8012-4dba-81cd-d99b4dd2dda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:28.889972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b6648dbf-8012-4dba-81cd-d99b4dd2dda3 None None] MFA Rules not processed for user `62fcfe1e52ca41b78ea48626dafbd1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:28.891553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b6648dbf-8012-4dba-81cd-d99b4dd2dda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:28.971423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1144/2264] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:49:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:28.984756 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd60b5-d0b1-4fc2-9907-e359e3ab6241 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:28.987137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5bdd60b5-d0b1-4fc2-9907-e359e3ab6241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:29.098864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd60b5-d0b1-4fc2-9907-e359e3ab6241 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:29.103940 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337791d-b131-4453-a2b7-1ac45c3851fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:29.104968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337791d-b131-4453-a2b7-1ac45c3851fb service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:29.105398 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337791d-b131-4453-a2b7-1ac45c3851fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:29.106100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337791d-b131-4453-a2b7-1ac45c3851fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:29.119278 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337791d-b131-4453-a2b7-1ac45c3851fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:29.121125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337791d-b131-4453-a2b7-1ac45c3851fb service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:29.128046 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:49:29.137519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1121/2265] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:49:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:49:31.976607 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f940be-b8b6-4ddb-ae73-7d13513b39fa None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:31.977229 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f940be-b8b6-4ddb-ae73-7d13513b39fa None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:31.977229 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f940be-b8b6-4ddb-ae73-7d13513b39fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:31.997597 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-29f940be-b8b6-4ddb-ae73-7d13513b39fa None None] MFA Rules not processed for user `62fcfe1e52ca41b78ea48626dafbd1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:31.999571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-29f940be-b8b6-4ddb-ae73-7d13513b39fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:32.008006 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1145/2266] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:49:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:39.426247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:49:40.543053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933d48b-e99b-49fc-8445-3cce4fb26f6c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:40.543613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933d48b-e99b-49fc-8445-3cce4fb26f6c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:40.543704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933d48b-e99b-49fc-8445-3cce4fb26f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:40.611211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b933d48b-e99b-49fc-8445-3cce4fb26f6c None None] MFA Rules not processed for user `253f9ffb48dd4eaab87aae5316fb5394`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:40.612588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b933d48b-e99b-49fc-8445-3cce4fb26f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:40.694060 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1122/2267] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jun 1 17:49:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:40.760864 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f940be-b8b6-4ddb-ae73-7d13513b39fa None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:40.762502 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-29f940be-b8b6-4ddb-ae73-7d13513b39fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:40.873438 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f940be-b8b6-4ddb-ae73-7d13513b39fa None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:40.878624 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d35cb-e6be-4b34-9c6e-ac8296b8ed95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f43a4bb5a18445b8836f4613cd5e14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:40.884696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d35cb-e6be-4b34-9c6e-ac8296b8ed95 service swift] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:40.884696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d35cb-e6be-4b34-9c6e-ac8296b8ed95 service swift] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:40.884696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d35cb-e6be-4b34-9c6e-ac8296b8ed95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:40.888842 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d35cb-e6be-4b34-9c6e-ac8296b8ed95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:40.890490 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d35cb-e6be-4b34-9c6e-ac8296b8ed95 service swift] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:40.899433 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1146/2268] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jun 1 17:49:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 17:49:41.902006 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff2d8e-87e3-4651-9d4e-73bd8385adaf None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:41.902943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff2d8e-87e3-4651-9d4e-73bd8385adaf None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:41.903537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff2d8e-87e3-4651-9d4e-73bd8385adaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:41.930914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e8ff2d8e-87e3-4651-9d4e-73bd8385adaf None None] MFA Rules not processed for user `253f9ffb48dd4eaab87aae5316fb5394`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:41.932361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e8ff2d8e-87e3-4651-9d4e-73bd8385adaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:41.949326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1123/2269] 10.222.0.33 () {58 vars in 967 bytes} [Wed Jun 1 17:49:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:41.957485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d35cb-e6be-4b34-9c6e-ac8296b8ed95 service swift] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:41.981576 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d35cb-e6be-4b34-9c6e-ac8296b8ed95 service swift] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:41.987566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4019e01-8749-4044-bb68-b18d0dc4baff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f43a4bb5a18445b8836f4613cd5e14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:41.991478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4019e01-8749-4044-bb68-b18d0dc4baff service swift] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:41.991478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4019e01-8749-4044-bb68-b18d0dc4baff service swift] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:41.991478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4019e01-8749-4044-bb68-b18d0dc4baff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:41.999046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4019e01-8749-4044-bb68-b18d0dc4baff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:42.000640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4019e01-8749-4044-bb68-b18d0dc4baff service swift] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:42.009494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1147/2270] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jun 1 17:49:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 01 17:49:42.719421 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b57f0-766b-4a28-8561-d3d88b559d52 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:42.720220 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b57f0-766b-4a28-8561-d3d88b559d52 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:42.721190 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b57f0-766b-4a28-8561-d3d88b559d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:42.740891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a11b57f0-766b-4a28-8561-d3d88b559d52 None None] MFA Rules not processed for user `253f9ffb48dd4eaab87aae5316fb5394`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:42.742224 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a11b57f0-766b-4a28-8561-d3d88b559d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:42.749866 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1124/2271] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jun 1 17:49:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:42.762081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4019e01-8749-4044-bb68-b18d0dc4baff service swift] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:42.769652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:49:42.773152 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4019e01-8749-4044-bb68-b18d0dc4baff service swift] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:42.778274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b85b2-fd52-400a-a640-c5fb9bf5da33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f43a4bb5a18445b8836f4613cd5e14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:42.778920 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b85b2-fd52-400a-a640-c5fb9bf5da33 service swift] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:42.779200 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b85b2-fd52-400a-a640-c5fb9bf5da33 service swift] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:42.779472 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b85b2-fd52-400a-a640-c5fb9bf5da33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:42.788145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b85b2-fd52-400a-a640-c5fb9bf5da33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:42.789750 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b85b2-fd52-400a-a640-c5fb9bf5da33 service swift] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:42.797601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1148/2272] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jun 1 17:49:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 17:49:43.662927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b46de-61da-4476-a080-ca0eda5939c1 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:43.663422 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b46de-61da-4476-a080-ca0eda5939c1 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:43.663531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b46de-61da-4476-a080-ca0eda5939c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:43.681911 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-205b46de-61da-4476-a080-ca0eda5939c1 None None] MFA Rules not processed for user `253f9ffb48dd4eaab87aae5316fb5394`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:43.683048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-205b46de-61da-4476-a080-ca0eda5939c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:43.690875 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1125/2273] 10.222.0.33 () {58 vars in 967 bytes} [Wed Jun 1 17:49:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:49:43.703059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b85b2-fd52-400a-a640-c5fb9bf5da33 service swift] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:43.713837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b85b2-fd52-400a-a640-c5fb9bf5da33 service swift] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:43.718881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6618e51-43e5-4be5-ba9e-11c746d54c59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f43a4bb5a18445b8836f4613cd5e14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:43.719548 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6618e51-43e5-4be5-ba9e-11c746d54c59 service swift] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:43.719866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6618e51-43e5-4be5-ba9e-11c746d54c59 service swift] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:43.720140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6618e51-43e5-4be5-ba9e-11c746d54c59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:43.728069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6618e51-43e5-4be5-ba9e-11c746d54c59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:43.729702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6618e51-43e5-4be5-ba9e-11c746d54c59 service swift] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:43.738277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1149/2274] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jun 1 17:49:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 17:49:46.695676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b46de-61da-4476-a080-ca0eda5939c1 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:46.697168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-205b46de-61da-4476-a080-ca0eda5939c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:46.711466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b46de-61da-4476-a080-ca0eda5939c1 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:46.716003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a191a-a0d6-4650-92ae-88587523ca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:46.716865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a191a-a0d6-4650-92ae-88587523ca80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:46.717182 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a191a-a0d6-4650-92ae-88587523ca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:46.717463 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a191a-a0d6-4650-92ae-88587523ca80 admin admin] PATH_INFO: `/v3/users/51e9536c6c764a08928cf995a3b0ef95` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:46.718652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a191a-a0d6-4650-92ae-88587523ca80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e9536c6c764a08928cf995a3b0ef95)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:46.720799 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a191a-a0d6-4650-92ae-88587523ca80 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:46.966694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-922a191a-a0d6-4650-92ae-88587523ca80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e9536c6c764a08928cf995a3b0ef95'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:47.079490 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-922a191a-a0d6-4650-92ae-88587523ca80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e9536c6c764a08928cf995a3b0ef95'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:47.087356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-922a191a-a0d6-4650-92ae-88587523ca80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e9536c6c764a08928cf995a3b0ef95'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:47.089755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-922a191a-a0d6-4650-92ae-88587523ca80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e9536c6c764a08928cf995a3b0ef95'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:47.102642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-922a191a-a0d6-4650-92ae-88587523ca80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e9536c6c764a08928cf995a3b0ef95'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:47.109088 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1126/2275] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 17:49:46 2022] DELETE /identity/v3/users/51e9536c6c764a08928cf995a3b0ef95 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:49:47.114539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176351e-81c0-4484-939d-bad4ec45eea8 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:47.115487 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176351e-81c0-4484-939d-bad4ec45eea8 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:47.116455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176351e-81c0-4484-939d-bad4ec45eea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:47.135849 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-3176351e-81c0-4484-939d-bad4ec45eea8 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:47.137080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3176351e-81c0-4484-939d-bad4ec45eea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:47.199299 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1150/2276] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:49:47.209547 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a191a-a0d6-4650-92ae-88587523ca80 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:47.211244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-922a191a-a0d6-4650-92ae-88587523ca80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:47.232254 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:49:47.284680 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a191a-a0d6-4650-92ae-88587523ca80 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:47.288733 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06848b-7708-4f01-a1f0-e3423b297c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:47.289432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06848b-7708-4f01-a1f0-e3423b297c23 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:47.289723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06848b-7708-4f01-a1f0-e3423b297c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:47.290006 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06848b-7708-4f01-a1f0-e3423b297c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:47.301139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06848b-7708-4f01-a1f0-e3423b297c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:47.308202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06848b-7708-4f01-a1f0-e3423b297c23 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:47.313253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1127/2277] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:49:47.671802 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176351e-81c0-4484-939d-bad4ec45eea8 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:47.675217 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3176351e-81c0-4484-939d-bad4ec45eea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:47.695564 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176351e-81c0-4484-939d-bad4ec45eea8 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:47.701505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:47.702392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:47.703110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:47.703397 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa admin admin] PATH_INFO: `/v3/projects/576af908c44544d6a5088438e2cea05d` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:47.713460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=576af908c44544d6a5088438e2cea05d)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:47.715452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:47.833443 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576af908c44544d6a5088438e2cea05d', 'request_id': 'req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:47.841142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576af908c44544d6a5088438e2cea05d', 'request_id': 'req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:47.909829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576af908c44544d6a5088438e2cea05d', 'request_id': 'req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:47.922028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa admin admin] The token cache is being invalidate because project 576af908c44544d6a5088438e2cea05d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 17:49:47.922331 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:47.923228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 17:49:47.939199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1151/2278] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 17:49:47 2022] DELETE /identity/v3/projects/576af908c44544d6a5088438e2cea05d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 17:49:54.850997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a43ac3-9245-41fd-9d95-455b91e3a0dd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:54.851492 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a43ac3-9245-41fd-9d95-455b91e3a0dd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:54.857205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a43ac3-9245-41fd-9d95-455b91e3a0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:54.870000 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-52a43ac3-9245-41fd-9d95-455b91e3a0dd None None] MFA Rules not processed for user `253f9ffb48dd4eaab87aae5316fb5394`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:49:54.871211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-52a43ac3-9245-41fd-9d95-455b91e3a0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:54.932365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1128/2279] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jun 1 17:49:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 17:49:54.944896 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:49:54.946409 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:49:55.024245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:49:55.029353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a92d3-d9dd-40e2-b8bf-a62b137cbeaa admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:49:55.035277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af76f8-22b6-4396-a8a0-c65dde78fffa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f43a4bb5a18445b8836f4613cd5e14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:49:55.035933 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af76f8-22b6-4396-a8a0-c65dde78fffa service swift] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:49:55.036403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af76f8-22b6-4396-a8a0-c65dde78fffa service swift] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:49:55.036514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af76f8-22b6-4396-a8a0-c65dde78fffa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:49:55.045718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af76f8-22b6-4396-a8a0-c65dde78fffa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:49:55.048112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af76f8-22b6-4396-a8a0-c65dde78fffa service swift] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:49:55.057228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1152/2280] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jun 1 17:49:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 17:50:01.494282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a43ac3-9245-41fd-9d95-455b91e3a0dd None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:50:01.495753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-52a43ac3-9245-41fd-9d95-455b91e3a0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:50:01.560454 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a43ac3-9245-41fd-9d95-455b91e3a0dd None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:50:01.564272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424a2e4-2038-48be-b543-9926fb2d5c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:50:01.565610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424a2e4-2038-48be-b543-9926fb2d5c2f service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:50:01.565898 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424a2e4-2038-48be-b543-9926fb2d5c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:50:01.566175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424a2e4-2038-48be-b543-9926fb2d5c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:50:01.568024 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7424a2e4-2038-48be-b543-9926fb2d5c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:50:01.650321 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424a2e4-2038-48be-b543-9926fb2d5c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:50:01.651829 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424a2e4-2038-48be-b543-9926fb2d5c2f service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:50:01.662118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1129/2281] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:50:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:50:05.235681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=4 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:50:11.657465 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=94 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:50:15.706465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1c162-a149-4a67-8322-25731747da39 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:50:15.707064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1c162-a149-4a67-8322-25731747da39 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:50:15.707064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1c162-a149-4a67-8322-25731747da39 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:50:15.708441 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1153/2282] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jun 1 17:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:50:15.715492 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63081b4b-e368-430f-946c-4a81cd329a8a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:50:15.716307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63081b4b-e368-430f-946c-4a81cd329a8a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:50:15.716592 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63081b4b-e368-430f-946c-4a81cd329a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:50:15.755148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-63081b4b-e368-430f-946c-4a81cd329a8a None None] MFA Rules not processed for user `5d5a5ba6aecd46e79dc7199589384a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:50:15.756336 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-63081b4b-e368-430f-946c-4a81cd329a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:50:15.824472 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1130/2283] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jun 1 17:50:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:50:15.836317 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1c162-a149-4a67-8322-25731747da39 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:50:15.838007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-97a1c162-a149-4a67-8322-25731747da39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:50:15.916866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1c162-a149-4a67-8322-25731747da39 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:50:15.920656 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef07a7-ffbb-4278-97f9-eaf5bb998e31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b34d05889f3c4d469f4661061457cb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:50:15.921401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef07a7-ffbb-4278-97f9-eaf5bb998e31 service glance] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:50:15.921715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef07a7-ffbb-4278-97f9-eaf5bb998e31 service glance] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:50:15.922023 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef07a7-ffbb-4278-97f9-eaf5bb998e31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:50:15.933175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef07a7-ffbb-4278-97f9-eaf5bb998e31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:50:15.934755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef07a7-ffbb-4278-97f9-eaf5bb998e31 service glance] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:50:15.947206 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1154/2284] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:50:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:50:16.236145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55589c78-8303-45c0-83c0-f7f993be2c08 None None] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:50:16.236463 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55589c78-8303-45c0-83c0-f7f993be2c08 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:50:16.236748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55589c78-8303-45c0-83c0-f7f993be2c08 None None] PATH_INFO: `/` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:50:16.238174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1131/2285] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jun 1 17:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 17:50:16.243565 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f54842-a2f3-4e2d-a765-5088157cbafd None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:50:16.243859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f54842-a2f3-4e2d-a765-5088157cbafd None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:50:16.244212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f54842-a2f3-4e2d-a765-5088157cbafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:50:16.263209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-22f54842-a2f3-4e2d-a765-5088157cbafd None None] MFA Rules not processed for user `4254398f2aac42f7b54f29294a73bfda`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:50:16.264404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-22f54842-a2f3-4e2d-a765-5088157cbafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:50:16.271026 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1155/2286] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jun 1 17:50:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:50:16.288507 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55589c78-8303-45c0-83c0-f7f993be2c08 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:50:16.290246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-55589c78-8303-45c0-83c0-f7f993be2c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:50:16.303832 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55589c78-8303-45c0-83c0-f7f993be2c08 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:50:16.307314 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25878b0f-461f-4c2b-a60c-35ef1d364707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:50:16.307944 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25878b0f-461f-4c2b-a60c-35ef1d364707 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:50:16.308225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25878b0f-461f-4c2b-a60c-35ef1d364707 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:50:16.308496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25878b0f-461f-4c2b-a60c-35ef1d364707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:50:16.315464 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25878b0f-461f-4c2b-a60c-35ef1d364707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:50:16.316879 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25878b0f-461f-4c2b-a60c-35ef1d364707 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:50:16.324638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1132/2287] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:50:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:50:16.410696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf89a1-8310-4366-ba03-bf42816ab3a6 None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:50:16.410983 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf89a1-8310-4366-ba03-bf42816ab3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:50:16.411259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf89a1-8310-4366-ba03-bf42816ab3a6 None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:50:16.412667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1156/2288] 10.222.0.33 () {54 vars in 921 bytes} [Wed Jun 1 17:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 01 17:50:16.418232 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc82e3-74dd-4255-8a8e-ecebf677a5a3 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:50:16.418525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc82e3-74dd-4255-8a8e-ecebf677a5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:50:16.418808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc82e3-74dd-4255-8a8e-ecebf677a5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:50:16.438388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-45bc82e3-74dd-4255-8a8e-ecebf677a5a3 None None] MFA Rules not processed for user `5d5a5ba6aecd46e79dc7199589384a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:50:16.445977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-45bc82e3-74dd-4255-8a8e-ecebf677a5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:50:16.449339 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1133/2289] 10.222.0.33 () {58 vars in 1018 bytes} [Wed Jun 1 17:50:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:50:16.460976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf89a1-8310-4366-ba03-bf42816ab3a6 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:50:16.473935 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf89a1-8310-4366-ba03-bf42816ab3a6 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:50:16.480545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173855b-5753-460b-bf86-1e3f535d8fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:50:16.480545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173855b-5753-460b-bf86-1e3f535d8fbd service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:50:16.480545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173855b-5753-460b-bf86-1e3f535d8fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:50:16.480545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173855b-5753-460b-bf86-1e3f535d8fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:50:16.491608 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173855b-5753-460b-bf86-1e3f535d8fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:50:16.493251 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173855b-5753-460b-bf86-1e3f535d8fbd service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:50:16.505732 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1157/2290] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:50:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:50:20.872862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647043e-13ee-426f-941a-395965e52f90 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:50:20.873402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647043e-13ee-426f-941a-395965e52f90 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:50:20.873506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647043e-13ee-426f-941a-395965e52f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:50:20.892762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-4647043e-13ee-426f-941a-395965e52f90 None None] MFA Rules not processed for user `253f9ffb48dd4eaab87aae5316fb5394`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:50:20.893980 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4647043e-13ee-426f-941a-395965e52f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:50:20.901109 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1134/2291] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jun 1 17:50:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:50:20.912827 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173855b-5753-460b-bf86-1e3f535d8fbd service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:50:20.923959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173855b-5753-460b-bf86-1e3f535d8fbd service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:50:20.928989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0a5ff-d9d0-45d9-85dd-fed12b39d64f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f43a4bb5a18445b8836f4613cd5e14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:50:20.929634 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0a5ff-d9d0-45d9-85dd-fed12b39d64f service swift] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:50:20.929946 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0a5ff-d9d0-45d9-85dd-fed12b39d64f service swift] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:50:20.930229 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0a5ff-d9d0-45d9-85dd-fed12b39d64f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:50:20.938248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0a5ff-d9d0-45d9-85dd-fed12b39d64f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:50:20.940337 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0a5ff-d9d0-45d9-85dd-fed12b39d64f service swift] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:50:20.948557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1158/2292] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jun 1 17:50:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 17:50:30.886689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=49 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:50:30.945368 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=50 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:51:08.770376 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647043e-13ee-426f-941a-395965e52f90 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:51:08.780068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647043e-13ee-426f-941a-395965e52f90 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:51:08.784480 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410536d0-9664-417a-82b4-c2713fa1d3f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:51:08.785176 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410536d0-9664-417a-82b4-c2713fa1d3f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:51:08.785471 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410536d0-9664-417a-82b4-c2713fa1d3f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:51:08.785756 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410536d0-9664-417a-82b4-c2713fa1d3f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:51:08.787627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-410536d0-9664-417a-82b4-c2713fa1d3f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:51:08.802009 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410536d0-9664-417a-82b4-c2713fa1d3f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:51:08.805722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410536d0-9664-417a-82b4-c2713fa1d3f6 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:51:08.814358 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1135/2293] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:51:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:51:09.994312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0a5ff-d9d0-45d9-85dd-fed12b39d64f service swift] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:51:10.004631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0a5ff-d9d0-45d9-85dd-fed12b39d64f service swift] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:51:10.008269 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09186168-712a-47f9-8aea-b9ded15fbe62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:51:10.008956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09186168-712a-47f9-8aea-b9ded15fbe62 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:51:10.009254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09186168-712a-47f9-8aea-b9ded15fbe62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:51:10.009585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09186168-712a-47f9-8aea-b9ded15fbe62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:51:10.011300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-09186168-712a-47f9-8aea-b9ded15fbe62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:51:10.026133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09186168-712a-47f9-8aea-b9ded15fbe62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:51:10.027561 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09186168-712a-47f9-8aea-b9ded15fbe62 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:51:10.039593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1159/2294] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:51:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:51:18.809515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=6 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:51:19.365167 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410536d0-9664-417a-82b4-c2713fa1d3f6 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:51:19.366589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-410536d0-9664-417a-82b4-c2713fa1d3f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:51:19.380782 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410536d0-9664-417a-82b4-c2713fa1d3f6 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:51:19.386413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8056a7-4aae-440f-9409-4f77e57109b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:51:19.387052 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8056a7-4aae-440f-9409-4f77e57109b9 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:51:19.387343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8056a7-4aae-440f-9409-4f77e57109b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:51:19.387634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8056a7-4aae-440f-9409-4f77e57109b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:51:19.389385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9f8056a7-4aae-440f-9409-4f77e57109b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:51:19.448385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8056a7-4aae-440f-9409-4f77e57109b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:51:19.450033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8056a7-4aae-440f-9409-4f77e57109b9 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:51:19.460770 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1136/2295] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:51:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:51:20.034382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=6 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:51:22.276353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09186168-712a-47f9-8aea-b9ded15fbe62 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:51:22.277866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-09186168-712a-47f9-8aea-b9ded15fbe62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:51:22.334279 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09186168-712a-47f9-8aea-b9ded15fbe62 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:51:22.337928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c29e4a-83b3-4be6-a45d-7e89f9941744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:51:22.338575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c29e4a-83b3-4be6-a45d-7e89f9941744 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:51:22.338862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c29e4a-83b3-4be6-a45d-7e89f9941744 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:51:22.339140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c29e4a-83b3-4be6-a45d-7e89f9941744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:51:22.341179 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-45c29e4a-83b3-4be6-a45d-7e89f9941744 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:51:22.399733 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c29e4a-83b3-4be6-a45d-7e89f9941744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:51:22.401188 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c29e4a-83b3-4be6-a45d-7e89f9941744 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:51:22.410676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1160/2296] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:51:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:51:23.702353 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8056a7-4aae-440f-9409-4f77e57109b9 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:51:23.713394 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8056a7-4aae-440f-9409-4f77e57109b9 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:51:23.717101 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e4f7b-3547-4e80-beef-c381aa0717dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:51:23.717861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e4f7b-3547-4e80-beef-c381aa0717dd service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:51:23.718265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e4f7b-3547-4e80-beef-c381aa0717dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:51:23.718553 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e4f7b-3547-4e80-beef-c381aa0717dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:51:23.720331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b63e4f7b-3547-4e80-beef-c381aa0717dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:51:23.780725 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e4f7b-3547-4e80-beef-c381aa0717dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:51:23.782198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e4f7b-3547-4e80-beef-c381aa0717dd service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:51:23.791504 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1137/2297] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:51:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:51:32.405898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=48 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:51:33.787471 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=56 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:51:38.195290 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c29e4a-83b3-4be6-a45d-7e89f9941744 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:51:38.206653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c29e4a-83b3-4be6-a45d-7e89f9941744 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:51:38.210793 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82f3f9-8e21-4e6b-9d25-97e58a915d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:51:38.211586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82f3f9-8e21-4e6b-9d25-97e58a915d5b service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:51:38.211911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82f3f9-8e21-4e6b-9d25-97e58a915d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:51:38.212181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82f3f9-8e21-4e6b-9d25-97e58a915d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:51:38.214566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8c82f3f9-8e21-4e6b-9d25-97e58a915d5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:51:38.226169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82f3f9-8e21-4e6b-9d25-97e58a915d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:51:38.227626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82f3f9-8e21-4e6b-9d25-97e58a915d5b service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:51:38.237473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1161/2298] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:51:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:51:41.190198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b04151-7d25-46bf-8be4-5a45654816b4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:51:41.190660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b04151-7d25-46bf-8be4-5a45654816b4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:51:41.190760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b04151-7d25-46bf-8be4-5a45654816b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:51:41.209731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d8b04151-7d25-46bf-8be4-5a45654816b4 None None] MFA Rules not processed for user `253f9ffb48dd4eaab87aae5316fb5394`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:51:41.211072 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d8b04151-7d25-46bf-8be4-5a45654816b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:51:41.218436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1138/2299] 10.222.0.33 () {58 vars in 967 bytes} [Wed Jun 1 17:51:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:51:41.261952 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82f3f9-8e21-4e6b-9d25-97e58a915d5b service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:51:41.279852 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82f3f9-8e21-4e6b-9d25-97e58a915d5b service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:51:41.285466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a2a7c-67f1-4e77-94c8-69d5299324d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f43a4bb5a18445b8836f4613cd5e14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:51:41.286113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a2a7c-67f1-4e77-94c8-69d5299324d7 service swift] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:51:41.286393 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a2a7c-67f1-4e77-94c8-69d5299324d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:51:41.286667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a2a7c-67f1-4e77-94c8-69d5299324d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:51:41.294682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a2a7c-67f1-4e77-94c8-69d5299324d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:51:41.296288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a2a7c-67f1-4e77-94c8-69d5299324d7 service swift] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:51:41.304233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1162/2300] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jun 1 17:51:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 17:51:44.461877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e2f9b-fe0d-4a34-9f07-cc31eff9d2de None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:51:44.462378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e2f9b-fe0d-4a34-9f07-cc31eff9d2de None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:51:44.462378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e2f9b-fe0d-4a34-9f07-cc31eff9d2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:51:44.485216 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a18e2f9b-fe0d-4a34-9f07-cc31eff9d2de None None] MFA Rules not processed for user `eb6555ff5f3f4823aee38990265d3a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 17:51:44.485216 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a18e2f9b-fe0d-4a34-9f07-cc31eff9d2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:51:44.538552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1139/2301] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 17:51:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 17:51:44.856312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a2a7c-67f1-4e77-94c8-69d5299324d7 service swift] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:51:44.866345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a2a7c-67f1-4e77-94c8-69d5299324d7 service swift] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:51:44.869947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d09e7-2911-4d82-9923-64c97628da71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:51:44.870586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d09e7-2911-4d82-9923-64c97628da71 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:51:44.870873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d09e7-2911-4d82-9923-64c97628da71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:51:44.871153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d09e7-2911-4d82-9923-64c97628da71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:51:44.872894 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-702d09e7-2911-4d82-9923-64c97628da71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:51:44.882524 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d09e7-2911-4d82-9923-64c97628da71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:51:44.884068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d09e7-2911-4d82-9923-64c97628da71 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:51:44.891943 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1163/2302] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:51:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:51:45.366134 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e2f9b-fe0d-4a34-9f07-cc31eff9d2de None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:51:45.372586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a18e2f9b-fe0d-4a34-9f07-cc31eff9d2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:51:45.445579 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e2f9b-fe0d-4a34-9f07-cc31eff9d2de None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:51:45.451105 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717ecf8-3518-4de9-958f-37a759cc4df6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:51:45.451787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717ecf8-3518-4de9-958f-37a759cc4df6 service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:51:45.452063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717ecf8-3518-4de9-958f-37a759cc4df6 service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:51:45.452342 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717ecf8-3518-4de9-958f-37a759cc4df6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:51:45.454227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3717ecf8-3518-4de9-958f-37a759cc4df6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:51:45.468275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717ecf8-3518-4de9-958f-37a759cc4df6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:51:45.469983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717ecf8-3518-4de9-958f-37a759cc4df6 service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:51:45.480704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1140/2303] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:51:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:51:49.600898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d09e7-2911-4d82-9923-64c97628da71 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:51:49.617905 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d09e7-2911-4d82-9923-64c97628da71 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:51:49.623051 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a0ff0-d6ac-4d89-b5af-6db1b0d7a054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:51:49.623748 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a0ff0-d6ac-4d89-b5af-6db1b0d7a054 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:51:49.624034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a0ff0-d6ac-4d89-b5af-6db1b0d7a054 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:51:49.624315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a0ff0-d6ac-4d89-b5af-6db1b0d7a054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:51:49.626364 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ef9a0ff0-d6ac-4d89-b5af-6db1b0d7a054 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:51:49.645351 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a0ff0-d6ac-4d89-b5af-6db1b0d7a054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:51:49.647903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a0ff0-d6ac-4d89-b5af-6db1b0d7a054 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:51:49.660410 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1164/2304] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:51:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:51:55.476307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=60 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:51:57.398354 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717ecf8-3518-4de9-958f-37a759cc4df6 service placement] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:51:57.410933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717ecf8-3518-4de9-958f-37a759cc4df6 service placement] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:51:57.416414 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4073c8-5ad5-4239-b8d4-69d447a26fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:51:57.417094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4073c8-5ad5-4239-b8d4-69d447a26fa2 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:51:57.420601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4073c8-5ad5-4239-b8d4-69d447a26fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:51:57.420601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4073c8-5ad5-4239-b8d4-69d447a26fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:51:57.420601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ce4073c8-5ad5-4239-b8d4-69d447a26fa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:51:57.431808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4073c8-5ad5-4239-b8d4-69d447a26fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:51:57.433416 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4073c8-5ad5-4239-b8d4-69d447a26fa2 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:51:57.444266 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1141/2305] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:51:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:51:59.654990 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=24 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:52:07.439939 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=6 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:53:17.784407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a0ff0-d6ac-4d89-b5af-6db1b0d7a054 service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:53:17.795537 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a0ff0-d6ac-4d89-b5af-6db1b0d7a054 service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:53:17.803340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1edb05-a8b4-4648-83ff-3c5f0da7b9a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:53:17.803340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1edb05-a8b4-4648-83ff-3c5f0da7b9a7 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:53:17.803340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1edb05-a8b4-4648-83ff-3c5f0da7b9a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:53:17.803340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1edb05-a8b4-4648-83ff-3c5f0da7b9a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:53:17.804729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-bb1edb05-a8b4-4648-83ff-3c5f0da7b9a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:53:17.815399 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1edb05-a8b4-4648-83ff-3c5f0da7b9a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:53:17.817032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1edb05-a8b4-4648-83ff-3c5f0da7b9a7 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:53:17.826538 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1165/2306] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:53:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:53:27.822134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=6 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:53:35.713375 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4073c8-5ad5-4239-b8d4-69d447a26fa2 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:53:35.724485 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4073c8-5ad5-4239-b8d4-69d447a26fa2 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:53:35.729961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f318097-446e-4cef-9668-6dc906f212e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:53:35.730650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f318097-446e-4cef-9668-6dc906f212e8 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:53:35.730886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f318097-446e-4cef-9668-6dc906f212e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:53:35.731165 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f318097-446e-4cef-9668-6dc906f212e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:53:35.733064 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3f318097-446e-4cef-9668-6dc906f212e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:53:35.790118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f318097-446e-4cef-9668-6dc906f212e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:53:35.791705 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f318097-446e-4cef-9668-6dc906f212e8 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:53:35.801381 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1142/2307] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:53:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:53:45.796633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=28 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:54:16.866429 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1edb05-a8b4-4648-83ff-3c5f0da7b9a7 service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:54:16.867808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-bb1edb05-a8b4-4648-83ff-3c5f0da7b9a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:54:16.884011 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1edb05-a8b4-4648-83ff-3c5f0da7b9a7 service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:54:16.889381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97742225-0dfd-4d45-b857-5a44379df4ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:54:16.890023 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97742225-0dfd-4d45-b857-5a44379df4ed service placement] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:54:16.890307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97742225-0dfd-4d45-b857-5a44379df4ed service placement] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:54:16.890582 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97742225-0dfd-4d45-b857-5a44379df4ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:54:16.892738 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-97742225-0dfd-4d45-b857-5a44379df4ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:54:16.904783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97742225-0dfd-4d45-b857-5a44379df4ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:54:16.906368 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97742225-0dfd-4d45-b857-5a44379df4ed service placement] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:54:16.916729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1166/2308] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:54:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:54:26.912539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=6 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:54:49.665151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f318097-446e-4cef-9668-6dc906f212e8 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:54:49.666660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3f318097-446e-4cef-9668-6dc906f212e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:54:49.678086 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f318097-446e-4cef-9668-6dc906f212e8 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:54:49.681736 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4db23-2156-47bf-9f55-f30e20b7797a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:54:49.682388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4db23-2156-47bf-9f55-f30e20b7797a service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:54:49.682672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4db23-2156-47bf-9f55-f30e20b7797a service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:54:49.682949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4db23-2156-47bf-9f55-f30e20b7797a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:54:49.684755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c7e4db23-2156-47bf-9f55-f30e20b7797a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 17:54:49.750606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4db23-2156-47bf-9f55-f30e20b7797a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:54:49.751983 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4db23-2156-47bf-9f55-f30e20b7797a service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:54:49.760913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1143/2309] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:54:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:54:59.756842 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=28 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:56:49.992633 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97742225-0dfd-4d45-b857-5a44379df4ed service placement] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:56:50.001945 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97742225-0dfd-4d45-b857-5a44379df4ed service placement] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:56:50.005629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54fbe5-7f4c-44d8-8de3-cbbc68ad4f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:56:50.006259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54fbe5-7f4c-44d8-8de3-cbbc68ad4f6e service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:56:50.006539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54fbe5-7f4c-44d8-8de3-cbbc68ad4f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:56:50.006809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54fbe5-7f4c-44d8-8de3-cbbc68ad4f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:56:50.016805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54fbe5-7f4c-44d8-8de3-cbbc68ad4f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:56:50.018241 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54fbe5-7f4c-44d8-8de3-cbbc68ad4f6e service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:56:50.029507 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1167/2310] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:56:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:56:50.133506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4db23-2156-47bf-9f55-f30e20b7797a service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:56:50.141939 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4db23-2156-47bf-9f55-f30e20b7797a service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:56:50.146027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8cef1-a4d8-4ab1-bdb7-c8f69e0c8a33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:56:50.146820 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8cef1-a4d8-4ab1-bdb7-c8f69e0c8a33 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:56:50.147102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8cef1-a4d8-4ab1-bdb7-c8f69e0c8a33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:56:50.147397 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8cef1-a4d8-4ab1-bdb7-c8f69e0c8a33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:56:50.155755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8cef1-a4d8-4ab1-bdb7-c8f69e0c8a33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:56:50.157209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8cef1-a4d8-4ab1-bdb7-c8f69e0c8a33 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:56:50.184694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1144/2311] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:56:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:56:50.236427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54fbe5-7f4c-44d8-8de3-cbbc68ad4f6e service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:56:50.245690 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54fbe5-7f4c-44d8-8de3-cbbc68ad4f6e service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:56:50.249494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3505cec-2bd4-4147-a8f8-55ccf5c4fd28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:56:50.250196 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3505cec-2bd4-4147-a8f8-55ccf5c4fd28 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:56:50.250529 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3505cec-2bd4-4147-a8f8-55ccf5c4fd28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:56:50.250804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3505cec-2bd4-4147-a8f8-55ccf5c4fd28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:56:50.260452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3505cec-2bd4-4147-a8f8-55ccf5c4fd28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:56:50.261995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3505cec-2bd4-4147-a8f8-55ccf5c4fd28 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:56:50.291632 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1168/2312] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:56:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:56:50.298248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8cef1-a4d8-4ab1-bdb7-c8f69e0c8a33 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:56:50.311744 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8cef1-a4d8-4ab1-bdb7-c8f69e0c8a33 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:56:50.318648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c0fc3-3451-4912-b0df-33274491bb58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:56:50.319309 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c0fc3-3451-4912-b0df-33274491bb58 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:56:50.319582 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c0fc3-3451-4912-b0df-33274491bb58 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:56:50.319862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c0fc3-3451-4912-b0df-33274491bb58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:56:50.328763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c0fc3-3451-4912-b0df-33274491bb58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:56:50.330298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c0fc3-3451-4912-b0df-33274491bb58 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:56:50.356409 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3505cec-2bd4-4147-a8f8-55ccf5c4fd28 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:56:50.359586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1145/2313] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:56:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:56:50.365065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3505cec-2bd4-4147-a8f8-55ccf5c4fd28 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:56:50.368746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc6be4-a921-400c-a104-91bab69ae1ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:56:50.369786 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc6be4-a921-400c-a104-91bab69ae1ec service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:56:50.369786 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc6be4-a921-400c-a104-91bab69ae1ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:56:50.372265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc6be4-a921-400c-a104-91bab69ae1ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:56:50.381266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc6be4-a921-400c-a104-91bab69ae1ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:56:50.382709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc6be4-a921-400c-a104-91bab69ae1ec service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:56:50.393949 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1169/2314] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:56:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:57:00.356786 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=26 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:57:00.389506 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=25 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:57:19.525356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c0fc3-3451-4912-b0df-33274491bb58 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:57:19.534676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c0fc3-3451-4912-b0df-33274491bb58 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:57:19.538153 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917f5fc-d6b6-4ef3-9a41-73f021741368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:57:19.538793 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917f5fc-d6b6-4ef3-9a41-73f021741368 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:57:19.539108 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917f5fc-d6b6-4ef3-9a41-73f021741368 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:57:19.539384 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917f5fc-d6b6-4ef3-9a41-73f021741368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:57:19.546447 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917f5fc-d6b6-4ef3-9a41-73f021741368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:57:19.547867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917f5fc-d6b6-4ef3-9a41-73f021741368 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:57:19.555654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1146/2315] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:57:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:57:29.552128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=6 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:58:50.568661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc6be4-a921-400c-a104-91bab69ae1ec service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:58:50.588282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc6be4-a921-400c-a104-91bab69ae1ec service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:58:50.591905 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e20bb-8fcd-4d28-889b-6c91fb4105b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:58:50.592591 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e20bb-8fcd-4d28-889b-6c91fb4105b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:58:50.592864 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e20bb-8fcd-4d28-889b-6c91fb4105b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:58:50.593173 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e20bb-8fcd-4d28-889b-6c91fb4105b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:58:50.615352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e20bb-8fcd-4d28-889b-6c91fb4105b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:58:50.616767 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e20bb-8fcd-4d28-889b-6c91fb4105b8 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:58:50.643696 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1170/2316] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:58:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 17:58:50.866097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917f5fc-d6b6-4ef3-9a41-73f021741368 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:58:50.885905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917f5fc-d6b6-4ef3-9a41-73f021741368 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:58:50.889496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f25ab8-1792-4858-a13d-c5bf962478db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:58:50.890164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f25ab8-1792-4858-a13d-c5bf962478db service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:58:50.890447 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f25ab8-1792-4858-a13d-c5bf962478db service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:58:50.890724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f25ab8-1792-4858-a13d-c5bf962478db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:58:50.898890 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f25ab8-1792-4858-a13d-c5bf962478db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:58:50.900319 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f25ab8-1792-4858-a13d-c5bf962478db service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:58:50.928683 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1147/2317] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:58:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:59:00.641480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=24 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:59:00.925851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=18 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 17:59:24.819614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e20bb-8fcd-4d28-889b-6c91fb4105b8 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 17:59:24.857742 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e20bb-8fcd-4d28-889b-6c91fb4105b8 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 17:59:24.862927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fc262-8909-442d-ac4b-6f9be35f87bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 17:59:24.863584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fc262-8909-442d-ac4b-6f9be35f87bb service placement] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 17:59:24.863874 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fc262-8909-442d-ac4b-6f9be35f87bb service placement] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 17:59:24.864155 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fc262-8909-442d-ac4b-6f9be35f87bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 17:59:24.872817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fc262-8909-442d-ac4b-6f9be35f87bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 17:59:24.874477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fc262-8909-442d-ac4b-6f9be35f87bb service placement] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 17:59:24.885113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1171/2318] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 17:59:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 17:59:34.880817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=16 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:00:51.000109 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f25ab8-1792-4858-a13d-c5bf962478db service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:00:51.017689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f25ab8-1792-4858-a13d-c5bf962478db service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:00:51.021254 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b1b0b-10f3-4519-ba88-f997330de4a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:00:51.021921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b1b0b-10f3-4519-ba88-f997330de4a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:00:51.022212 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b1b0b-10f3-4519-ba88-f997330de4a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:00:51.022517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b1b0b-10f3-4519-ba88-f997330de4a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:00:51.032496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b1b0b-10f3-4519-ba88-f997330de4a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:00:51.033932 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b1b0b-10f3-4519-ba88-f997330de4a9 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:00:51.061721 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1148/2319] 10.222.0.33 () {60 vars in 1396 bytes} [Wed Jun 1 18:00:50 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:01:01.058836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=17 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:02:24.511874 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fc262-8909-442d-ac4b-6f9be35f87bb service placement] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:02:24.513614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-551fc262-8909-442d-ac4b-6f9be35f87bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:02:24.598437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fc262-8909-442d-ac4b-6f9be35f87bb service placement] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:02:24.602126 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b31127-c97a-4018-a031-74ce77d35c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:02:24.602778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31127-c97a-4018-a031-74ce77d35c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:02:24.603062 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31127-c97a-4018-a031-74ce77d35c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:02:24.603371 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31127-c97a-4018-a031-74ce77d35c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:02:24.605295 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-31b31127-c97a-4018-a031-74ce77d35c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:02:24.615470 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b31127-c97a-4018-a031-74ce77d35c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:02:24.616909 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b31127-c97a-4018-a031-74ce77d35c68 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:02:24.625463 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1172/2320] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:02:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:02:34.621262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=39 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:02:51.144500 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b1b0b-10f3-4519-ba88-f997330de4a9 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:02:51.199139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b1b0b-10f3-4519-ba88-f997330de4a9 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:02:51.203202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9d931-deb4-4893-b204-b8c228a96b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:02:51.209659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9d931-deb4-4893-b204-b8c228a96b4a service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:02:51.209659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9d931-deb4-4893-b204-b8c228a96b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:02:51.209659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9d931-deb4-4893-b204-b8c228a96b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:02:51.209659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1ac9d931-deb4-4893-b204-b8c228a96b4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:02:51.300813 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9d931-deb4-4893-b204-b8c228a96b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:02:51.302304 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9d931-deb4-4893-b204-b8c228a96b4a service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:02:51.324916 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1149/2321] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:02:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:02:51.375695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b31127-c97a-4018-a031-74ce77d35c68 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:02:51.388180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b31127-c97a-4018-a031-74ce77d35c68 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:02:51.391079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437f709-664e-4eed-81bf-8c5d898edde5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:02:51.391871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437f709-664e-4eed-81bf-8c5d898edde5 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:02:51.392161 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437f709-664e-4eed-81bf-8c5d898edde5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:02:51.392467 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437f709-664e-4eed-81bf-8c5d898edde5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:02:51.394412 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-5437f709-664e-4eed-81bf-8c5d898edde5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:02:51.408949 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437f709-664e-4eed-81bf-8c5d898edde5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:02:51.412656 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437f709-664e-4eed-81bf-8c5d898edde5 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:02:51.421235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1173/2322] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:02:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:02:51.479496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9d931-deb4-4893-b204-b8c228a96b4a service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:02:51.481233 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1ac9d931-deb4-4893-b204-b8c228a96b4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:02:51.495621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9d931-deb4-4893-b204-b8c228a96b4a service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:02:51.504598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d89aa-e084-4998-aff0-9fd24cba3470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:02:51.504598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d89aa-e084-4998-aff0-9fd24cba3470 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:02:51.504598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d89aa-e084-4998-aff0-9fd24cba3470 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:02:51.504598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d89aa-e084-4998-aff0-9fd24cba3470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:02:51.507486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-133d89aa-e084-4998-aff0-9fd24cba3470 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:02:51.510614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437f709-664e-4eed-81bf-8c5d898edde5 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:02:51.511984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-5437f709-664e-4eed-81bf-8c5d898edde5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:02:51.526370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437f709-664e-4eed-81bf-8c5d898edde5 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:02:51.533137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedee10-8f2d-45dd-8ced-36cbc2013f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:02:51.533798 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedee10-8f2d-45dd-8ced-36cbc2013f2c service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:02:51.534065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedee10-8f2d-45dd-8ced-36cbc2013f2c service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:02:51.534365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedee10-8f2d-45dd-8ced-36cbc2013f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:02:51.536207 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4bedee10-8f2d-45dd-8ced-36cbc2013f2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:02:51.579747 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d89aa-e084-4998-aff0-9fd24cba3470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:02:51.584283 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d89aa-e084-4998-aff0-9fd24cba3470 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:02:51.590711 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1150/2323] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:02:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:02:51.613091 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedee10-8f2d-45dd-8ced-36cbc2013f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:02:51.614656 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedee10-8f2d-45dd-8ced-36cbc2013f2c service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:02:51.625855 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1174/2324] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:02:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:02:51.642910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d89aa-e084-4998-aff0-9fd24cba3470 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:02:51.649240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:02:51.654963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d89aa-e084-4998-aff0-9fd24cba3470 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:02:51.666719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d2308-06cf-420e-81b6-fae6c94baf9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:02:51.666719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d2308-06cf-420e-81b6-fae6c94baf9c service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:02:51.666719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d2308-06cf-420e-81b6-fae6c94baf9c service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:02:51.666719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d2308-06cf-420e-81b6-fae6c94baf9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:02:51.667417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fd4d2308-06cf-420e-81b6-fae6c94baf9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:02:51.680805 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d2308-06cf-420e-81b6-fae6c94baf9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:02:51.682423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d2308-06cf-420e-81b6-fae6c94baf9c service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:02:51.694535 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1151/2325] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:02:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:02:51.735021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedee10-8f2d-45dd-8ced-36cbc2013f2c service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:02:51.746694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedee10-8f2d-45dd-8ced-36cbc2013f2c service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:02:51.756072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b76b35-3a7e-4e94-a0ce-8eeb336b197f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:02:51.756072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b76b35-3a7e-4e94-a0ce-8eeb336b197f service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:02:51.756072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b76b35-3a7e-4e94-a0ce-8eeb336b197f service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:02:51.756072 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b76b35-3a7e-4e94-a0ce-8eeb336b197f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:02:51.757398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-17b76b35-3a7e-4e94-a0ce-8eeb336b197f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:02:51.831758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b76b35-3a7e-4e94-a0ce-8eeb336b197f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:02:51.833373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b76b35-3a7e-4e94-a0ce-8eeb336b197f service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:02:51.842626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1175/2326] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:02:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:02:52.588139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e932c0-50d9-493e-8ce6-c3e2c9a40ddb None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:02:52.588704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e932c0-50d9-493e-8ce6-c3e2c9a40ddb None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:02:52.588704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e932c0-50d9-493e-8ce6-c3e2c9a40ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:02:52.634925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-05e932c0-50d9-493e-8ce6-c3e2c9a40ddb None None] MFA Rules not processed for user `fb4a1cae173c4793a49032181d6417af`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:02:52.636116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-05e932c0-50d9-493e-8ce6-c3e2c9a40ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:02:52.643261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1152/2327] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:02:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:02:53.148864 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b76b35-3a7e-4e94-a0ce-8eeb336b197f service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:02:53.158468 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b76b35-3a7e-4e94-a0ce-8eeb336b197f service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:02:53.162134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c494cc-6443-4a77-b11a-aa9fef019688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:02:53.162723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c494cc-6443-4a77-b11a-aa9fef019688 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:02:53.163079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c494cc-6443-4a77-b11a-aa9fef019688 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:02:53.163369 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c494cc-6443-4a77-b11a-aa9fef019688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:02:53.165242 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-11c494cc-6443-4a77-b11a-aa9fef019688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:02:53.175686 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c494cc-6443-4a77-b11a-aa9fef019688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:02:53.177152 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c494cc-6443-4a77-b11a-aa9fef019688 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:02:53.185287 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1176/2328] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:02:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:03:02.633756 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=16 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:03:03.181693 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=78 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:03:50.684853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e932c0-50d9-493e-8ce6-c3e2c9a40ddb None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:03:50.698933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e932c0-50d9-493e-8ce6-c3e2c9a40ddb None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:03:50.704417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866081-99b9-4478-a224-74d1f5260e58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:03:50.705094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866081-99b9-4478-a224-74d1f5260e58 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:03:50.705381 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866081-99b9-4478-a224-74d1f5260e58 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:03:50.705661 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866081-99b9-4478-a224-74d1f5260e58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:03:50.707510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d1866081-99b9-4478-a224-74d1f5260e58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:03:50.778987 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1866081-99b9-4478-a224-74d1f5260e58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:03:50.780576 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1866081-99b9-4478-a224-74d1f5260e58 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:03:50.789756 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1153/2329] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:03:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:03:51.192665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c494cc-6443-4a77-b11a-aa9fef019688 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:03:51.194244 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-11c494cc-6443-4a77-b11a-aa9fef019688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:03:51.217580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c494cc-6443-4a77-b11a-aa9fef019688 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:03:51.221113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7af7a-2333-4a3a-b2b0-777f36b9a314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:03:51.221746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7af7a-2333-4a3a-b2b0-777f36b9a314 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:03:51.222024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7af7a-2333-4a3a-b2b0-777f36b9a314 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:03:51.222297 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7af7a-2333-4a3a-b2b0-777f36b9a314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:03:51.224079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-c8c7af7a-2333-4a3a-b2b0-777f36b9a314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:03:51.280850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7af7a-2333-4a3a-b2b0-777f36b9a314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:03:51.282311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7af7a-2333-4a3a-b2b0-777f36b9a314 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:03:51.291090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1177/2330] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:03:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:04:00.785307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=33 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:04:01.287057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=33 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:04:29.805766 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866081-99b9-4478-a224-74d1f5260e58 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:04:29.807333 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d1866081-99b9-4478-a224-74d1f5260e58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:04:29.887247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866081-99b9-4478-a224-74d1f5260e58 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:04:29.892620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8122f1-6c5e-4b69-bd21-ba54baef4ebc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:04:29.893297 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8122f1-6c5e-4b69-bd21-ba54baef4ebc service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:04:29.893588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8122f1-6c5e-4b69-bd21-ba54baef4ebc service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:04:29.893866 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8122f1-6c5e-4b69-bd21-ba54baef4ebc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:04:29.895732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-bb8122f1-6c5e-4b69-bd21-ba54baef4ebc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:04:29.907977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8122f1-6c5e-4b69-bd21-ba54baef4ebc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:04:29.909601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8122f1-6c5e-4b69-bd21-ba54baef4ebc service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:04:29.919484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1154/2331] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:04:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:04:39.915227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=37 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:05:51.209588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7af7a-2333-4a3a-b2b0-777f36b9a314 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:05:51.211149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-c8c7af7a-2333-4a3a-b2b0-777f36b9a314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:05:51.222080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7af7a-2333-4a3a-b2b0-777f36b9a314 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:05:51.225636 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae3431-3c82-4739-a9c1-3bc08df0a26d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:05:51.226303 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae3431-3c82-4739-a9c1-3bc08df0a26d service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:05:51.226585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae3431-3c82-4739-a9c1-3bc08df0a26d service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:05:51.226857 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae3431-3c82-4739-a9c1-3bc08df0a26d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:05:51.228630 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f0ae3431-3c82-4739-a9c1-3bc08df0a26d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:05:51.297844 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae3431-3c82-4739-a9c1-3bc08df0a26d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:05:51.299269 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae3431-3c82-4739-a9c1-3bc08df0a26d service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:05:51.308205 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1178/2332] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:05:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:06:01.304157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=33 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:07:31.484136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8122f1-6c5e-4b69-bd21-ba54baef4ebc service placement] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:07:31.493700 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8122f1-6c5e-4b69-bd21-ba54baef4ebc service placement] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:07:31.497905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11365fa4-7aa2-405f-8f46-9429cf8ddaba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:07:31.498539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11365fa4-7aa2-405f-8f46-9429cf8ddaba service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:07:31.498822 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11365fa4-7aa2-405f-8f46-9429cf8ddaba service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:07:31.499097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11365fa4-7aa2-405f-8f46-9429cf8ddaba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:07:31.506369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11365fa4-7aa2-405f-8f46-9429cf8ddaba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:07:31.507784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11365fa4-7aa2-405f-8f46-9429cf8ddaba service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:07:31.517042 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1155/2333] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:07:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:07:41.513318 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=6 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:07:51.767503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae3431-3c82-4739-a9c1-3bc08df0a26d service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:07:51.776450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae3431-3c82-4739-a9c1-3bc08df0a26d service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:07:51.780085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6b31f-7638-412c-b835-17d46dfaae8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:07:51.780726 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6b31f-7638-412c-b835-17d46dfaae8a service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:07:51.781050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6b31f-7638-412c-b835-17d46dfaae8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:07:51.781331 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6b31f-7638-412c-b835-17d46dfaae8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:07:51.789535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6b31f-7638-412c-b835-17d46dfaae8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:07:51.791580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6b31f-7638-412c-b835-17d46dfaae8a service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:07:51.818175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1179/2334] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:07:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:07:51.867169 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11365fa4-7aa2-405f-8f46-9429cf8ddaba service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:07:51.876477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11365fa4-7aa2-405f-8f46-9429cf8ddaba service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:07:51.880062 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed085954-839c-45ec-8a1c-e1b5c0efb767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:07:51.880699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed085954-839c-45ec-8a1c-e1b5c0efb767 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:07:51.881014 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed085954-839c-45ec-8a1c-e1b5c0efb767 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:07:51.881299 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed085954-839c-45ec-8a1c-e1b5c0efb767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:07:51.890313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed085954-839c-45ec-8a1c-e1b5c0efb767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:07:51.891742 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed085954-839c-45ec-8a1c-e1b5c0efb767 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:07:51.920249 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1156/2335] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:07:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:07:52.225719 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6b31f-7638-412c-b835-17d46dfaae8a service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:07:52.234569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6b31f-7638-412c-b835-17d46dfaae8a service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:07:52.238218 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c61399-8a3c-4e48-a2bf-bb21ebe02165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:07:52.238871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c61399-8a3c-4e48-a2bf-bb21ebe02165 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:07:52.239159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c61399-8a3c-4e48-a2bf-bb21ebe02165 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:07:52.239439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c61399-8a3c-4e48-a2bf-bb21ebe02165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:07:52.249577 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c61399-8a3c-4e48-a2bf-bb21ebe02165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:07:52.251028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c61399-8a3c-4e48-a2bf-bb21ebe02165 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:07:52.279290 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1180/2336] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:07:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:08:01.917364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=13 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:08:02.276345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=26 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:08:50.712232 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed085954-839c-45ec-8a1c-e1b5c0efb767 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:08:50.721949 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed085954-839c-45ec-8a1c-e1b5c0efb767 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:08:50.725710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba368c7d-6d1e-4d9f-a8c6-091facb9f8bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:08:50.726363 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba368c7d-6d1e-4d9f-a8c6-091facb9f8bf service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:08:50.726651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba368c7d-6d1e-4d9f-a8c6-091facb9f8bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:08:50.726933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba368c7d-6d1e-4d9f-a8c6-091facb9f8bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:08:50.750640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba368c7d-6d1e-4d9f-a8c6-091facb9f8bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:08:50.752096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba368c7d-6d1e-4d9f-a8c6-091facb9f8bf service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:08:50.762147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1157/2337] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:08:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:08:51.476563 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c61399-8a3c-4e48-a2bf-bb21ebe02165 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:08:51.513716 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c61399-8a3c-4e48-a2bf-bb21ebe02165 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:08:51.519263 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c704e58-ac84-45ac-b758-1583192b51d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:08:51.519908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c704e58-ac84-45ac-b758-1583192b51d3 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:08:51.520188 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c704e58-ac84-45ac-b758-1583192b51d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:08:51.520468 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c704e58-ac84-45ac-b758-1583192b51d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:08:51.528398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c704e58-ac84-45ac-b758-1583192b51d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:08:51.530067 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c704e58-ac84-45ac-b758-1583192b51d3 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:08:51.556647 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1181/2338] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:08:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:08:53.139907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba368c7d-6d1e-4d9f-a8c6-091facb9f8bf service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:08:53.159443 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba368c7d-6d1e-4d9f-a8c6-091facb9f8bf service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:08:53.163219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239df5-2102-4b48-b7ad-1b11a608d4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:08:53.163871 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239df5-2102-4b48-b7ad-1b11a608d4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:08:53.164155 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239df5-2102-4b48-b7ad-1b11a608d4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:08:53.164492 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239df5-2102-4b48-b7ad-1b11a608d4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:08:53.175626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f239df5-2102-4b48-b7ad-1b11a608d4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:08:53.177158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f239df5-2102-4b48-b7ad-1b11a608d4f5 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:08:53.189428 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1158/2339] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:08:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:08:54.366512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c704e58-ac84-45ac-b758-1583192b51d3 service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:08:54.368203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6c704e58-ac84-45ac-b758-1583192b51d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:08:54.380966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c704e58-ac84-45ac-b758-1583192b51d3 service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:08:54.385081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ddafe-5bbe-490e-9ce9-1245667b3033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:08:54.386027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ddafe-5bbe-490e-9ce9-1245667b3033 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:08:54.386780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ddafe-5bbe-490e-9ce9-1245667b3033 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:08:54.387360 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ddafe-5bbe-490e-9ce9-1245667b3033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:08:54.398367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ddafe-5bbe-490e-9ce9-1245667b3033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:08:54.399813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ddafe-5bbe-490e-9ce9-1245667b3033 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:08:54.410940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1182/2340] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:08:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:08:55.570724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239df5-2102-4b48-b7ad-1b11a608d4f5 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:08:55.580961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239df5-2102-4b48-b7ad-1b11a608d4f5 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:08:55.585435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a83be-8038-4a05-83f4-a41fdcc3d6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:08:55.586082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a83be-8038-4a05-83f4-a41fdcc3d6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:08:55.586384 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a83be-8038-4a05-83f4-a41fdcc3d6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:08:55.586679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a83be-8038-4a05-83f4-a41fdcc3d6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:08:55.588461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6e8a83be-8038-4a05-83f4-a41fdcc3d6e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:08:55.679287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a83be-8038-4a05-83f4-a41fdcc3d6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:08:55.680655 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a83be-8038-4a05-83f4-a41fdcc3d6e6 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:08:55.706026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1159/2341] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:08:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:08:59.951506 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ddafe-5bbe-490e-9ce9-1245667b3033 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:08:59.953268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b16ddafe-5bbe-490e-9ce9-1245667b3033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:08:59.968640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ddafe-5bbe-490e-9ce9-1245667b3033 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:08:59.973983 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca7e88-3baf-4b46-b83c-0358038e872d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:08:59.974633 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca7e88-3baf-4b46-b83c-0358038e872d service placement] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:08:59.974920 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca7e88-3baf-4b46-b83c-0358038e872d service placement] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:08:59.975198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca7e88-3baf-4b46-b83c-0358038e872d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:08:59.976973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-9dca7e88-3baf-4b46-b83c-0358038e872d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:08:59.989868 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca7e88-3baf-4b46-b83c-0358038e872d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:08:59.991576 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca7e88-3baf-4b46-b83c-0358038e872d service placement] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:09:00.002739 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1183/2342] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:08:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:09:03.779055 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a83be-8038-4a05-83f4-a41fdcc3d6e6 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:09:03.790206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a83be-8038-4a05-83f4-a41fdcc3d6e6 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:09:03.796325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffdc1d-fbf7-4f7d-9142-860160142ca3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:09:03.797075 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffdc1d-fbf7-4f7d-9142-860160142ca3 service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:09:03.797423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffdc1d-fbf7-4f7d-9142-860160142ca3 service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:09:03.797763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffdc1d-fbf7-4f7d-9142-860160142ca3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:09:03.799621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-68ffdc1d-fbf7-4f7d-9142-860160142ca3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:09:03.811754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffdc1d-fbf7-4f7d-9142-860160142ca3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:09:03.819978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffdc1d-fbf7-4f7d-9142-860160142ca3 service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:09:03.823538 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1160/2343] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:09:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:09:03.921961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca7e88-3baf-4b46-b83c-0358038e872d service placement] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:09:03.923770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-9dca7e88-3baf-4b46-b83c-0358038e872d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:09:03.938210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca7e88-3baf-4b46-b83c-0358038e872d service placement] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:09:03.943009 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffecd4-9eaa-44f7-8f40-8008dede5a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:09:03.943882 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffecd4-9eaa-44f7-8f40-8008dede5a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:09:03.944169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffecd4-9eaa-44f7-8f40-8008dede5a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:09:03.944448 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffecd4-9eaa-44f7-8f40-8008dede5a77 admin admin] PATH_INFO: `/v3/users/fb4a1cae173c4793a49032181d6417af` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:09:03.945679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffecd4-9eaa-44f7-8f40-8008dede5a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb4a1cae173c4793a49032181d6417af)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:09:03.947836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffecd4-9eaa-44f7-8f40-8008dede5a77 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:09:04.075186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-b7ffecd4-9eaa-44f7-8f40-8008dede5a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb4a1cae173c4793a49032181d6417af'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:04.136509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-b7ffecd4-9eaa-44f7-8f40-8008dede5a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb4a1cae173c4793a49032181d6417af'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:04.143920 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-b7ffecd4-9eaa-44f7-8f40-8008dede5a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb4a1cae173c4793a49032181d6417af'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:04.144557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-b7ffecd4-9eaa-44f7-8f40-8008dede5a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb4a1cae173c4793a49032181d6417af'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:04.157026 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-b7ffecd4-9eaa-44f7-8f40-8008dede5a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb4a1cae173c4793a49032181d6417af'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:04.162945 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1184/2344] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:09:03 2022] DELETE /identity/v3/users/fb4a1cae173c4793a49032181d6417af => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:09:04.424473 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffdc1d-fbf7-4f7d-9142-860160142ca3 service placement] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:09:04.438248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffdc1d-fbf7-4f7d-9142-860160142ca3 service placement] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:09:04.499054 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8193550-a0dc-4f05-8bff-cefb69cfa70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:09:04.502128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8193550-a0dc-4f05-8bff-cefb69cfa70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:09:04.502128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8193550-a0dc-4f05-8bff-cefb69cfa70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:09:04.502128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8193550-a0dc-4f05-8bff-cefb69cfa70c admin admin] PATH_INFO: `/v3/projects/889878507fdb4e6791348f4f989b0932` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:09:04.503212 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:09:04.511528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8193550-a0dc-4f05-8bff-cefb69cfa70c admin admin] RBAC: Authorizing `identity:delete_project(project_id=889878507fdb4e6791348f4f989b0932)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:09:04.513552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8193550-a0dc-4f05-8bff-cefb69cfa70c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:09:04.646595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b8193550-a0dc-4f05-8bff-cefb69cfa70c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '889878507fdb4e6791348f4f989b0932', 'request_id': 'req-b8193550-a0dc-4f05-8bff-cefb69cfa70c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:04.652645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b8193550-a0dc-4f05-8bff-cefb69cfa70c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '889878507fdb4e6791348f4f989b0932', 'request_id': 'req-b8193550-a0dc-4f05-8bff-cefb69cfa70c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:04.742105 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b8193550-a0dc-4f05-8bff-cefb69cfa70c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '889878507fdb4e6791348f4f989b0932', 'request_id': 'req-b8193550-a0dc-4f05-8bff-cefb69cfa70c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:04.753610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b8193550-a0dc-4f05-8bff-cefb69cfa70c admin admin] The token cache is being invalidate because project 889878507fdb4e6791348f4f989b0932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:09:04.753900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b8193550-a0dc-4f05-8bff-cefb69cfa70c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:04.754514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b8193550-a0dc-4f05-8bff-cefb69cfa70c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:04.756115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1161/2345] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:09:04 2022] DELETE /identity/v3/projects/889878507fdb4e6791348f4f989b0932 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:09:04.760073 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffecd4-9eaa-44f7-8f40-8008dede5a77 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:09:04.761705 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b7ffecd4-9eaa-44f7-8f40-8008dede5a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:09:04.774535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffecd4-9eaa-44f7-8f40-8008dede5a77 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:09:04.822169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:09:04.831028 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151e071-a4df-444a-9542-5858741237b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:09:04.831917 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151e071-a4df-444a-9542-5858741237b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:09:04.832200 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151e071-a4df-444a-9542-5858741237b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:09:04.832478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151e071-a4df-444a-9542-5858741237b8 admin admin] PATH_INFO: `/v3/users/5e60341f1bec4ee981fc9b6e6ec4384d` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:09:04.846097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151e071-a4df-444a-9542-5858741237b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e60341f1bec4ee981fc9b6e6ec4384d)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:09:04.848036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151e071-a4df-444a-9542-5858741237b8 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:09:05.041508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e151e071-a4df-444a-9542-5858741237b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e60341f1bec4ee981fc9b6e6ec4384d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:05.084287 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e151e071-a4df-444a-9542-5858741237b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e60341f1bec4ee981fc9b6e6ec4384d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:05.092055 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e151e071-a4df-444a-9542-5858741237b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e60341f1bec4ee981fc9b6e6ec4384d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:05.092693 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e151e071-a4df-444a-9542-5858741237b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e60341f1bec4ee981fc9b6e6ec4384d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:05.104546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e151e071-a4df-444a-9542-5858741237b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e60341f1bec4ee981fc9b6e6ec4384d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:05.110498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1185/2346] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:09:04 2022] DELETE /identity/v3/users/5e60341f1bec4ee981fc9b6e6ec4384d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:09:05.337311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8193550-a0dc-4f05-8bff-cefb69cfa70c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:09:05.338981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b8193550-a0dc-4f05-8bff-cefb69cfa70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:09:05.352261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8193550-a0dc-4f05-8bff-cefb69cfa70c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:09:05.410189 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55a9f0-cd31-4470-aef2-939b7bfafdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:09:05.411005 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a9f0-cd31-4470-aef2-939b7bfafdff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:09:05.411293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a9f0-cd31-4470-aef2-939b7bfafdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:09:05.411591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a9f0-cd31-4470-aef2-939b7bfafdff admin admin] PATH_INFO: `/v3/projects/b5796adc2c9747be90ca88f4bec0ab27` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:09:05.422305 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55a9f0-cd31-4470-aef2-939b7bfafdff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5796adc2c9747be90ca88f4bec0ab27)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:09:05.424228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55a9f0-cd31-4470-aef2-939b7bfafdff admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:09:05.554888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ae55a9f0-cd31-4470-aef2-939b7bfafdff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5796adc2c9747be90ca88f4bec0ab27', 'request_id': 'req-ae55a9f0-cd31-4470-aef2-939b7bfafdff'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:05.563555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ae55a9f0-cd31-4470-aef2-939b7bfafdff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5796adc2c9747be90ca88f4bec0ab27', 'request_id': 'req-ae55a9f0-cd31-4470-aef2-939b7bfafdff'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:05.644494 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ae55a9f0-cd31-4470-aef2-939b7bfafdff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5796adc2c9747be90ca88f4bec0ab27', 'request_id': 'req-ae55a9f0-cd31-4470-aef2-939b7bfafdff'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:05.656462 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ae55a9f0-cd31-4470-aef2-939b7bfafdff admin admin] The token cache is being invalidate because project b5796adc2c9747be90ca88f4bec0ab27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:09:05.659142 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ae55a9f0-cd31-4470-aef2-939b7bfafdff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:05.659142 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ae55a9f0-cd31-4470-aef2-939b7bfafdff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:09:05.660356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1162/2347] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:09:05 2022] DELETE /identity/v3/projects/b5796adc2c9747be90ca88f4bec0ab27 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:09:15.106891 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=34,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:09:15.653318 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:09:36.802178 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151e071-a4df-444a-9542-5858741237b8 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:09:36.803613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e151e071-a4df-444a-9542-5858741237b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:09:36.898789 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151e071-a4df-444a-9542-5858741237b8 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:09:36.960827 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38194a6b-af6e-4d7f-885e-00a76e308bf7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:09:36.961533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38194a6b-af6e-4d7f-885e-00a76e308bf7 service placement] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:09:36.961823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38194a6b-af6e-4d7f-885e-00a76e308bf7 service placement] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:09:36.962104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38194a6b-af6e-4d7f-885e-00a76e308bf7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:09:36.963897 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-38194a6b-af6e-4d7f-885e-00a76e308bf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:09:36.975760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38194a6b-af6e-4d7f-885e-00a76e308bf7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:09:36.977412 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38194a6b-af6e-4d7f-885e-00a76e308bf7 service placement] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:09:36.988449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1186/2348] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:09:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:09:46.984621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=69 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:10:50.686334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55a9f0-cd31-4470-aef2-939b7bfafdff admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:10:50.687675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ae55a9f0-cd31-4470-aef2-939b7bfafdff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:10:50.766127 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55a9f0-cd31-4470-aef2-939b7bfafdff admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:10:50.771804 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d806e-2c97-4c41-a805-cac25a5e7c17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:10:50.772453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d806e-2c97-4c41-a805-cac25a5e7c17 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:10:50.772737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d806e-2c97-4c41-a805-cac25a5e7c17 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:10:50.773041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d806e-2c97-4c41-a805-cac25a5e7c17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:10:50.774834 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fd5d806e-2c97-4c41-a805-cac25a5e7c17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:10:50.833103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d806e-2c97-4c41-a805-cac25a5e7c17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:10:50.834712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d806e-2c97-4c41-a805-cac25a5e7c17 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:10:50.843550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1163/2349] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:10:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:10:53.519668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38194a6b-af6e-4d7f-885e-00a76e308bf7 service placement] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:10:53.531978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38194a6b-af6e-4d7f-885e-00a76e308bf7 service placement] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:10:53.538775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b1c81-a6fc-404c-8565-45cc2cd2b61d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:10:53.539366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b1c81-a6fc-404c-8565-45cc2cd2b61d service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:10:53.539653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b1c81-a6fc-404c-8565-45cc2cd2b61d service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:10:53.539932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b1c81-a6fc-404c-8565-45cc2cd2b61d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:10:53.541756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-847b1c81-a6fc-404c-8565-45cc2cd2b61d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:10:53.555045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b1c81-a6fc-404c-8565-45cc2cd2b61d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:10:53.556640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b1c81-a6fc-404c-8565-45cc2cd2b61d service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:10:53.569160 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1187/2350] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:10:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:11:00.839606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=59 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:11:03.563174 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=6 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:12:35.487965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d806e-2c97-4c41-a805-cac25a5e7c17 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:12:35.490065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fd5d806e-2c97-4c41-a805-cac25a5e7c17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:12:35.577419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d806e-2c97-4c41-a805-cac25a5e7c17 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:12:35.581089 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fed986-a2cd-458a-b95b-a5d7e31a581e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:12:35.581738 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fed986-a2cd-458a-b95b-a5d7e31a581e service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:12:35.582026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fed986-a2cd-458a-b95b-a5d7e31a581e service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:12:35.582308 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fed986-a2cd-458a-b95b-a5d7e31a581e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:12:35.584160 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f1fed986-a2cd-458a-b95b-a5d7e31a581e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:12:35.593424 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fed986-a2cd-458a-b95b-a5d7e31a581e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:12:35.594863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fed986-a2cd-458a-b95b-a5d7e31a581e service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:12:35.602816 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1164/2351] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:12:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:12:45.599249 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=39 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:12:51.704147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b1c81-a6fc-404c-8565-45cc2cd2b61d service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:12:51.705653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-847b1c81-a6fc-404c-8565-45cc2cd2b61d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:12:51.760685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b1c81-a6fc-404c-8565-45cc2cd2b61d service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:12:51.766387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516c364-1b02-403a-9074-94082767b333 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:12:51.767050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516c364-1b02-403a-9074-94082767b333 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:12:51.767336 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516c364-1b02-403a-9074-94082767b333 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:12:51.767616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516c364-1b02-403a-9074-94082767b333 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:12:51.769455 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6516c364-1b02-403a-9074-94082767b333 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:12:51.841845 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516c364-1b02-403a-9074-94082767b333 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:12:51.843445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516c364-1b02-403a-9074-94082767b333 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:12:51.852451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1188/2352] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:12:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:12:52.089204 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fed986-a2cd-458a-b95b-a5d7e31a581e service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:12:52.102425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fed986-a2cd-458a-b95b-a5d7e31a581e service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:12:52.107872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955b86e-6f9f-4dbc-947e-0293f2175f62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:12:52.108513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955b86e-6f9f-4dbc-947e-0293f2175f62 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:12:52.108799 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955b86e-6f9f-4dbc-947e-0293f2175f62 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:12:52.109112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955b86e-6f9f-4dbc-947e-0293f2175f62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:12:52.110966 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c955b86e-6f9f-4dbc-947e-0293f2175f62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:12:52.180752 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955b86e-6f9f-4dbc-947e-0293f2175f62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:12:52.182363 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955b86e-6f9f-4dbc-947e-0293f2175f62 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:12:52.191248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1165/2353] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:12:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:12:53.823794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516c364-1b02-403a-9074-94082767b333 service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:12:53.825268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6516c364-1b02-403a-9074-94082767b333 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:12:53.890493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516c364-1b02-403a-9074-94082767b333 service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:12:53.894120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e94d75-cbcf-4b77-b790-023e767b5f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:12:53.894764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e94d75-cbcf-4b77-b790-023e767b5f09 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:12:53.895680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e94d75-cbcf-4b77-b790-023e767b5f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:12:53.895988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e94d75-cbcf-4b77-b790-023e767b5f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:12:53.897748 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-25e94d75-cbcf-4b77-b790-023e767b5f09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:12:53.953805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:12:53.967150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e94d75-cbcf-4b77-b790-023e767b5f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:12:53.968746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e94d75-cbcf-4b77-b790-023e767b5f09 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:12:53.978391 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1189/2354] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:12:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:13:02.187115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=33 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:13:04.002216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=6 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:13:53.668809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955b86e-6f9f-4dbc-947e-0293f2175f62 service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:13:53.678127 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955b86e-6f9f-4dbc-947e-0293f2175f62 service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:13:53.682345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b7b7d-331d-43b4-9cea-0e79341071ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:13:53.682981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b7b7d-331d-43b4-9cea-0e79341071ba service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:13:53.683262 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b7b7d-331d-43b4-9cea-0e79341071ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:13:53.683537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b7b7d-331d-43b4-9cea-0e79341071ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:13:53.685298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1a2b7b7d-331d-43b4-9cea-0e79341071ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:13:53.699726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b7b7d-331d-43b4-9cea-0e79341071ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:13:53.701190 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b7b7d-331d-43b4-9cea-0e79341071ba service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:13:53.711942 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1166/2355] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:13:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:13:54.889020 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e94d75-cbcf-4b77-b790-023e767b5f09 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:13:54.890586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-25e94d75-cbcf-4b77-b790-023e767b5f09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:13:54.903174 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e94d75-cbcf-4b77-b790-023e767b5f09 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:13:54.906884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3dafb-e15d-4608-9efb-26db8eaf5cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:13:54.907614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3dafb-e15d-4608-9efb-26db8eaf5cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:13:54.907968 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3dafb-e15d-4608-9efb-26db8eaf5cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:13:54.908311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3dafb-e15d-4608-9efb-26db8eaf5cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:13:54.910170 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6aa3dafb-e15d-4608-9efb-26db8eaf5cd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:13:54.926064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3dafb-e15d-4608-9efb-26db8eaf5cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:13:54.927148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3dafb-e15d-4608-9efb-26db8eaf5cd8 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:13:54.939941 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1190/2356] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:13:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:14:03.707097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=6 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:14:04.934160 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=6 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:14:39.750131 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b7b7d-331d-43b4-9cea-0e79341071ba service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:14:39.751567 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1a2b7b7d-331d-43b4-9cea-0e79341071ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:14:39.778079 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b7b7d-331d-43b4-9cea-0e79341071ba service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:14:39.783118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460ad3d-c9a6-4d07-baad-aaf4a17f6025 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:14:39.783762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460ad3d-c9a6-4d07-baad-aaf4a17f6025 service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:14:39.784051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460ad3d-c9a6-4d07-baad-aaf4a17f6025 service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:14:39.784335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460ad3d-c9a6-4d07-baad-aaf4a17f6025 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:14:39.793387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460ad3d-c9a6-4d07-baad-aaf4a17f6025 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:14:39.794974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460ad3d-c9a6-4d07-baad-aaf4a17f6025 service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:14:39.805021 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1167/2357] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:14:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:14:49.800829 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=11 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:14:54.135297 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3dafb-e15d-4608-9efb-26db8eaf5cd8 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:14:54.145839 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3dafb-e15d-4608-9efb-26db8eaf5cd8 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:14:54.149458 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67f17f-3916-45a3-b5be-2c8801eab934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:14:54.150106 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67f17f-3916-45a3-b5be-2c8801eab934 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:14:54.150392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67f17f-3916-45a3-b5be-2c8801eab934 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:14:54.150670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67f17f-3916-45a3-b5be-2c8801eab934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:14:54.152414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-2b67f17f-3916-45a3-b5be-2c8801eab934 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:14:54.224989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67f17f-3916-45a3-b5be-2c8801eab934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:14:54.226445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67f17f-3916-45a3-b5be-2c8801eab934 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:14:54.235462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1191/2358] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:14:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:15:04.231375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=33 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:15:51.332364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460ad3d-c9a6-4d07-baad-aaf4a17f6025 service placement] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:15:51.341760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460ad3d-c9a6-4d07-baad-aaf4a17f6025 service placement] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:15:51.346003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30814cee-2539-468f-a178-a579896dd968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:15:51.346640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30814cee-2539-468f-a178-a579896dd968 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:51.346928 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30814cee-2539-468f-a178-a579896dd968 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:51.347211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30814cee-2539-468f-a178-a579896dd968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:51.349002 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-30814cee-2539-468f-a178-a579896dd968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:15:51.414299 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30814cee-2539-468f-a178-a579896dd968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:15:51.415737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30814cee-2539-468f-a178-a579896dd968 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:15:51.426114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1168/2359] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:15:55.543633 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67f17f-3916-45a3-b5be-2c8801eab934 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:15:55.559959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67f17f-3916-45a3-b5be-2c8801eab934 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:15:55.579700 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54c188-dafe-42f0-8c8e-adf06020f2c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:15:55.580647 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54c188-dafe-42f0-8c8e-adf06020f2c4 service placement] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:55.581762 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54c188-dafe-42f0-8c8e-adf06020f2c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:55.582195 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54c188-dafe-42f0-8c8e-adf06020f2c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:55.586625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6f54c188-dafe-42f0-8c8e-adf06020f2c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:15:55.605388 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54c188-dafe-42f0-8c8e-adf06020f2c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:15:55.608076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54c188-dafe-42f0-8c8e-adf06020f2c4 service placement] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:15:55.624973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1192/2360] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:15:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:15:55.688811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30814cee-2539-468f-a178-a579896dd968 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:15:55.690287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-30814cee-2539-468f-a178-a579896dd968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:15:55.702532 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30814cee-2539-468f-a178-a579896dd968 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:15:55.714413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859bee-06be-4671-a617-936fda3e4f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:15:55.715316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859bee-06be-4671-a617-936fda3e4f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:55.715790 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859bee-06be-4671-a617-936fda3e4f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:55.716068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859bee-06be-4671-a617-936fda3e4f82 admin admin] PATH_INFO: `/v3/users/6863a714f4cf4350940d638c82fbc650` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:55.718039 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb859bee-06be-4671-a617-936fda3e4f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6863a714f4cf4350940d638c82fbc650)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:15:55.720058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb859bee-06be-4671-a617-936fda3e4f82 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:15:55.937025 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bb859bee-06be-4671-a617-936fda3e4f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6863a714f4cf4350940d638c82fbc650'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:15:56.031611 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bb859bee-06be-4671-a617-936fda3e4f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6863a714f4cf4350940d638c82fbc650'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:15:56.039218 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bb859bee-06be-4671-a617-936fda3e4f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6863a714f4cf4350940d638c82fbc650'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:15:56.039906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bb859bee-06be-4671-a617-936fda3e4f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6863a714f4cf4350940d638c82fbc650'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:15:56.052131 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bb859bee-06be-4671-a617-936fda3e4f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6863a714f4cf4350940d638c82fbc650'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:15:56.058032 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1169/2361] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:15:55 2022] DELETE /identity/v3/users/6863a714f4cf4350940d638c82fbc650 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:15:56.366812 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54c188-dafe-42f0-8c8e-adf06020f2c4 service placement] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:15:56.379689 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54c188-dafe-42f0-8c8e-adf06020f2c4 service placement] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:15:56.446228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f503fcd-e75b-43b7-bb25-dc9b43d51504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:15:56.447105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f503fcd-e75b-43b7-bb25-dc9b43d51504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:56.447386 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f503fcd-e75b-43b7-bb25-dc9b43d51504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:56.447660 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f503fcd-e75b-43b7-bb25-dc9b43d51504 admin admin] PATH_INFO: `/v3/projects/4f02f0e87ef1498a836b2e1d3bb842cf` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:56.448833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f503fcd-e75b-43b7-bb25-dc9b43d51504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f02f0e87ef1498a836b2e1d3bb842cf)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:15:56.450793 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f503fcd-e75b-43b7-bb25-dc9b43d51504 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:15:56.564074 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8f503fcd-e75b-43b7-bb25-dc9b43d51504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f02f0e87ef1498a836b2e1d3bb842cf', 'request_id': 'req-8f503fcd-e75b-43b7-bb25-dc9b43d51504'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:15:56.571575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8f503fcd-e75b-43b7-bb25-dc9b43d51504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f02f0e87ef1498a836b2e1d3bb842cf', 'request_id': 'req-8f503fcd-e75b-43b7-bb25-dc9b43d51504'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:15:56.619498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8f503fcd-e75b-43b7-bb25-dc9b43d51504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f02f0e87ef1498a836b2e1d3bb842cf', 'request_id': 'req-8f503fcd-e75b-43b7-bb25-dc9b43d51504'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:15:56.631566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8f503fcd-e75b-43b7-bb25-dc9b43d51504 admin admin] The token cache is being invalidate because project 4f02f0e87ef1498a836b2e1d3bb842cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:15:56.631856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8f503fcd-e75b-43b7-bb25-dc9b43d51504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:15:56.632497 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8f503fcd-e75b-43b7-bb25-dc9b43d51504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:15:56.634164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1193/2362] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:15:56 2022] DELETE /identity/v3/projects/4f02f0e87ef1498a836b2e1d3bb842cf => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:15:56.640958 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3323f7-56c2-4001-b51e-a57cded2dc19 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:56.641260 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3323f7-56c2-4001-b51e-a57cded2dc19 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:56.641548 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3323f7-56c2-4001-b51e-a57cded2dc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:56.699811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-bd3323f7-56c2-4001-b51e-a57cded2dc19 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:15:56.701215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-bd3323f7-56c2-4001-b51e-a57cded2dc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:15:56.731308 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:15:56.760739 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1170/2363] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:15:56.768648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cf459-5859-47aa-983b-b93bea393e1b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:56.768961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cf459-5859-47aa-983b-b93bea393e1b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:56.769259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cf459-5859-47aa-983b-b93bea393e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:56.788497 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-9d1cf459-5859-47aa-983b-b93bea393e1b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:15:56.789841 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-9d1cf459-5859-47aa-983b-b93bea393e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:15:56.799652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1194/2364] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:15:56.803778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3323f7-56c2-4001-b51e-a57cded2dc19 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:15:56.814711 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3323f7-56c2-4001-b51e-a57cded2dc19 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:15:56.819787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70b2d2-1fa3-4f99-bb46-6668ee379d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:15:56.822471 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70b2d2-1fa3-4f99-bb46-6668ee379d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:56.822471 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70b2d2-1fa3-4f99-bb46-6668ee379d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:56.822471 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70b2d2-1fa3-4f99-bb46-6668ee379d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:56.822471 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70b2d2-1fa3-4f99-bb46-6668ee379d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:15:56.822471 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70b2d2-1fa3-4f99-bb46-6668ee379d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:15:56.823761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70b2d2-1fa3-4f99-bb46-6668ee379d93 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:15:56.835801 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1171/2365] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:15:56.840121 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cf459-5859-47aa-983b-b93bea393e1b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:15:56.849639 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cf459-5859-47aa-983b-b93bea393e1b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:15:56.854615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1ef11-9b63-4683-9cde-87490e5043de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:15:56.855466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1ef11-9b63-4683-9cde-87490e5043de admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:56.855823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1ef11-9b63-4683-9cde-87490e5043de admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:56.856185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1ef11-9b63-4683-9cde-87490e5043de admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:56.857063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1ef11-9b63-4683-9cde-87490e5043de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:15:56.861480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1ef11-9b63-4683-9cde-87490e5043de admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:15:56.973546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1195/2366] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:15:56 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:15:56.975018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70b2d2-1fa3-4f99-bb46-6668ee379d93 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:15:56.985900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70b2d2-1fa3-4f99-bb46-6668ee379d93 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:15:57.066725 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1a44c-1176-4588-94af-2aad9e1cca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:15:57.067405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1a44c-1176-4588-94af-2aad9e1cca59 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:57.067671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1a44c-1176-4588-94af-2aad9e1cca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:57.067956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1a44c-1176-4588-94af-2aad9e1cca59 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:57.068655 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1a44c-1176-4588-94af-2aad9e1cca59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:15:57.070667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1a44c-1176-4588-94af-2aad9e1cca59 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:15:57.180925 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1172/2367] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:15:56 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:15:57.185241 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1ef11-9b63-4683-9cde-87490e5043de admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:15:57.195668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1ef11-9b63-4683-9cde-87490e5043de admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:15:57.200235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc073c2-29b8-44a2-95c8-029c6b4f65c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:15:57.201073 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc073c2-29b8-44a2-95c8-029c6b4f65c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:57.201371 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc073c2-29b8-44a2-95c8-029c6b4f65c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:57.201653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc073c2-29b8-44a2-95c8-029c6b4f65c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:57.202543 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc073c2-29b8-44a2-95c8-029c6b4f65c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:15:57.204184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc073c2-29b8-44a2-95c8-029c6b4f65c8 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:15:57.214690 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1196/2368] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:15:57.219114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1a44c-1176-4588-94af-2aad9e1cca59 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:15:57.229195 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1a44c-1176-4588-94af-2aad9e1cca59 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:15:57.235218 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4d504-7b4d-4c1e-9d27-190376c502a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:15:57.235914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4d504-7b4d-4c1e-9d27-190376c502a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:57.236186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4d504-7b4d-4c1e-9d27-190376c502a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:57.236469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4d504-7b4d-4c1e-9d27-190376c502a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:57.237292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4d504-7b4d-4c1e-9d27-190376c502a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:15:57.238903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4d504-7b4d-4c1e-9d27-190376c502a4 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:15:57.249343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1173/2369] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:15:57.253528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc073c2-29b8-44a2-95c8-029c6b4f65c8 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:15:57.263387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc073c2-29b8-44a2-95c8-029c6b4f65c8 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:15:57.268695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f405e2c-e414-4763-bc8c-5c8eee702fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:15:57.269637 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f405e2c-e414-4763-bc8c-5c8eee702fba admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:57.269927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f405e2c-e414-4763-bc8c-5c8eee702fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:57.270209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f405e2c-e414-4763-bc8c-5c8eee702fba admin admin] PATH_INFO: `/v3/projects/2c2954612dd04cd9a7bcb3266c8e7d58/users/caf17387465741db84cb1a1577da3911/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:57.286114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f405e2c-e414-4763-bc8c-5c8eee702fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c2954612dd04cd9a7bcb3266c8e7d58, user_id=caf17387465741db84cb1a1577da3911, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:15:57.288793 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f405e2c-e414-4763-bc8c-5c8eee702fba admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:15:57.362412 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1197/2370] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:15:57 2022] PUT /identity/v3/projects/2c2954612dd04cd9a7bcb3266c8e7d58/users/caf17387465741db84cb1a1577da3911/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:15:57.373993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8be1f-6783-446f-87e1-a5d299904bb5 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:57.374417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8be1f-6783-446f-87e1-a5d299904bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:57.374838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8be1f-6783-446f-87e1-a5d299904bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:57.405435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-70f8be1f-6783-446f-87e1-a5d299904bb5 None None] MFA Rules not processed for user `caf17387465741db84cb1a1577da3911`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:15:57.406867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-70f8be1f-6783-446f-87e1-a5d299904bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:15:57.481515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1174/2371] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:15:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:15:57.492986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f405e2c-e414-4763-bc8c-5c8eee702fba admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:15:57.494794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-9f405e2c-e414-4763-bc8c-5c8eee702fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:15:57.502196 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:15:57.558837 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d4755-79ae-4ae8-9914-c507333be940 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:57.559126 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d4755-79ae-4ae8-9914-c507333be940 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:57.559408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d4755-79ae-4ae8-9914-c507333be940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:57.575625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f405e2c-e414-4763-bc8c-5c8eee702fba admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:15:57.582301 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2ab48-e8de-4cac-9f38-cbe0c24fe51e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:15:57.582985 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2ab48-e8de-4cac-9f38-cbe0c24fe51e service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:57.583315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2ab48-e8de-4cac-9f38-cbe0c24fe51e service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:57.583539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2ab48-e8de-4cac-9f38-cbe0c24fe51e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:57.586353 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-064d4755-79ae-4ae8-9914-c507333be940 None None] MFA Rules not processed for user `6f0ce995acc646d88f47c92e8458931a`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:15:57.587538 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-064d4755-79ae-4ae8-9914-c507333be940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:15:57.591613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2ab48-e8de-4cac-9f38-cbe0c24fe51e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:15:57.595228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2ab48-e8de-4cac-9f38-cbe0c24fe51e service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:15:57.602650 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1198/2372] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:15:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:15:57.607005 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:15:57.648189 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1175/2373] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:15:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:15:57.975067 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2ab48-e8de-4cac-9f38-cbe0c24fe51e service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:15:57.976422 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b2e2ab48-e8de-4cac-9f38-cbe0c24fe51e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:15:58.038515 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2ab48-e8de-4cac-9f38-cbe0c24fe51e service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:15:58.042257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe1a51-43ed-462e-9ad0-249a4af0c610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:15:58.042914 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe1a51-43ed-462e-9ad0-249a4af0c610 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:58.043199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe1a51-43ed-462e-9ad0-249a4af0c610 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:58.043481 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe1a51-43ed-462e-9ad0-249a4af0c610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:58.046184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-28fe1a51-43ed-462e-9ad0-249a4af0c610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:15:58.056308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe1a51-43ed-462e-9ad0-249a4af0c610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:15:58.057844 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe1a51-43ed-462e-9ad0-249a4af0c610 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:15:58.066962 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1199/2374] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:15:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:15:59.507678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d4755-79ae-4ae8-9914-c507333be940 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:15:59.509116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-064d4755-79ae-4ae8-9914-c507333be940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:15:59.576501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d4755-79ae-4ae8-9914-c507333be940 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:15:59.581497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c571deb-d346-40b4-9e26-3867ba39ec80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:15:59.582138 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c571deb-d346-40b4-9e26-3867ba39ec80 service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:15:59.582423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c571deb-d346-40b4-9e26-3867ba39ec80 service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:15:59.582699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c571deb-d346-40b4-9e26-3867ba39ec80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:15:59.584436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2c571deb-d346-40b4-9e26-3867ba39ec80 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:15:59.595658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c571deb-d346-40b4-9e26-3867ba39ec80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:15:59.597285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c571deb-d346-40b4-9e26-3867ba39ec80 service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:15:59.606809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1176/2375] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:15:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:16:08.063265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=58 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:16:09.602758 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=46 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:17:45.626916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe1a51-43ed-462e-9ad0-249a4af0c610 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:17:45.628315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-28fe1a51-43ed-462e-9ad0-249a4af0c610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:17:45.696113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe1a51-43ed-462e-9ad0-249a4af0c610 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:17:45.699735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789ef65-2f9e-4b22-85b5-8bff609ac9cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:17:45.700386 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789ef65-2f9e-4b22-85b5-8bff609ac9cc service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:17:45.700672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789ef65-2f9e-4b22-85b5-8bff609ac9cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:17:45.700967 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789ef65-2f9e-4b22-85b5-8bff609ac9cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:17:45.702719 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-1789ef65-2f9e-4b22-85b5-8bff609ac9cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:17:45.781658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789ef65-2f9e-4b22-85b5-8bff609ac9cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:17:45.783102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789ef65-2f9e-4b22-85b5-8bff609ac9cc service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:17:45.802976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1200/2376] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:17:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:17:46.195551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c571deb-d346-40b4-9e26-3867ba39ec80 service placement] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:17:46.207590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c571deb-d346-40b4-9e26-3867ba39ec80 service placement] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:17:46.212995 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb637722-f9c9-40de-baeb-c918e2ec056e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:17:46.213633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb637722-f9c9-40de-baeb-c918e2ec056e service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:17:46.213916 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb637722-f9c9-40de-baeb-c918e2ec056e service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:17:46.214233 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb637722-f9c9-40de-baeb-c918e2ec056e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:17:46.215971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fb637722-f9c9-40de-baeb-c918e2ec056e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:17:46.228121 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb637722-f9c9-40de-baeb-c918e2ec056e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:17:46.229734 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb637722-f9c9-40de-baeb-c918e2ec056e service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:17:46.240621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1177/2377] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:17:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:17:46.272253 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789ef65-2f9e-4b22-85b5-8bff609ac9cc service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:17:46.284555 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789ef65-2f9e-4b22-85b5-8bff609ac9cc service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:17:46.290512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f961d-4fdb-4ff1-a522-66ec7a224dad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:17:46.291154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f961d-4fdb-4ff1-a522-66ec7a224dad service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:17:46.291437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f961d-4fdb-4ff1-a522-66ec7a224dad service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:17:46.291748 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f961d-4fdb-4ff1-a522-66ec7a224dad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:17:46.293807 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-722f961d-4fdb-4ff1-a522-66ec7a224dad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:17:46.306452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f961d-4fdb-4ff1-a522-66ec7a224dad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:17:46.308039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f961d-4fdb-4ff1-a522-66ec7a224dad service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:17:46.318615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1201/2378] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:17:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:17:56.235624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=6 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:17:56.314181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=72 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:18:54.376392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb637722-f9c9-40de-baeb-c918e2ec056e service nova] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:18:54.377842 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fb637722-f9c9-40de-baeb-c918e2ec056e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:18:54.400323 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb637722-f9c9-40de-baeb-c918e2ec056e service nova] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:18:54.403903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b79003-1cdd-45ea-84d3-fc8ea68b820d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:18:54.404553 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b79003-1cdd-45ea-84d3-fc8ea68b820d service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:18:54.404838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b79003-1cdd-45ea-84d3-fc8ea68b820d service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:18:54.405157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b79003-1cdd-45ea-84d3-fc8ea68b820d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:18:54.406921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-96b79003-1cdd-45ea-84d3-fc8ea68b820d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:18:54.488955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b79003-1cdd-45ea-84d3-fc8ea68b820d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:18:54.490524 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b79003-1cdd-45ea-84d3-fc8ea68b820d service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:18:54.509363 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1178/2379] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:18:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:19:04.505966 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=47 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:19:42.729462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f961d-4fdb-4ff1-a522-66ec7a224dad service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:19:42.781814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f961d-4fdb-4ff1-a522-66ec7a224dad service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:19:42.786832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9f55a-4144-4c39-b396-db9fe9defe21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:19:42.787477 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9f55a-4144-4c39-b396-db9fe9defe21 service placement] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:19:42.787762 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9f55a-4144-4c39-b396-db9fe9defe21 service placement] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:19:42.788045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9f55a-4144-4c39-b396-db9fe9defe21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:19:42.789828 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-84a9f55a-4144-4c39-b396-db9fe9defe21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:19:42.801901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9f55a-4144-4c39-b396-db9fe9defe21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:19:42.803472 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9f55a-4144-4c39-b396-db9fe9defe21 service placement] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:19:42.814463 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1202/2380] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:19:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:19:45.917620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b79003-1cdd-45ea-84d3-fc8ea68b820d service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:19:45.926349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b79003-1cdd-45ea-84d3-fc8ea68b820d service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:19:45.930061 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b64dd-859b-4096-b0b9-53968b891967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:19:45.930704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b64dd-859b-4096-b0b9-53968b891967 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:19:45.930993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b64dd-859b-4096-b0b9-53968b891967 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:19:45.931276 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b64dd-859b-4096-b0b9-53968b891967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:19:45.934437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-583b64dd-859b-4096-b0b9-53968b891967 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:19:45.948282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b64dd-859b-4096-b0b9-53968b891967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:19:45.949750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b64dd-859b-4096-b0b9-53968b891967 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:19:45.960692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1179/2381] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:19:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:19:46.231265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9f55a-4144-4c39-b396-db9fe9defe21 service placement] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:19:46.243204 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9f55a-4144-4c39-b396-db9fe9defe21 service placement] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:19:46.248737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025598f8-7616-46c8-b86b-f792db3c8b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:19:46.250103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025598f8-7616-46c8-b86b-f792db3c8b1d service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:19:46.250103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025598f8-7616-46c8-b86b-f792db3c8b1d service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:19:46.250103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025598f8-7616-46c8-b86b-f792db3c8b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:19:46.251742 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-025598f8-7616-46c8-b86b-f792db3c8b1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:19:46.272539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025598f8-7616-46c8-b86b-f792db3c8b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:19:46.276011 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025598f8-7616-46c8-b86b-f792db3c8b1d service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:19:46.294226 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1203/2382] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:19:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:19:55.955801 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=6 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:19:56.290908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=38 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:21:44.460801 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b64dd-859b-4096-b0b9-53968b891967 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:44.471476 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b64dd-859b-4096-b0b9-53968b891967 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:44.475480 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adee1e2-1583-4406-afaa-6f16e4586b75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:44.477412 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adee1e2-1583-4406-afaa-6f16e4586b75 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:44.477412 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adee1e2-1583-4406-afaa-6f16e4586b75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:44.477412 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adee1e2-1583-4406-afaa-6f16e4586b75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:44.487291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adee1e2-1583-4406-afaa-6f16e4586b75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:44.489470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adee1e2-1583-4406-afaa-6f16e4586b75 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:44.498067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1180/2383] 10.222.0.33 () {60 vars in 1396 bytes} [Wed Jun 1 18:21:44 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:21:44.538718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025598f8-7616-46c8-b86b-f792db3c8b1d service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:44.565351 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025598f8-7616-46c8-b86b-f792db3c8b1d service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:44.571907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feadc95-42b1-4379-8322-86966f86a675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:44.572778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feadc95-42b1-4379-8322-86966f86a675 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:44.573098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feadc95-42b1-4379-8322-86966f86a675 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:44.573473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feadc95-42b1-4379-8322-86966f86a675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:44.575374 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-9feadc95-42b1-4379-8322-86966f86a675 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:44.651332 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feadc95-42b1-4379-8322-86966f86a675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:44.653045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feadc95-42b1-4379-8322-86966f86a675 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:44.673170 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1204/2384] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:21:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:21:46.534889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adee1e2-1583-4406-afaa-6f16e4586b75 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:46.628764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adee1e2-1583-4406-afaa-6f16e4586b75 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:46.633906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa4cb4-52bc-4dfc-9dbe-6ec80017f341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:46.634806 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa4cb4-52bc-4dfc-9dbe-6ec80017f341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:46.635164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa4cb4-52bc-4dfc-9dbe-6ec80017f341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:46.635517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa4cb4-52bc-4dfc-9dbe-6ec80017f341 admin admin] PATH_INFO: `/v3/users/caf17387465741db84cb1a1577da3911` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:46.636820 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa4cb4-52bc-4dfc-9dbe-6ec80017f341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf17387465741db84cb1a1577da3911)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:46.639322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa4cb4-52bc-4dfc-9dbe-6ec80017f341 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:46.865607 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-93fa4cb4-52bc-4dfc-9dbe-6ec80017f341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf17387465741db84cb1a1577da3911'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:46.941794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-93fa4cb4-52bc-4dfc-9dbe-6ec80017f341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf17387465741db84cb1a1577da3911'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:46.951333 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-93fa4cb4-52bc-4dfc-9dbe-6ec80017f341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf17387465741db84cb1a1577da3911'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:46.952040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-93fa4cb4-52bc-4dfc-9dbe-6ec80017f341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf17387465741db84cb1a1577da3911'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:46.965890 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-93fa4cb4-52bc-4dfc-9dbe-6ec80017f341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf17387465741db84cb1a1577da3911'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:46.972128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1181/2385] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:21:46 2022] DELETE /identity/v3/users/caf17387465741db84cb1a1577da3911 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:21:46.977010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa55232-a44c-4a71-944d-fe9ffd21d51c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:46.977589 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa55232-a44c-4a71-944d-fe9ffd21d51c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:46.977589 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa55232-a44c-4a71-944d-fe9ffd21d51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:47.007539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-1aa55232-a44c-4a71-944d-fe9ffd21d51c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:21:47.008756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-1aa55232-a44c-4a71-944d-fe9ffd21d51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:47.070939 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1205/2386] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:21:47.080470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa4cb4-52bc-4dfc-9dbe-6ec80017f341 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:47.082587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-93fa4cb4-52bc-4dfc-9dbe-6ec80017f341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:47.137295 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:21:47.140778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa4cb4-52bc-4dfc-9dbe-6ec80017f341 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:47.144999 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09554670-f1bb-4c07-a07c-0e1c97ba73f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:47.145596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09554670-f1bb-4c07-a07c-0e1c97ba73f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:47.145877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09554670-f1bb-4c07-a07c-0e1c97ba73f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:47.146152 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09554670-f1bb-4c07-a07c-0e1c97ba73f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:47.155613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09554670-f1bb-4c07-a07c-0e1c97ba73f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:47.157147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09554670-f1bb-4c07-a07c-0e1c97ba73f7 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:47.167400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1182/2387] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:21:47.601509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa55232-a44c-4a71-944d-fe9ffd21d51c None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:47.603351 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-1aa55232-a44c-4a71-944d-fe9ffd21d51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:47.628767 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa55232-a44c-4a71-944d-fe9ffd21d51c None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:47.630975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa95af8-46c2-4345-ab4a-7596c4f9919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:47.632243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa95af8-46c2-4345-ab4a-7596c4f9919d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:47.632744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa95af8-46c2-4345-ab4a-7596c4f9919d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:47.633261 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa95af8-46c2-4345-ab4a-7596c4f9919d admin admin] PATH_INFO: `/v3/projects/2c2954612dd04cd9a7bcb3266c8e7d58` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:47.634714 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa95af8-46c2-4345-ab4a-7596c4f9919d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c2954612dd04cd9a7bcb3266c8e7d58)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:47.637126 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa95af8-46c2-4345-ab4a-7596c4f9919d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:47.755049 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2aa95af8-46c2-4345-ab4a-7596c4f9919d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c2954612dd04cd9a7bcb3266c8e7d58', 'request_id': 'req-2aa95af8-46c2-4345-ab4a-7596c4f9919d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:47.761376 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2aa95af8-46c2-4345-ab4a-7596c4f9919d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c2954612dd04cd9a7bcb3266c8e7d58', 'request_id': 'req-2aa95af8-46c2-4345-ab4a-7596c4f9919d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:47.765222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:21:47.821573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2aa95af8-46c2-4345-ab4a-7596c4f9919d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c2954612dd04cd9a7bcb3266c8e7d58', 'request_id': 'req-2aa95af8-46c2-4345-ab4a-7596c4f9919d'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:47.843166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2aa95af8-46c2-4345-ab4a-7596c4f9919d admin admin] The token cache is being invalidate because project 2c2954612dd04cd9a7bcb3266c8e7d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:21:47.843674 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2aa95af8-46c2-4345-ab4a-7596c4f9919d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:47.844655 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2aa95af8-46c2-4345-ab4a-7596c4f9919d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:47.847307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1206/2388] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:21:47 2022] DELETE /identity/v3/projects/2c2954612dd04cd9a7bcb3266c8e7d58 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:21:47.852884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debeb14-2a78-4b63-bd71-bafdcee62f20 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:47.853440 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debeb14-2a78-4b63-bd71-bafdcee62f20 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:47.853945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debeb14-2a78-4b63-bd71-bafdcee62f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:47.875849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-3debeb14-2a78-4b63-bd71-bafdcee62f20 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:21:47.877261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3debeb14-2a78-4b63-bd71-bafdcee62f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:47.895623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff485c84-5d90-487a-9aa0-2edb0b8291ea None None] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:47.896041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff485c84-5d90-487a-9aa0-2edb0b8291ea None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:47.897003 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff485c84-5d90-487a-9aa0-2edb0b8291ea None None] PATH_INFO: `/` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:47.897921 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1207/2389] 10.222.0.33 () {54 vars in 912 bytes} [Wed Jun 1 18:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 01 18:21:47.906691 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabf024-9ee8-43b0-963a-c431f02b1509 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:47.907180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabf024-9ee8-43b0-963a-c431f02b1509 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:47.907474 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabf024-9ee8-43b0-963a-c431f02b1509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:47.983176 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1183/2390] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:21:47.990920 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-ddabf024-9ee8-43b0-963a-c431f02b1509 None None] MFA Rules not processed for user `ae952b30dffa450e97ce4a73da8d00f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:21:47.992660 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ddabf024-9ee8-43b0-963a-c431f02b1509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:47.997529 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3b791-3e28-4e24-8671-98bb55ae3c70 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:47.997840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3b791-3e28-4e24-8671-98bb55ae3c70 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:47.998116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3b791-3e28-4e24-8671-98bb55ae3c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:48.051670 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-eca3b791-3e28-4e24-8671-98bb55ae3c70 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:21:48.061119 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-eca3b791-3e28-4e24-8671-98bb55ae3c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:48.077367 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1184/2391] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:21:48.082879 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3b791-3e28-4e24-8671-98bb55ae3c70 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:48.092684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3b791-3e28-4e24-8671-98bb55ae3c70 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:48.098357 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd92fe-c981-4241-9ac9-dd692848c8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:48.099066 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd92fe-c981-4241-9ac9-dd692848c8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:48.099534 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd92fe-c981-4241-9ac9-dd692848c8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:48.099981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd92fe-c981-4241-9ac9-dd692848c8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:48.100898 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd92fe-c981-4241-9ac9-dd692848c8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:21:48.101413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd92fe-c981-4241-9ac9-dd692848c8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:48.104037 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd92fe-c981-4241-9ac9-dd692848c8a3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:48.107511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1208/2392] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jun 1 18:21:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:21:48.128131 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1185/2393] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 18:21:48.132476 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabf024-9ee8-43b0-963a-c431f02b1509 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:48.137746 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd92fe-c981-4241-9ac9-dd692848c8a3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:48.141049 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e3dd92fe-c981-4241-9ac9-dd692848c8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:48.154264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabf024-9ee8-43b0-963a-c431f02b1509 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:48.162278 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd92fe-c981-4241-9ac9-dd692848c8a3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:48.163140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d963c74-8d5f-4f42-bee8-dfc72cb9d440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:48.164469 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d963c74-8d5f-4f42-bee8-dfc72cb9d440 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:48.165449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d963c74-8d5f-4f42-bee8-dfc72cb9d440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:48.166412 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d963c74-8d5f-4f42-bee8-dfc72cb9d440 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:48.167276 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65898d-5f03-4852-9836-e91539b81845 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:48.167888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65898d-5f03-4852-9836-e91539b81845 service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:48.168088 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65898d-5f03-4852-9836-e91539b81845 service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:48.168530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65898d-5f03-4852-9836-e91539b81845 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:48.168669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d963c74-8d5f-4f42-bee8-dfc72cb9d440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:48.171747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d963c74-8d5f-4f42-bee8-dfc72cb9d440 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:48.183883 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65898d-5f03-4852-9836-e91539b81845 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:48.187364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65898d-5f03-4852-9836-e91539b81845 service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:48.204452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1186/2394] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:21:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:21:48.271929 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1209/2395] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:21:48 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:21:48.273097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65898d-5f03-4852-9836-e91539b81845 service placement] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:48.283752 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65898d-5f03-4852-9836-e91539b81845 service placement] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:48.347371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aeb52a-1afd-4b43-b7d3-7a50c14f672d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:48.348441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aeb52a-1afd-4b43-b7d3-7a50c14f672d admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:48.348441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aeb52a-1afd-4b43-b7d3-7a50c14f672d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:48.348652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aeb52a-1afd-4b43-b7d3-7a50c14f672d admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:48.349337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aeb52a-1afd-4b43-b7d3-7a50c14f672d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:48.351354 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aeb52a-1afd-4b43-b7d3-7a50c14f672d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:48.445695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1187/2396] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:21:48 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:21:48.449454 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d963c74-8d5f-4f42-bee8-dfc72cb9d440 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:48.462340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d963c74-8d5f-4f42-bee8-dfc72cb9d440 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:48.468377 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b20afb-71d2-46d9-9b07-14a25b48375a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:48.469117 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b20afb-71d2-46d9-9b07-14a25b48375a admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:48.469401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b20afb-71d2-46d9-9b07-14a25b48375a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:48.469680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b20afb-71d2-46d9-9b07-14a25b48375a admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:48.471208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b20afb-71d2-46d9-9b07-14a25b48375a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:48.472882 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b20afb-71d2-46d9-9b07-14a25b48375a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:48.489288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1210/2397] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:21:48.493150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aeb52a-1afd-4b43-b7d3-7a50c14f672d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:48.503437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aeb52a-1afd-4b43-b7d3-7a50c14f672d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:48.508349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb2031-801d-494d-bed4-d8982c52dff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:48.509052 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb2031-801d-494d-bed4-d8982c52dff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:48.509343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb2031-801d-494d-bed4-d8982c52dff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:48.509627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb2031-801d-494d-bed4-d8982c52dff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:48.510366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb2031-801d-494d-bed4-d8982c52dff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:48.512044 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb2031-801d-494d-bed4-d8982c52dff6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:48.522496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1188/2398] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:21:48.526623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b20afb-71d2-46d9-9b07-14a25b48375a admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:48.537361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b20afb-71d2-46d9-9b07-14a25b48375a admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:48.542074 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fd34c-e763-4c21-b2f3-4eb8e4ec3bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:48.542971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fd34c-e763-4c21-b2f3-4eb8e4ec3bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:48.543255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fd34c-e763-4c21-b2f3-4eb8e4ec3bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:48.543534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fd34c-e763-4c21-b2f3-4eb8e4ec3bc0 admin admin] PATH_INFO: `/v3/projects/b2ed52b7a4c744cea54733cb53360ffd/users/25b579b23bb34811ad8fc854c62acca9/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:48.559762 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fd34c-e763-4c21-b2f3-4eb8e4ec3bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ed52b7a4c744cea54733cb53360ffd, user_id=25b579b23bb34811ad8fc854c62acca9, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:48.563314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fd34c-e763-4c21-b2f3-4eb8e4ec3bc0 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:48.650097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1211/2399] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:21:48 2022] PUT /identity/v3/projects/b2ed52b7a4c744cea54733cb53360ffd/users/25b579b23bb34811ad8fc854c62acca9/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:21:48.660984 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a8376-4327-4c8b-8339-3f5423e587ec None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:48.661284 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a8376-4327-4c8b-8339-3f5423e587ec None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:48.661572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a8376-4327-4c8b-8339-3f5423e587ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:48.683616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fd34c-e763-4c21-b2f3-4eb8e4ec3bc0 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:48.685420 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-237fd34c-e763-4c21-b2f3-4eb8e4ec3bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:48.703199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b08a8376-4327-4c8b-8339-3f5423e587ec None None] MFA Rules not processed for user `25b579b23bb34811ad8fc854c62acca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:21:48.706231 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b08a8376-4327-4c8b-8339-3f5423e587ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:48.738185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:21:48.771735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:21:48.778782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fd34c-e763-4c21-b2f3-4eb8e4ec3bc0 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:48.787424 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1189/2400] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:21:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:21:48.791562 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a8376-4327-4c8b-8339-3f5423e587ec None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:48.792491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56469051-a255-420e-9cec-f79c1dd3db18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:48.793184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56469051-a255-420e-9cec-f79c1dd3db18 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:48.793459 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56469051-a255-420e-9cec-f79c1dd3db18 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:48.793790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56469051-a255-420e-9cec-f79c1dd3db18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:48.797120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-56469051-a255-420e-9cec-f79c1dd3db18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:48.812873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56469051-a255-420e-9cec-f79c1dd3db18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:48.815520 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56469051-a255-420e-9cec-f79c1dd3db18 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:48.828283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1212/2401] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:21:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:21:48.881383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a8376-4327-4c8b-8339-3f5423e587ec None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:48.886513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee601d5-1eb2-44cb-92b4-1880b338a3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:48.887448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee601d5-1eb2-44cb-92b4-1880b338a3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:48.887729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee601d5-1eb2-44cb-92b4-1880b338a3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:48.888011 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee601d5-1eb2-44cb-92b4-1880b338a3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:48.888710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee601d5-1eb2-44cb-92b4-1880b338a3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:48.896867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee601d5-1eb2-44cb-92b4-1880b338a3d7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:48.994250 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1190/2402] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:21:48 2022] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:21:48.999193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56469051-a255-420e-9cec-f79c1dd3db18 service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:49.014915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56469051-a255-420e-9cec-f79c1dd3db18 service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:49.087316 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d409b27-2388-45a7-822a-6f0390e16faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:49.088051 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d409b27-2388-45a7-822a-6f0390e16faa admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:49.088334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d409b27-2388-45a7-822a-6f0390e16faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:49.088637 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d409b27-2388-45a7-822a-6f0390e16faa admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:49.089465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d409b27-2388-45a7-822a-6f0390e16faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:49.091428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d409b27-2388-45a7-822a-6f0390e16faa admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:49.199527 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1213/2403] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:21:48 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:21:49.203900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee601d5-1eb2-44cb-92b4-1880b338a3d7 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:49.214362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee601d5-1eb2-44cb-92b4-1880b338a3d7 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:49.218930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394b184-4250-4083-9285-74e588fbabcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:49.219598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394b184-4250-4083-9285-74e588fbabcb admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:49.219879 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394b184-4250-4083-9285-74e588fbabcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:49.220710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394b184-4250-4083-9285-74e588fbabcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:49.221708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394b184-4250-4083-9285-74e588fbabcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:49.223416 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394b184-4250-4083-9285-74e588fbabcb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:49.234477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1191/2404] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:21:49.239372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d409b27-2388-45a7-822a-6f0390e16faa admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:49.249568 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d409b27-2388-45a7-822a-6f0390e16faa admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:49.255042 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37b6c4-1c31-4da6-b340-8d6ca5bcccd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:49.256053 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37b6c4-1c31-4da6-b340-8d6ca5bcccd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:49.256408 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37b6c4-1c31-4da6-b340-8d6ca5bcccd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:49.256785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37b6c4-1c31-4da6-b340-8d6ca5bcccd5 admin admin] PATH_INFO: `/v3/projects/0591918a45a6447ab2554804b34cdb60/users/b249323faef048a08ebfd829824ea1e8/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:49.272610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37b6c4-1c31-4da6-b340-8d6ca5bcccd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0591918a45a6447ab2554804b34cdb60, user_id=b249323faef048a08ebfd829824ea1e8, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:49.275432 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37b6c4-1c31-4da6-b340-8d6ca5bcccd5 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:49.336514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1214/2405] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:21:49 2022] PUT /identity/v3/projects/0591918a45a6447ab2554804b34cdb60/users/b249323faef048a08ebfd829824ea1e8/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:21:49.340678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394b184-4250-4083-9285-74e588fbabcb admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:49.351257 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394b184-4250-4083-9285-74e588fbabcb admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:49.428067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e44284-0c2d-437b-8f2e-68509996e5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:49.428862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e44284-0c2d-437b-8f2e-68509996e5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:49.429235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e44284-0c2d-437b-8f2e-68509996e5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:49.429519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e44284-0c2d-437b-8f2e-68509996e5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:49.430282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e44284-0c2d-437b-8f2e-68509996e5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:49.432038 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e44284-0c2d-437b-8f2e-68509996e5a2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:49.442624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1192/2406] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:21:49.446764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37b6c4-1c31-4da6-b340-8d6ca5bcccd5 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:49.457088 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37b6c4-1c31-4da6-b340-8d6ca5bcccd5 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:49.461940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a994c0b-7cc8-4a1d-aa5e-98bd98c2959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:49.462921 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a994c0b-7cc8-4a1d-aa5e-98bd98c2959c admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:49.463143 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a994c0b-7cc8-4a1d-aa5e-98bd98c2959c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:49.463416 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a994c0b-7cc8-4a1d-aa5e-98bd98c2959c admin admin] PATH_INFO: `/v3/projects/0591918a45a6447ab2554804b34cdb60/users/b249323faef048a08ebfd829824ea1e8/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:49.465431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a994c0b-7cc8-4a1d-aa5e-98bd98c2959c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0591918a45a6447ab2554804b34cdb60, user_id=b249323faef048a08ebfd829824ea1e8, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:49.468090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a994c0b-7cc8-4a1d-aa5e-98bd98c2959c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:49.482375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1215/2407] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:21:49 2022] PUT /identity/v3/projects/0591918a45a6447ab2554804b34cdb60/users/b249323faef048a08ebfd829824ea1e8/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:21:49.505143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669b797-9f45-4f05-8ca4-31a73b13d60a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:49.505444 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669b797-9f45-4f05-8ca4-31a73b13d60a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:49.505731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669b797-9f45-4f05-8ca4-31a73b13d60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:49.537989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-d669b797-9f45-4f05-8ca4-31a73b13d60a None None] MFA Rules not processed for user `b249323faef048a08ebfd829824ea1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:21:49.541536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d669b797-9f45-4f05-8ca4-31a73b13d60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:49.573885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:21:49.628145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1193/2408] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:21:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:21:49.639589 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a994c0b-7cc8-4a1d-aa5e-98bd98c2959c admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:49.641357 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0a994c0b-7cc8-4a1d-aa5e-98bd98c2959c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:49.703474 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a994c0b-7cc8-4a1d-aa5e-98bd98c2959c admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:49.708682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb753d76-0256-4067-b134-32fc07e83aaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:49.709671 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb753d76-0256-4067-b134-32fc07e83aaa service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:49.710150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb753d76-0256-4067-b134-32fc07e83aaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:49.710646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb753d76-0256-4067-b134-32fc07e83aaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:49.721929 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb753d76-0256-4067-b134-32fc07e83aaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:49.723497 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb753d76-0256-4067-b134-32fc07e83aaa service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:49.734518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1216/2409] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:21:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:21:50.554135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669b797-9f45-4f05-8ca4-31a73b13d60a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:50.556119 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d669b797-9f45-4f05-8ca4-31a73b13d60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:50.670615 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669b797-9f45-4f05-8ca4-31a73b13d60a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:50.681939 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63864148-b79a-467c-9180-7f96855db75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:50.684052 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63864148-b79a-467c-9180-7f96855db75d service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:50.684433 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63864148-b79a-467c-9180-7f96855db75d service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:50.686176 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63864148-b79a-467c-9180-7f96855db75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:50.690380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-63864148-b79a-467c-9180-7f96855db75d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:50.708040 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63864148-b79a-467c-9180-7f96855db75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:50.710436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63864148-b79a-467c-9180-7f96855db75d service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:50.724065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1194/2410] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:21:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:21:50.747884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb753d76-0256-4067-b134-32fc07e83aaa service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:50.810123 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:21:50.835498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb753d76-0256-4067-b134-32fc07e83aaa service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:50.840508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc19bd-5ffd-4a3c-a096-4c483474815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:50.841812 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc19bd-5ffd-4a3c-a096-4c483474815b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:50.842521 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc19bd-5ffd-4a3c-a096-4c483474815b admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:50.842521 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc19bd-5ffd-4a3c-a096-4c483474815b admin admin] PATH_INFO: `/v3/users/25b579b23bb34811ad8fc854c62acca9` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:50.843601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc19bd-5ffd-4a3c-a096-4c483474815b admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b579b23bb34811ad8fc854c62acca9)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:50.846987 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc19bd-5ffd-4a3c-a096-4c483474815b admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:51.054512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-41bc19bd-5ffd-4a3c-a096-4c483474815b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b579b23bb34811ad8fc854c62acca9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:51.149645 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-41bc19bd-5ffd-4a3c-a096-4c483474815b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b579b23bb34811ad8fc854c62acca9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:51.158417 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-41bc19bd-5ffd-4a3c-a096-4c483474815b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b579b23bb34811ad8fc854c62acca9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:51.160000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-41bc19bd-5ffd-4a3c-a096-4c483474815b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b579b23bb34811ad8fc854c62acca9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:51.173064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-41bc19bd-5ffd-4a3c-a096-4c483474815b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b579b23bb34811ad8fc854c62acca9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:51.184694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1217/2411] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:21:50 2022] DELETE /identity/v3/users/25b579b23bb34811ad8fc854c62acca9 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:21:51.190184 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b93920-da82-447a-a335-6b1f3a04e7bc None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:51.190729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b93920-da82-447a-a335-6b1f3a04e7bc None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:51.191194 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b93920-da82-447a-a335-6b1f3a04e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:51.212964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-11b93920-da82-447a-a335-6b1f3a04e7bc None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:21:51.247979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-11b93920-da82-447a-a335-6b1f3a04e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:51.295011 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1195/2412] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:21:51.306165 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc19bd-5ffd-4a3c-a096-4c483474815b admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:51.306584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-41bc19bd-5ffd-4a3c-a096-4c483474815b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:51.385640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc19bd-5ffd-4a3c-a096-4c483474815b admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:51.392256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a53f7b-ed9b-48ed-a3d3-724c2799fa1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:51.392930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a53f7b-ed9b-48ed-a3d3-724c2799fa1d service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:51.393245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a53f7b-ed9b-48ed-a3d3-724c2799fa1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:51.393519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a53f7b-ed9b-48ed-a3d3-724c2799fa1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:51.406507 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a53f7b-ed9b-48ed-a3d3-724c2799fa1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:51.409287 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a53f7b-ed9b-48ed-a3d3-724c2799fa1d service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:51.419997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1218/2413] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:21:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:21:51.519889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c2763-46ed-457f-b1a9-7847fb5bfb58 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:51.520185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c2763-46ed-457f-b1a9-7847fb5bfb58 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:51.520461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c2763-46ed-457f-b1a9-7847fb5bfb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:51.553611 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0a6c2763-46ed-457f-b1a9-7847fb5bfb58 None None] MFA Rules not processed for user `62fcfe1e52ca41b78ea48626dafbd1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:21:51.554938 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0a6c2763-46ed-457f-b1a9-7847fb5bfb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:51.632595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1196/2414] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:21:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:21:52.025024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36054bae-b2e1-4527-8ed6-29f66d4e7cf0 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:52.025535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36054bae-b2e1-4527-8ed6-29f66d4e7cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:52.025535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36054bae-b2e1-4527-8ed6-29f66d4e7cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:52.070524 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-36054bae-b2e1-4527-8ed6-29f66d4e7cf0 None None] MFA Rules not processed for user `7e29d3b37ec342fe91765a8b13354bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:21:52.073179 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-36054bae-b2e1-4527-8ed6-29f66d4e7cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:52.118961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c2763-46ed-457f-b1a9-7847fb5bfb58 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:52.122219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0a6c2763-46ed-457f-b1a9-7847fb5bfb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:52.132801 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=100 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:21:52.137101 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c2763-46ed-457f-b1a9-7847fb5bfb58 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:52.141051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02277bc-b84c-472a-97f8-f285e24312a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:52.141988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02277bc-b84c-472a-97f8-f285e24312a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:52.142676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02277bc-b84c-472a-97f8-f285e24312a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:52.142959 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02277bc-b84c-472a-97f8-f285e24312a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:52.144928 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c02277bc-b84c-472a-97f8-f285e24312a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:52.155536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1219/2415] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:21:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:21:52.156017 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02277bc-b84c-472a-97f8-f285e24312a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:52.157645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02277bc-b84c-472a-97f8-f285e24312a5 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:52.168698 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1197/2416] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:21:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:21:52.205066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c54ce-3fd8-41b9-bcdf-54eda5c01dd4 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:52.206378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c54ce-3fd8-41b9-bcdf-54eda5c01dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:52.211719 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c54ce-3fd8-41b9-bcdf-54eda5c01dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:52.215266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:21:52.244928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-546c54ce-3fd8-41b9-bcdf-54eda5c01dd4 None None] MFA Rules not processed for user `eb6555ff5f3f4823aee38990265d3a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:21:52.246491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-546c54ce-3fd8-41b9-bcdf-54eda5c01dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:52.315948 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1220/2417] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:21:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:21:52.334988 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02277bc-b84c-472a-97f8-f285e24312a5 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:52.336419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c02277bc-b84c-472a-97f8-f285e24312a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:52.360476 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02277bc-b84c-472a-97f8-f285e24312a5 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:52.366382 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8424ab-1bcf-489d-993a-cc2237464bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:52.367833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8424ab-1bcf-489d-993a-cc2237464bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:52.368122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8424ab-1bcf-489d-993a-cc2237464bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:52.368577 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8424ab-1bcf-489d-993a-cc2237464bbf admin admin] PATH_INFO: `/v3/projects/b2ed52b7a4c744cea54733cb53360ffd` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:52.370090 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8424ab-1bcf-489d-993a-cc2237464bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ed52b7a4c744cea54733cb53360ffd)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:52.372245 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8424ab-1bcf-489d-993a-cc2237464bbf admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:52.511140 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bd8424ab-1bcf-489d-993a-cc2237464bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ed52b7a4c744cea54733cb53360ffd', 'request_id': 'req-bd8424ab-1bcf-489d-993a-cc2237464bbf'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:52.522652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bd8424ab-1bcf-489d-993a-cc2237464bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ed52b7a4c744cea54733cb53360ffd', 'request_id': 'req-bd8424ab-1bcf-489d-993a-cc2237464bbf'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:52.586922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bd8424ab-1bcf-489d-993a-cc2237464bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ed52b7a4c744cea54733cb53360ffd', 'request_id': 'req-bd8424ab-1bcf-489d-993a-cc2237464bbf'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:52.617649 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bd8424ab-1bcf-489d-993a-cc2237464bbf admin admin] The token cache is being invalidate because project b2ed52b7a4c744cea54733cb53360ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:21:52.617978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bd8424ab-1bcf-489d-993a-cc2237464bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:52.627575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bd8424ab-1bcf-489d-993a-cc2237464bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:52.636170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1198/2418] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:21:52 2022] DELETE /identity/v3/projects/b2ed52b7a4c744cea54733cb53360ffd => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:21:52.640499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c54ce-3fd8-41b9-bcdf-54eda5c01dd4 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:52.655019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8424ab-1bcf-489d-993a-cc2237464bbf admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:52.658016 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-bd8424ab-1bcf-489d-993a-cc2237464bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:52.668302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c54ce-3fd8-41b9-bcdf-54eda5c01dd4 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:52.752136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8424ab-1bcf-489d-993a-cc2237464bbf admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:52.756463 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d37e73-1d13-4d4c-8b18-e5ba38f7fef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:52.759151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ea439-315f-4405-8e1c-960acae3cad7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:52.759829 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ea439-315f-4405-8e1c-960acae3cad7 service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:52.760133 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ea439-315f-4405-8e1c-960acae3cad7 service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:52.760295 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d37e73-1d13-4d4c-8b18-e5ba38f7fef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:52.760420 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ea439-315f-4405-8e1c-960acae3cad7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:52.760535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d37e73-1d13-4d4c-8b18-e5ba38f7fef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:52.760709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d37e73-1d13-4d4c-8b18-e5ba38f7fef7 admin admin] PATH_INFO: `/v3/users/b249323faef048a08ebfd829824ea1e8` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:52.761994 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d37e73-1d13-4d4c-8b18-e5ba38f7fef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b249323faef048a08ebfd829824ea1e8)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:52.762330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9a9ea439-315f-4405-8e1c-960acae3cad7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:52.763991 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d37e73-1d13-4d4c-8b18-e5ba38f7fef7 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:52.777855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ea439-315f-4405-8e1c-960acae3cad7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:52.779547 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ea439-315f-4405-8e1c-960acae3cad7 service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:52.791873 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1199/2419] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:21:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:21:52.957753 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-12d37e73-1d13-4d4c-8b18-e5ba38f7fef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b249323faef048a08ebfd829824ea1e8'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:53.032503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-12d37e73-1d13-4d4c-8b18-e5ba38f7fef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b249323faef048a08ebfd829824ea1e8'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:53.047852 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-12d37e73-1d13-4d4c-8b18-e5ba38f7fef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b249323faef048a08ebfd829824ea1e8'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:53.049149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-12d37e73-1d13-4d4c-8b18-e5ba38f7fef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b249323faef048a08ebfd829824ea1e8'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:53.063167 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-12d37e73-1d13-4d4c-8b18-e5ba38f7fef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b249323faef048a08ebfd829824ea1e8'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:53.070121 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1221/2420] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:21:52 2022] DELETE /identity/v3/users/b249323faef048a08ebfd829824ea1e8 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:21:53.537448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ea439-315f-4405-8e1c-960acae3cad7 service placement] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:53.538360 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9a9ea439-315f-4405-8e1c-960acae3cad7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:53.558965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ea439-315f-4405-8e1c-960acae3cad7 service placement] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:53.657023 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d3cfa-2f1b-48d6-8d3d-0996202801f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:53.658449 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d3cfa-2f1b-48d6-8d3d-0996202801f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:53.658970 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d3cfa-2f1b-48d6-8d3d-0996202801f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:53.659404 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d3cfa-2f1b-48d6-8d3d-0996202801f2 admin admin] PATH_INFO: `/v3/projects/0591918a45a6447ab2554804b34cdb60` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:53.661075 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d3cfa-2f1b-48d6-8d3d-0996202801f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0591918a45a6447ab2554804b34cdb60)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:53.663185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d3cfa-2f1b-48d6-8d3d-0996202801f2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:53.671711 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:21:53.794743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ee0d3cfa-2f1b-48d6-8d3d-0996202801f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0591918a45a6447ab2554804b34cdb60', 'request_id': 'req-ee0d3cfa-2f1b-48d6-8d3d-0996202801f2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:53.802225 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ee0d3cfa-2f1b-48d6-8d3d-0996202801f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0591918a45a6447ab2554804b34cdb60', 'request_id': 'req-ee0d3cfa-2f1b-48d6-8d3d-0996202801f2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:53.873426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ee0d3cfa-2f1b-48d6-8d3d-0996202801f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0591918a45a6447ab2554804b34cdb60', 'request_id': 'req-ee0d3cfa-2f1b-48d6-8d3d-0996202801f2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:53.887885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ee0d3cfa-2f1b-48d6-8d3d-0996202801f2 admin admin] The token cache is being invalidate because project 0591918a45a6447ab2554804b34cdb60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:21:53.888096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ee0d3cfa-2f1b-48d6-8d3d-0996202801f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:53.888809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-ee0d3cfa-2f1b-48d6-8d3d-0996202801f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:53.894557 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1200/2421] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:21:53 2022] DELETE /identity/v3/projects/0591918a45a6447ab2554804b34cdb60 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:21:53.897392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d328a2-4a80-4aa2-aa9c-8db5fc6ac7f4 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:53.897885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d328a2-4a80-4aa2-aa9c-8db5fc6ac7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:53.898169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d328a2-4a80-4aa2-aa9c-8db5fc6ac7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:53.917070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-27d328a2-4a80-4aa2-aa9c-8db5fc6ac7f4 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:21:53.918283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-27d328a2-4a80-4aa2-aa9c-8db5fc6ac7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:53.941791 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:21:54.010333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1222/2422] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:21:54.019535 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5694924-159b-4aca-878a-475f1d8734b4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:54.019963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5694924-159b-4aca-878a-475f1d8734b4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:54.020263 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5694924-159b-4aca-878a-475f1d8734b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:54.042991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c5694924-159b-4aca-878a-475f1d8734b4 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:21:54.044386 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c5694924-159b-4aca-878a-475f1d8734b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:54.053887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1201/2423] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:21:54.057791 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d328a2-4a80-4aa2-aa9c-8db5fc6ac7f4 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:54.069459 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d328a2-4a80-4aa2-aa9c-8db5fc6ac7f4 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:54.074457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf48685-22da-484f-bbc0-5bc5e6a8be73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:54.078870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf48685-22da-484f-bbc0-5bc5e6a8be73 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:54.078870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf48685-22da-484f-bbc0-5bc5e6a8be73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:54.078870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf48685-22da-484f-bbc0-5bc5e6a8be73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:54.078870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf48685-22da-484f-bbc0-5bc5e6a8be73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:21:54.078870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf48685-22da-484f-bbc0-5bc5e6a8be73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:54.078870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf48685-22da-484f-bbc0-5bc5e6a8be73 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:54.092667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1223/2424] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 18:21:54.097486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5694924-159b-4aca-878a-475f1d8734b4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:54.107684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5694924-159b-4aca-878a-475f1d8734b4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:54.113894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45637814-5a89-4a63-8bfd-048017b24441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:54.114658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45637814-5a89-4a63-8bfd-048017b24441 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:54.114943 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45637814-5a89-4a63-8bfd-048017b24441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:54.115330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45637814-5a89-4a63-8bfd-048017b24441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:54.116125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45637814-5a89-4a63-8bfd-048017b24441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:54.118092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45637814-5a89-4a63-8bfd-048017b24441 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:54.246739 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf48685-22da-484f-bbc0-5bc5e6a8be73 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:54.260707 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1202/2425] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:21:54 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:21:54.268199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf48685-22da-484f-bbc0-5bc5e6a8be73 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:54.369171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314d380-7259-4e54-90e6-762bc4f8496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:54.369941 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314d380-7259-4e54-90e6-762bc4f8496f admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:54.370300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314d380-7259-4e54-90e6-762bc4f8496f admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:54.370652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314d380-7259-4e54-90e6-762bc4f8496f admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:54.371414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314d380-7259-4e54-90e6-762bc4f8496f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:54.373432 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314d380-7259-4e54-90e6-762bc4f8496f admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:54.468596 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1224/2426] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:21:54 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:21:54.472014 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45637814-5a89-4a63-8bfd-048017b24441 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:54.485982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45637814-5a89-4a63-8bfd-048017b24441 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:54.492147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b7146-8477-41ed-be12-7e60756a68a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:54.493129 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7146-8477-41ed-be12-7e60756a68a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:54.493628 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7146-8477-41ed-be12-7e60756a68a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:54.493972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7146-8477-41ed-be12-7e60756a68a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:54.494911 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b7146-8477-41ed-be12-7e60756a68a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:54.496545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b7146-8477-41ed-be12-7e60756a68a9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:54.508303 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1203/2427] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 18:21:54.512435 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314d380-7259-4e54-90e6-762bc4f8496f admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:54.524444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314d380-7259-4e54-90e6-762bc4f8496f admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:54.529931 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684f1c9-411a-442f-a3b5-9521f565e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:54.530690 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684f1c9-411a-442f-a3b5-9521f565e3db admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:54.531063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684f1c9-411a-442f-a3b5-9521f565e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:54.531394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684f1c9-411a-442f-a3b5-9521f565e3db admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:54.532314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684f1c9-411a-442f-a3b5-9521f565e3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:54.534770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684f1c9-411a-442f-a3b5-9521f565e3db admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:54.555250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1225/2428] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:21:54.556523 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b7146-8477-41ed-be12-7e60756a68a9 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:54.576324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b7146-8477-41ed-be12-7e60756a68a9 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:54.582113 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c8132-433f-4465-b299-9384f6d5771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:54.583072 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c8132-433f-4465-b299-9384f6d5771c admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:54.583363 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c8132-433f-4465-b299-9384f6d5771c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:54.583667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c8132-433f-4465-b299-9384f6d5771c admin admin] PATH_INFO: `/v3/projects/0d8859f6d1ad42e9a2bf5dd1f3ff2554/users/c32491d68e574eeeb5cd9bcf2b7231b9/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:54.599762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c8132-433f-4465-b299-9384f6d5771c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8859f6d1ad42e9a2bf5dd1f3ff2554, user_id=c32491d68e574eeeb5cd9bcf2b7231b9, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:54.609553 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c8132-433f-4465-b299-9384f6d5771c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:54.684470 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684f1c9-411a-442f-a3b5-9521f565e3db admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:54.686516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-5684f1c9-411a-442f-a3b5-9521f565e3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:54.691417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1204/2429] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:21:54 2022] PUT /identity/v3/projects/0d8859f6d1ad42e9a2bf5dd1f3ff2554/users/c32491d68e574eeeb5cd9bcf2b7231b9/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:21:54.702912 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e9634-14d8-48b0-b52b-e7865c391e2f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:54.703411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e9634-14d8-48b0-b52b-e7865c391e2f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:54.703693 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e9634-14d8-48b0-b52b-e7865c391e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:54.731542 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6a5e9634-14d8-48b0-b52b-e7865c391e2f None None] MFA Rules not processed for user `c32491d68e574eeeb5cd9bcf2b7231b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:21:54.732756 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6a5e9634-14d8-48b0-b52b-e7865c391e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:54.749933 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684f1c9-411a-442f-a3b5-9521f565e3db admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:54.800788 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:21:54.820113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53a0d7-0c30-4198-8e4c-9a99811d6f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:54.821159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53a0d7-0c30-4198-8e4c-9a99811d6f28 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:54.821702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53a0d7-0c30-4198-8e4c-9a99811d6f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:54.821702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53a0d7-0c30-4198-8e4c-9a99811d6f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:54.823541 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-bb53a0d7-0c30-4198-8e4c-9a99811d6f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:54.825062 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1205/2430] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:21:54.829330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e9634-14d8-48b0-b52b-e7865c391e2f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:54.851843 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:21:54.890312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53a0d7-0c30-4198-8e4c-9a99811d6f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:54.891756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53a0d7-0c30-4198-8e4c-9a99811d6f28 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:54.903237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1226/2431] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:21:54.909465 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e9634-14d8-48b0-b52b-e7865c391e2f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:54.916491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56da14-b23c-4a22-a1f4-2a8a2576ad96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:54.917196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56da14-b23c-4a22-a1f4-2a8a2576ad96 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:54.917928 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56da14-b23c-4a22-a1f4-2a8a2576ad96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:54.917928 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56da14-b23c-4a22-a1f4-2a8a2576ad96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:54.918448 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56da14-b23c-4a22-a1f4-2a8a2576ad96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:54.920466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56da14-b23c-4a22-a1f4-2a8a2576ad96 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:55.072663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1206/2432] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:21:54 2022] POST /identity/v3/projects => generated 375 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:21:55.076623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53a0d7-0c30-4198-8e4c-9a99811d6f28 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:55.087832 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53a0d7-0c30-4198-8e4c-9a99811d6f28 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:55.151293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1b371-757e-47a3-baf8-539021eaa6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:55.151975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1b371-757e-47a3-baf8-539021eaa6bc admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:55.152260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1b371-757e-47a3-baf8-539021eaa6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:55.152540 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1b371-757e-47a3-baf8-539021eaa6bc admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:55.153291 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1b371-757e-47a3-baf8-539021eaa6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:55.155237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1b371-757e-47a3-baf8-539021eaa6bc admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:55.291664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1227/2433] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:21:55 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:21:55.295712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56da14-b23c-4a22-a1f4-2a8a2576ad96 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:55.308140 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56da14-b23c-4a22-a1f4-2a8a2576ad96 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:55.318743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741873f-c711-4d69-bac9-1146adca8813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:55.318743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741873f-c711-4d69-bac9-1146adca8813 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:55.318743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741873f-c711-4d69-bac9-1146adca8813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:55.318743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741873f-c711-4d69-bac9-1146adca8813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:55.319144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741873f-c711-4d69-bac9-1146adca8813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:55.319144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741873f-c711-4d69-bac9-1146adca8813 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:55.330660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1207/2434] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:21:55.333875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1b371-757e-47a3-baf8-539021eaa6bc admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:55.351799 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1b371-757e-47a3-baf8-539021eaa6bc admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:55.365541 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852437b3-136a-4e96-9f52-719c75372c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:55.367053 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852437b3-136a-4e96-9f52-719c75372c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:55.367702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852437b3-136a-4e96-9f52-719c75372c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:55.368236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852437b3-136a-4e96-9f52-719c75372c8e admin admin] PATH_INFO: `/v3/projects/d96ada952e0d4e3ca254fa1a1092309d/users/af01833600fa4a83826b4a6d53ecd626/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:55.394088 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852437b3-136a-4e96-9f52-719c75372c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96ada952e0d4e3ca254fa1a1092309d, user_id=af01833600fa4a83826b4a6d53ecd626, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:55.397875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852437b3-136a-4e96-9f52-719c75372c8e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:55.483270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1228/2435] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:21:55 2022] PUT /identity/v3/projects/d96ada952e0d4e3ca254fa1a1092309d/users/af01833600fa4a83826b4a6d53ecd626/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:21:55.489304 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741873f-c711-4d69-bac9-1146adca8813 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:55.499436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741873f-c711-4d69-bac9-1146adca8813 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:55.613486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4bcad-5f15-4a4f-a2b8-3a220263bea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:55.614720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4bcad-5f15-4a4f-a2b8-3a220263bea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:55.615050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4bcad-5f15-4a4f-a2b8-3a220263bea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:55.615716 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4bcad-5f15-4a4f-a2b8-3a220263bea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:55.616825 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4bcad-5f15-4a4f-a2b8-3a220263bea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:55.620635 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4bcad-5f15-4a4f-a2b8-3a220263bea0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:55.637668 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1208/2436] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:21:55.641978 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852437b3-136a-4e96-9f52-719c75372c8e admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:55.653927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852437b3-136a-4e96-9f52-719c75372c8e admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:55.660301 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfa3b7-a531-4057-942b-2e86fed96030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:55.661700 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfa3b7-a531-4057-942b-2e86fed96030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:55.662151 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfa3b7-a531-4057-942b-2e86fed96030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:55.662589 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfa3b7-a531-4057-942b-2e86fed96030 admin admin] PATH_INFO: `/v3/projects/d96ada952e0d4e3ca254fa1a1092309d/users/af01833600fa4a83826b4a6d53ecd626/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:55.664972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfa3b7-a531-4057-942b-2e86fed96030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96ada952e0d4e3ca254fa1a1092309d, user_id=af01833600fa4a83826b4a6d53ecd626, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:55.669288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfa3b7-a531-4057-942b-2e86fed96030 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:55.685002 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1229/2437] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:21:55 2022] PUT /identity/v3/projects/d96ada952e0d4e3ca254fa1a1092309d/users/af01833600fa4a83826b4a6d53ecd626/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:21:55.697740 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f77e6-368a-4eff-a394-01f0926b14a8 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:55.698325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f77e6-368a-4eff-a394-01f0926b14a8 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:55.698325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f77e6-368a-4eff-a394-01f0926b14a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:55.748079 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-cb7f77e6-368a-4eff-a394-01f0926b14a8 None None] MFA Rules not processed for user `af01833600fa4a83826b4a6d53ecd626`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:21:55.749559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cb7f77e6-368a-4eff-a394-01f0926b14a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:55.846280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1209/2438] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:21:55.854180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfa3b7-a531-4057-942b-2e86fed96030 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:55.856014 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-25bfa3b7-a531-4057-942b-2e86fed96030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:55.918584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:21:55.924460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfa3b7-a531-4057-942b-2e86fed96030 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:55.928629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73392a9e-f509-43ca-9de2-aec988b97f5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:55.929322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73392a9e-f509-43ca-9de2-aec988b97f5c service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:55.929612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73392a9e-f509-43ca-9de2-aec988b97f5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:55.929893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73392a9e-f509-43ca-9de2-aec988b97f5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:55.988558 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73392a9e-f509-43ca-9de2-aec988b97f5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:55.990152 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73392a9e-f509-43ca-9de2-aec988b97f5c service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:55.999378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1230/2439] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:21:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:21:59.309457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f77e6-368a-4eff-a394-01f0926b14a8 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:59.339112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:21:59.403678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f77e6-368a-4eff-a394-01f0926b14a8 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:59.408681 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300480b2-0b82-46cb-87b4-adfd3f86e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:59.409757 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300480b2-0b82-46cb-87b4-adfd3f86e2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:59.410041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300480b2-0b82-46cb-87b4-adfd3f86e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:59.410319 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300480b2-0b82-46cb-87b4-adfd3f86e2c1 admin admin] PATH_INFO: `/v3/users/c32491d68e574eeeb5cd9bcf2b7231b9` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:59.411593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300480b2-0b82-46cb-87b4-adfd3f86e2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c32491d68e574eeeb5cd9bcf2b7231b9)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:59.413636 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300480b2-0b82-46cb-87b4-adfd3f86e2c1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:59.574494 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-300480b2-0b82-46cb-87b4-adfd3f86e2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c32491d68e574eeeb5cd9bcf2b7231b9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:59.649641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-300480b2-0b82-46cb-87b4-adfd3f86e2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c32491d68e574eeeb5cd9bcf2b7231b9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:59.657289 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-300480b2-0b82-46cb-87b4-adfd3f86e2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c32491d68e574eeeb5cd9bcf2b7231b9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:59.658198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-300480b2-0b82-46cb-87b4-adfd3f86e2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c32491d68e574eeeb5cd9bcf2b7231b9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:59.672634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-300480b2-0b82-46cb-87b4-adfd3f86e2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c32491d68e574eeeb5cd9bcf2b7231b9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:21:59.679723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1210/2440] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:21:59 2022] DELETE /identity/v3/users/c32491d68e574eeeb5cd9bcf2b7231b9 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:21:59.684308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d994a-38f5-42d8-a61e-2b9760140a3b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:59.684820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d994a-38f5-42d8-a61e-2b9760140a3b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:59.684964 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d994a-38f5-42d8-a61e-2b9760140a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:59.702520 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-235d994a-38f5-42d8-a61e-2b9760140a3b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:21:59.703721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-235d994a-38f5-42d8-a61e-2b9760140a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:59.764503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1231/2441] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:21:59.776166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300480b2-0b82-46cb-87b4-adfd3f86e2c1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:21:59.777650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-300480b2-0b82-46cb-87b4-adfd3f86e2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:21:59.851986 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300480b2-0b82-46cb-87b4-adfd3f86e2c1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:21:59.855960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd7156-b3ef-449d-a617-ee0143df5da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:21:59.856754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd7156-b3ef-449d-a617-ee0143df5da1 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:21:59.857100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd7156-b3ef-449d-a617-ee0143df5da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:21:59.857418 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd7156-b3ef-449d-a617-ee0143df5da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:21:59.867718 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd7156-b3ef-449d-a617-ee0143df5da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:21:59.869218 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd7156-b3ef-449d-a617-ee0143df5da1 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:21:59.879459 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1211/2442] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:22:00.388830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d994a-38f5-42d8-a61e-2b9760140a3b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:00.390401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-235d994a-38f5-42d8-a61e-2b9760140a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:00.405392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d994a-38f5-42d8-a61e-2b9760140a3b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:00.425100 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62627d-2147-4b9d-af93-cf615fbd45ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:00.426908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62627d-2147-4b9d-af93-cf615fbd45ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:00.427200 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62627d-2147-4b9d-af93-cf615fbd45ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:00.427705 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62627d-2147-4b9d-af93-cf615fbd45ce admin admin] PATH_INFO: `/v3/projects/0d8859f6d1ad42e9a2bf5dd1f3ff2554` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:00.429127 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62627d-2147-4b9d-af93-cf615fbd45ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8859f6d1ad42e9a2bf5dd1f3ff2554)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:00.431880 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62627d-2147-4b9d-af93-cf615fbd45ce admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:00.561497 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dd62627d-2147-4b9d-af93-cf615fbd45ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8859f6d1ad42e9a2bf5dd1f3ff2554', 'request_id': 'req-dd62627d-2147-4b9d-af93-cf615fbd45ce'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:00.568744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dd62627d-2147-4b9d-af93-cf615fbd45ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8859f6d1ad42e9a2bf5dd1f3ff2554', 'request_id': 'req-dd62627d-2147-4b9d-af93-cf615fbd45ce'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:00.672439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dd62627d-2147-4b9d-af93-cf615fbd45ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8859f6d1ad42e9a2bf5dd1f3ff2554', 'request_id': 'req-dd62627d-2147-4b9d-af93-cf615fbd45ce'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:00.686516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dd62627d-2147-4b9d-af93-cf615fbd45ce admin admin] The token cache is being invalidate because project 0d8859f6d1ad42e9a2bf5dd1f3ff2554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:00.687530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dd62627d-2147-4b9d-af93-cf615fbd45ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:00.688334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dd62627d-2147-4b9d-af93-cf615fbd45ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:00.691089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1232/2443] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:00 2022] DELETE /identity/v3/projects/0d8859f6d1ad42e9a2bf5dd1f3ff2554 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:00.695097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd7156-b3ef-449d-a617-ee0143df5da1 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:00.710401 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd7156-b3ef-449d-a617-ee0143df5da1 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:00.773282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:00.815129 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41843b8d-dc28-4c37-9811-bd5910666a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:00.818003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41843b8d-dc28-4c37-9811-bd5910666a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:00.818386 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41843b8d-dc28-4c37-9811-bd5910666a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:00.818901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41843b8d-dc28-4c37-9811-bd5910666a1b admin admin] PATH_INFO: `/v3/users/af01833600fa4a83826b4a6d53ecd626` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:00.824962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41843b8d-dc28-4c37-9811-bd5910666a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=af01833600fa4a83826b4a6d53ecd626)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:00.824962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41843b8d-dc28-4c37-9811-bd5910666a1b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:01.040854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-41843b8d-dc28-4c37-9811-bd5910666a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af01833600fa4a83826b4a6d53ecd626'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:01.124222 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-41843b8d-dc28-4c37-9811-bd5910666a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af01833600fa4a83826b4a6d53ecd626'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:01.140631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-41843b8d-dc28-4c37-9811-bd5910666a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af01833600fa4a83826b4a6d53ecd626'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:01.141420 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-41843b8d-dc28-4c37-9811-bd5910666a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af01833600fa4a83826b4a6d53ecd626'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:01.159909 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-41843b8d-dc28-4c37-9811-bd5910666a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af01833600fa4a83826b4a6d53ecd626'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:01.166202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1212/2444] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:00 2022] DELETE /identity/v3/users/af01833600fa4a83826b4a6d53ecd626 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:01.885918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62627d-2147-4b9d-af93-cf615fbd45ce admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:01.887530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-dd62627d-2147-4b9d-af93-cf615fbd45ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:01.907884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62627d-2147-4b9d-af93-cf615fbd45ce admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:01.948777 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:01.991165 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b7f5f-96c0-450a-9360-38f8301f6120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:01.992020 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7f5f-96c0-450a-9360-38f8301f6120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:01.992304 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7f5f-96c0-450a-9360-38f8301f6120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:01.992576 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7f5f-96c0-450a-9360-38f8301f6120 admin admin] PATH_INFO: `/v3/projects/d96ada952e0d4e3ca254fa1a1092309d` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:01.993965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b7f5f-96c0-450a-9360-38f8301f6120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96ada952e0d4e3ca254fa1a1092309d)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:01.995904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b7f5f-96c0-450a-9360-38f8301f6120 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:02.086617 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-df9b7f5f-96c0-450a-9360-38f8301f6120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96ada952e0d4e3ca254fa1a1092309d', 'request_id': 'req-df9b7f5f-96c0-450a-9360-38f8301f6120'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:02.093400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-df9b7f5f-96c0-450a-9360-38f8301f6120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96ada952e0d4e3ca254fa1a1092309d', 'request_id': 'req-df9b7f5f-96c0-450a-9360-38f8301f6120'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:02.181392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-df9b7f5f-96c0-450a-9360-38f8301f6120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96ada952e0d4e3ca254fa1a1092309d', 'request_id': 'req-df9b7f5f-96c0-450a-9360-38f8301f6120'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:02.199367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-df9b7f5f-96c0-450a-9360-38f8301f6120 admin admin] The token cache is being invalidate because project d96ada952e0d4e3ca254fa1a1092309d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:02.199646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-df9b7f5f-96c0-450a-9360-38f8301f6120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:02.200445 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-df9b7f5f-96c0-450a-9360-38f8301f6120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:02.202765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1233/2445] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:01 2022] DELETE /identity/v3/projects/d96ada952e0d4e3ca254fa1a1092309d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:02.214767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92526e-84a0-4a0c-84d7-a9bb44891f49 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:02.214767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92526e-84a0-4a0c-84d7-a9bb44891f49 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:02.214767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92526e-84a0-4a0c-84d7-a9bb44891f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:02.237376 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1d92526e-84a0-4a0c-84d7-a9bb44891f49 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:02.238623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1d92526e-84a0-4a0c-84d7-a9bb44891f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:02.307206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1213/2446] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:02.316037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722208b-ff8c-4313-8c74-d0f154dd0273 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:02.316325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722208b-ff8c-4313-8c74-d0f154dd0273 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:02.316999 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722208b-ff8c-4313-8c74-d0f154dd0273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:02.335894 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-1722208b-ff8c-4313-8c74-d0f154dd0273 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:02.337153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-1722208b-ff8c-4313-8c74-d0f154dd0273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:02.345299 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1234/2447] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:02.349720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92526e-84a0-4a0c-84d7-a9bb44891f49 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:02.359445 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92526e-84a0-4a0c-84d7-a9bb44891f49 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:02.365261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fef3d3-c250-4cb3-83bb-f4facf6b8add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:02.365958 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fef3d3-c250-4cb3-83bb-f4facf6b8add admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:02.366252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fef3d3-c250-4cb3-83bb-f4facf6b8add admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:02.366536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fef3d3-c250-4cb3-83bb-f4facf6b8add admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:02.367285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fef3d3-c250-4cb3-83bb-f4facf6b8add admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:22:02.367583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fef3d3-c250-4cb3-83bb-f4facf6b8add admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:02.369364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fef3d3-c250-4cb3-83bb-f4facf6b8add admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:02.382507 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1214/2448] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:22:02.387093 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722208b-ff8c-4313-8c74-d0f154dd0273 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:02.397158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722208b-ff8c-4313-8c74-d0f154dd0273 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:02.401844 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef70b60-38f6-4583-863b-664be8112172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:02.402531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef70b60-38f6-4583-863b-664be8112172 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:02.402813 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef70b60-38f6-4583-863b-664be8112172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:02.403085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef70b60-38f6-4583-863b-664be8112172 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:02.403770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef70b60-38f6-4583-863b-664be8112172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:02.405713 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef70b60-38f6-4583-863b-664be8112172 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:02.421451 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fef3d3-c250-4cb3-83bb-f4facf6b8add admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:02.424899 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-01fef3d3-c250-4cb3-83bb-f4facf6b8add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:02.491199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:02.510657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1235/2449] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:22:02 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:02.513790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef70b60-38f6-4583-863b-664be8112172 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:02.524874 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fef3d3-c250-4cb3-83bb-f4facf6b8add admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:02.594016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef70b60-38f6-4583-863b-664be8112172 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:02.600220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0016c-0fca-4c0b-9158-f5d490385159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:02.601047 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0016c-0fca-4c0b-9158-f5d490385159 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:02.601342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0016c-0fca-4c0b-9158-f5d490385159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:02.601622 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0016c-0fca-4c0b-9158-f5d490385159 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:02.602326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0016c-0fca-4c0b-9158-f5d490385159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:02.602773 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e02da-29a6-4568-a9c6-7d6dee84ef7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:02.603550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e02da-29a6-4568-a9c6-7d6dee84ef7a service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:02.603898 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e02da-29a6-4568-a9c6-7d6dee84ef7a service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:02.604239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e02da-29a6-4568-a9c6-7d6dee84ef7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:02.604514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0016c-0fca-4c0b-9158-f5d490385159 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:02.606269 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-046e02da-29a6-4568-a9c6-7d6dee84ef7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:02.619212 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e02da-29a6-4568-a9c6-7d6dee84ef7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:02.620910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e02da-29a6-4568-a9c6-7d6dee84ef7a service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:02.631795 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1215/2450] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:22:02.633407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e02da-29a6-4568-a9c6-7d6dee84ef7a service placement] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:02.634869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-046e02da-29a6-4568-a9c6-7d6dee84ef7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:02.650947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e02da-29a6-4568-a9c6-7d6dee84ef7a service placement] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:02.657003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c0116-c2b2-4bd4-bd6a-f97ac55c6232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:02.658769 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c0116-c2b2-4bd4-bd6a-f97ac55c6232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:02.658769 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c0116-c2b2-4bd4-bd6a-f97ac55c6232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:02.659132 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c0116-c2b2-4bd4-bd6a-f97ac55c6232 admin admin] PATH_INFO: `/v3/users/6f0ce995acc646d88f47c92e8458931a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:02.660427 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c0116-c2b2-4bd4-bd6a-f97ac55c6232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f0ce995acc646d88f47c92e8458931a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:02.662534 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c0116-c2b2-4bd4-bd6a-f97ac55c6232 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:02.675970 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1236/2451] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:22:02 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:22:02.677549 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0016c-0fca-4c0b-9158-f5d490385159 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:02.690240 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0016c-0fca-4c0b-9158-f5d490385159 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:02.695629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8398ddc-4302-4a40-907e-ece09a56e7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:02.696419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8398ddc-4302-4a40-907e-ece09a56e7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:02.696957 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8398ddc-4302-4a40-907e-ece09a56e7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:02.697470 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8398ddc-4302-4a40-907e-ece09a56e7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:02.698570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8398ddc-4302-4a40-907e-ece09a56e7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:02.700064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8398ddc-4302-4a40-907e-ece09a56e7c4 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:02.712001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1237/2452] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:02.715809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8398ddc-4302-4a40-907e-ece09a56e7c4 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:02.723944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:02.727456 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8398ddc-4302-4a40-907e-ece09a56e7c4 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:02.732202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a19d2-498f-4b2b-b9a2-7a9955be3a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:02.732849 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a19d2-498f-4b2b-b9a2-7a9955be3a25 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:02.733178 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a19d2-498f-4b2b-b9a2-7a9955be3a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:02.733464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a19d2-498f-4b2b-b9a2-7a9955be3a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:02.734242 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a19d2-498f-4b2b-b9a2-7a9955be3a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:02.735846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a19d2-498f-4b2b-b9a2-7a9955be3a25 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:02.748450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1238/2453] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 18:22:02.752546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a19d2-498f-4b2b-b9a2-7a9955be3a25 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:02.762422 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a19d2-498f-4b2b-b9a2-7a9955be3a25 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:02.767098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598784c3-5292-4de2-88f8-2d9072b416e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:02.767971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598784c3-5292-4de2-88f8-2d9072b416e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:02.768302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598784c3-5292-4de2-88f8-2d9072b416e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:02.768584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598784c3-5292-4de2-88f8-2d9072b416e3 admin admin] PATH_INFO: `/v3/projects/6e3e0cfcdc984d6894430ec637152380/users/e5743a51a07342fca9ce5efed60bef53/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:02.784019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598784c3-5292-4de2-88f8-2d9072b416e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3e0cfcdc984d6894430ec637152380, user_id=e5743a51a07342fca9ce5efed60bef53, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:02.786690 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598784c3-5292-4de2-88f8-2d9072b416e3 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:02.828915 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8b0c0116-c2b2-4bd4-bd6a-f97ac55c6232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f0ce995acc646d88f47c92e8458931a'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:02.844473 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1239/2454] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:02 2022] PUT /identity/v3/projects/6e3e0cfcdc984d6894430ec637152380/users/e5743a51a07342fca9ce5efed60bef53/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:22:02.895800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8b0c0116-c2b2-4bd4-bd6a-f97ac55c6232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f0ce995acc646d88f47c92e8458931a'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:02.904573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8b0c0116-c2b2-4bd4-bd6a-f97ac55c6232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f0ce995acc646d88f47c92e8458931a'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:02.905455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8b0c0116-c2b2-4bd4-bd6a-f97ac55c6232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f0ce995acc646d88f47c92e8458931a'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:02.908693 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173ee14-22ed-42f4-b19d-acf3946ddf00 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:02.909220 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173ee14-22ed-42f4-b19d-acf3946ddf00 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:02.909513 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173ee14-22ed-42f4-b19d-acf3946ddf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:02.919450 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-8b0c0116-c2b2-4bd4-bd6a-f97ac55c6232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f0ce995acc646d88f47c92e8458931a'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:02.926119 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1216/2455] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:02 2022] DELETE /identity/v3/users/6f0ce995acc646d88f47c92e8458931a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:02.938936 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-d173ee14-22ed-42f4-b19d-acf3946ddf00 None None] MFA Rules not processed for user `e5743a51a07342fca9ce5efed60bef53`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:02.940958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d173ee14-22ed-42f4-b19d-acf3946ddf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:03.008105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1240/2456] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:22:03.012691 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c0116-c2b2-4bd4-bd6a-f97ac55c6232 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:03.014214 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8b0c0116-c2b2-4bd4-bd6a-f97ac55c6232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:03.069643 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:03.086562 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c0116-c2b2-4bd4-bd6a-f97ac55c6232 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:03.092066 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e38a36-3490-4688-bd2a-ef80a20cc33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:03.092902 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e38a36-3490-4688-bd2a-ef80a20cc33e admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:03.093291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e38a36-3490-4688-bd2a-ef80a20cc33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:03.093776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e38a36-3490-4688-bd2a-ef80a20cc33e admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:03.094530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e38a36-3490-4688-bd2a-ef80a20cc33e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:03.097403 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e38a36-3490-4688-bd2a-ef80a20cc33e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:03.177317 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173ee14-22ed-42f4-b19d-acf3946ddf00 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:03.178756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d173ee14-22ed-42f4-b19d-acf3946ddf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:03.193307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173ee14-22ed-42f4-b19d-acf3946ddf00 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:03.198004 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac29c7d-30b4-4a93-84a8-1096a095f350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:03.199051 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac29c7d-30b4-4a93-84a8-1096a095f350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:03.199350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac29c7d-30b4-4a93-84a8-1096a095f350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:03.199625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac29c7d-30b4-4a93-84a8-1096a095f350 admin admin] PATH_INFO: `/v3/projects/8d056d4e36b845a69c089b124c1b538f` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:03.200814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac29c7d-30b4-4a93-84a8-1096a095f350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d056d4e36b845a69c089b124c1b538f)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:03.202783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac29c7d-30b4-4a93-84a8-1096a095f350 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:03.218074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1217/2457] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:22:03 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:03.223392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e38a36-3490-4688-bd2a-ef80a20cc33e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:03.292894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e38a36-3490-4688-bd2a-ef80a20cc33e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:03.299343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423037e-acbc-4742-8633-6c5f6843080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:03.300297 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423037e-acbc-4742-8633-6c5f6843080c admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:03.300585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423037e-acbc-4742-8633-6c5f6843080c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:03.301150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423037e-acbc-4742-8633-6c5f6843080c admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:03.301889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423037e-acbc-4742-8633-6c5f6843080c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:03.304878 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423037e-acbc-4742-8633-6c5f6843080c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:03.339685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dac29c7d-30b4-4a93-84a8-1096a095f350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d056d4e36b845a69c089b124c1b538f', 'request_id': 'req-dac29c7d-30b4-4a93-84a8-1096a095f350'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:03.353385 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dac29c7d-30b4-4a93-84a8-1096a095f350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d056d4e36b845a69c089b124c1b538f', 'request_id': 'req-dac29c7d-30b4-4a93-84a8-1096a095f350'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:03.420765 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1218/2458] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:22:03 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:03.423218 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423037e-acbc-4742-8633-6c5f6843080c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:03.433898 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423037e-acbc-4742-8633-6c5f6843080c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:03.456581 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dac29c7d-30b4-4a93-84a8-1096a095f350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d056d4e36b845a69c089b124c1b538f', 'request_id': 'req-dac29c7d-30b4-4a93-84a8-1096a095f350'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:03.472016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dac29c7d-30b4-4a93-84a8-1096a095f350 admin admin] The token cache is being invalidate because project 8d056d4e36b845a69c089b124c1b538f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:03.472649 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dac29c7d-30b4-4a93-84a8-1096a095f350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:03.473571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dac29c7d-30b4-4a93-84a8-1096a095f350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:03.476366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1241/2459] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:03 2022] DELETE /identity/v3/projects/8d056d4e36b845a69c089b124c1b538f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:22:03.485972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ff78c-92be-4226-bd0b-addac93f5095 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:03.485972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ff78c-92be-4226-bd0b-addac93f5095 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:03.485972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ff78c-92be-4226-bd0b-addac93f5095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:03.503829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-0a7ff78c-92be-4226-bd0b-addac93f5095 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:03.505375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0a7ff78c-92be-4226-bd0b-addac93f5095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:03.513796 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab411e3f-1304-4ee2-8115-2a5b5818fd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:03.514612 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab411e3f-1304-4ee2-8115-2a5b5818fd83 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:03.514927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab411e3f-1304-4ee2-8115-2a5b5818fd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:03.515174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab411e3f-1304-4ee2-8115-2a5b5818fd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:03.515919 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab411e3f-1304-4ee2-8115-2a5b5818fd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:03.518380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab411e3f-1304-4ee2-8115-2a5b5818fd83 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:03.530018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1219/2460] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 18:22:03.534708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab411e3f-1304-4ee2-8115-2a5b5818fd83 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:03.536052 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ab411e3f-1304-4ee2-8115-2a5b5818fd83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:03.550574 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab411e3f-1304-4ee2-8115-2a5b5818fd83 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:03.553064 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:03.556265 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc50f66-e4fd-4bab-80e6-16a7d187773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:03.556989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc50f66-e4fd-4bab-80e6-16a7d187773a admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:03.557286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc50f66-e4fd-4bab-80e6-16a7d187773a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:03.557569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc50f66-e4fd-4bab-80e6-16a7d187773a admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:03.558308 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc50f66-e4fd-4bab-80e6-16a7d187773a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:03.560043 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc50f66-e4fd-4bab-80e6-16a7d187773a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:03.572463 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1220/2461] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:03.577031 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc50f66-e4fd-4bab-80e6-16a7d187773a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:03.589595 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1242/2462] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:03.589856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc50f66-e4fd-4bab-80e6-16a7d187773a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:03.592223 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50770721-e0d1-48af-8cad-d74032529c60 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:03.592223 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50770721-e0d1-48af-8cad-d74032529c60 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:03.592223 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50770721-e0d1-48af-8cad-d74032529c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:03.594805 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d5dab-c5fc-4d8b-bde5-2ae11f398d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:03.595745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d5dab-c5fc-4d8b-bde5-2ae11f398d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:03.596123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d5dab-c5fc-4d8b-bde5-2ae11f398d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:03.596406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d5dab-c5fc-4d8b-bde5-2ae11f398d88 admin admin] PATH_INFO: `/v3/projects/1b80ce8a51634eda97a2c9c3e2139c01/users/effe306002e840569b0e1edef04bcd02/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:03.614077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d5dab-c5fc-4d8b-bde5-2ae11f398d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b80ce8a51634eda97a2c9c3e2139c01, user_id=effe306002e840569b0e1edef04bcd02, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:03.615905 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-50770721-e0d1-48af-8cad-d74032529c60 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:03.617158 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-50770721-e0d1-48af-8cad-d74032529c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:03.617688 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d5dab-c5fc-4d8b-bde5-2ae11f398d88 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:03.626880 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1243/2463] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:22:03.631092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50770721-e0d1-48af-8cad-d74032529c60 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:03.640521 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50770721-e0d1-48af-8cad-d74032529c60 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:03.646921 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dc648-06ec-401e-a258-2c7f89662606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:03.647803 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dc648-06ec-401e-a258-2c7f89662606 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:03.648106 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dc648-06ec-401e-a258-2c7f89662606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:03.648456 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dc648-06ec-401e-a258-2c7f89662606 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:03.649502 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dc648-06ec-401e-a258-2c7f89662606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:22:03.650040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dc648-06ec-401e-a258-2c7f89662606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:03.651948 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dc648-06ec-401e-a258-2c7f89662606 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:03.671886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1221/2464] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:03 2022] PUT /identity/v3/projects/1b80ce8a51634eda97a2c9c3e2139c01/users/effe306002e840569b0e1edef04bcd02/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:03.672420 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1244/2465] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 18:22:03.673807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d5dab-c5fc-4d8b-bde5-2ae11f398d88 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:03.679730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2c7ce-60d1-40e5-88e1-ba1c798641ba None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:03.679730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2c7ce-60d1-40e5-88e1-ba1c798641ba None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:03.679730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2c7ce-60d1-40e5-88e1-ba1c798641ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:03.706411 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-79b2c7ce-60d1-40e5-88e1-ba1c798641ba None None] MFA Rules not processed for user `effe306002e840569b0e1edef04bcd02`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:03.707573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:03.707730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-79b2c7ce-60d1-40e5-88e1-ba1c798641ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:03.756507 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d5dab-c5fc-4d8b-bde5-2ae11f398d88 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:03.761482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee5713-8de3-4ffc-b9f2-5f52bceea337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:03.762155 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee5713-8de3-4ffc-b9f2-5f52bceea337 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:03.762442 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee5713-8de3-4ffc-b9f2-5f52bceea337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:03.762743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee5713-8de3-4ffc-b9f2-5f52bceea337 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:03.763429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee5713-8de3-4ffc-b9f2-5f52bceea337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:03.765387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee5713-8de3-4ffc-b9f2-5f52bceea337 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:03.776498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1245/2466] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:22:03.780931 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2c7ce-60d1-40e5-88e1-ba1c798641ba None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:03.793016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2c7ce-60d1-40e5-88e1-ba1c798641ba None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:03.797865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8540f-855a-4e69-a389-9d6dd51b7fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:03.798533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8540f-855a-4e69-a389-9d6dd51b7fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:03.799036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8540f-855a-4e69-a389-9d6dd51b7fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:03.799170 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8540f-855a-4e69-a389-9d6dd51b7fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:03.799799 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8540f-855a-4e69-a389-9d6dd51b7fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:03.802248 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8540f-855a-4e69-a389-9d6dd51b7fd2 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:03.828413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1222/2467] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:22:03 2022] POST /identity/v3/projects => generated 363 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:22:03.833319 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee5713-8de3-4ffc-b9f2-5f52bceea337 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:03.880089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1246/2468] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:22:03 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:22:03.884080 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8540f-855a-4e69-a389-9d6dd51b7fd2 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:03.899446 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee5713-8de3-4ffc-b9f2-5f52bceea337 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:03.946884 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8540f-855a-4e69-a389-9d6dd51b7fd2 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:03.951995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea30802-2391-424b-b485-d92a044dfa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:03.952765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea30802-2391-424b-b485-d92a044dfa98 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:03.953157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea30802-2391-424b-b485-d92a044dfa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:03.953370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea30802-2391-424b-b485-d92a044dfa98 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:03.954097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea30802-2391-424b-b485-d92a044dfa98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:03.956582 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea30802-2391-424b-b485-d92a044dfa98 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:03.959894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9fb90-511e-415e-a705-58168bd5620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:03.960637 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9fb90-511e-415e-a705-58168bd5620e admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:03.960926 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9fb90-511e-415e-a705-58168bd5620e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:03.966183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9fb90-511e-415e-a705-58168bd5620e admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:03.966183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9fb90-511e-415e-a705-58168bd5620e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:03.966183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9fb90-511e-415e-a705-58168bd5620e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:04.049640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1247/2469] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:22:03 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:22:04.053642 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea30802-2391-424b-b485-d92a044dfa98 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:04.063552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea30802-2391-424b-b485-d92a044dfa98 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:04.069367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308ccd4-c9de-4d41-bd7b-8d72d9c1c35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:04.070036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308ccd4-c9de-4d41-bd7b-8d72d9c1c35d admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:04.070321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308ccd4-c9de-4d41-bd7b-8d72d9c1c35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:04.070612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308ccd4-c9de-4d41-bd7b-8d72d9c1c35d admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:04.071338 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308ccd4-c9de-4d41-bd7b-8d72d9c1c35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:04.072969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308ccd4-c9de-4d41-bd7b-8d72d9c1c35d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:04.074678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1223/2470] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:22:03 2022] POST /identity/v3/users => generated 282 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:22:04.081512 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9fb90-511e-415e-a705-58168bd5620e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:04.084126 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1248/2471] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 18:22:04.088093 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308ccd4-c9de-4d41-bd7b-8d72d9c1c35d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:04.092165 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9fb90-511e-415e-a705-58168bd5620e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:04.097150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f4224-5f28-417b-ad0e-85b1831c2d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:04.097844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f4224-5f28-417b-ad0e-85b1831c2d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:04.098140 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f4224-5f28-417b-ad0e-85b1831c2d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:04.098426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f4224-5f28-417b-ad0e-85b1831c2d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:04.098771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308ccd4-c9de-4d41-bd7b-8d72d9c1c35d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:04.099313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f4224-5f28-417b-ad0e-85b1831c2d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:04.100864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f4224-5f28-417b-ad0e-85b1831c2d27 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:04.103695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada532b-ed44-4ae9-959e-d5d0b2edccea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:04.104582 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada532b-ed44-4ae9-959e-d5d0b2edccea admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:04.104867 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada532b-ed44-4ae9-959e-d5d0b2edccea admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:04.105235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada532b-ed44-4ae9-959e-d5d0b2edccea admin admin] PATH_INFO: `/v3/projects/836d070843c1408fa1446be69f4f0435/users/ebf77f3040d04bfcac1aa410ed6e952b/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:04.108453 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:04.112556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1224/2472] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 18:22:04.116521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f4224-5f28-417b-ad0e-85b1831c2d27 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:04.121297 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada532b-ed44-4ae9-959e-d5d0b2edccea admin admin] RBAC: Authorizing `identity:create_grant(project_id=836d070843c1408fa1446be69f4f0435, user_id=ebf77f3040d04bfcac1aa410ed6e952b, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:04.124113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada532b-ed44-4ae9-959e-d5d0b2edccea admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:04.127308 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f4224-5f28-417b-ad0e-85b1831c2d27 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:04.132449 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67789865-925c-41e4-a669-0170b7680ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:04.133147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67789865-925c-41e4-a669-0170b7680ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:04.133478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67789865-925c-41e4-a669-0170b7680ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:04.133929 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67789865-925c-41e4-a669-0170b7680ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:04.134658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67789865-925c-41e4-a669-0170b7680ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:04.136308 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67789865-925c-41e4-a669-0170b7680ed2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:04.147677 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1225/2473] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 18:22:04.151726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67789865-925c-41e4-a669-0170b7680ed2 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:04.161412 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67789865-925c-41e4-a669-0170b7680ed2 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:04.166087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fe87e-e6cf-4166-951b-7abbd4a3624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:04.166947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fe87e-e6cf-4166-951b-7abbd4a3624f admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:04.167237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fe87e-e6cf-4166-951b-7abbd4a3624f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:04.167533 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fe87e-e6cf-4166-951b-7abbd4a3624f admin admin] PATH_INFO: `/v3/projects/b8b6fd339f434b3da30af496fd614a7a/users/5d98c6e8a60747d59e98e9894fa52fb8/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:04.182016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1249/2474] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:04 2022] PUT /identity/v3/projects/836d070843c1408fa1446be69f4f0435/users/ebf77f3040d04bfcac1aa410ed6e952b/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:22:04.182331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fe87e-e6cf-4166-951b-7abbd4a3624f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b6fd339f434b3da30af496fd614a7a, user_id=5d98c6e8a60747d59e98e9894fa52fb8, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:04.185099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fe87e-e6cf-4166-951b-7abbd4a3624f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:04.185680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada532b-ed44-4ae9-959e-d5d0b2edccea admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:04.239900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:04.245200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1226/2475] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:04 2022] PUT /identity/v3/projects/b8b6fd339f434b3da30af496fd614a7a/users/5d98c6e8a60747d59e98e9894fa52fb8/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:22:04.252089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada532b-ed44-4ae9-959e-d5d0b2edccea admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:04.256761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481dac2-01db-4484-88b9-efec1d865094 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:04.257130 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481dac2-01db-4484-88b9-efec1d865094 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:04.257421 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481dac2-01db-4484-88b9-efec1d865094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:04.285876 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7481dac2-01db-4484-88b9-efec1d865094 None None] MFA Rules not processed for user `5d98c6e8a60747d59e98e9894fa52fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:04.287332 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7481dac2-01db-4484-88b9-efec1d865094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:04.310050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d2e6f-9169-4d5d-b2af-965f52b5629a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:04.310718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d2e6f-9169-4d5d-b2af-965f52b5629a admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:04.311151 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d2e6f-9169-4d5d-b2af-965f52b5629a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:04.311307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d2e6f-9169-4d5d-b2af-965f52b5629a admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:04.311991 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d2e6f-9169-4d5d-b2af-965f52b5629a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:04.314054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d2e6f-9169-4d5d-b2af-965f52b5629a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:04.325129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1250/2476] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 18:22:04.329197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d2e6f-9169-4d5d-b2af-965f52b5629a admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:04.339480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d2e6f-9169-4d5d-b2af-965f52b5629a admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:04.344232 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcc1d4-b190-462d-81c8-338f8a52fee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:04.345073 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcc1d4-b190-462d-81c8-338f8a52fee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:04.345347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcc1d4-b190-462d-81c8-338f8a52fee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:04.345689 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcc1d4-b190-462d-81c8-338f8a52fee4 admin admin] PATH_INFO: `/v3/projects/836d070843c1408fa1446be69f4f0435/users/ebf77f3040d04bfcac1aa410ed6e952b/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:04.347716 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcc1d4-b190-462d-81c8-338f8a52fee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=836d070843c1408fa1446be69f4f0435, user_id=ebf77f3040d04bfcac1aa410ed6e952b, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:04.350423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcc1d4-b190-462d-81c8-338f8a52fee4 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:04.354583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1227/2477] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:22:04.358933 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481dac2-01db-4484-88b9-efec1d865094 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:04.360886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1251/2478] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:04 2022] PUT /identity/v3/projects/836d070843c1408fa1446be69f4f0435/users/ebf77f3040d04bfcac1aa410ed6e952b/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:04.369960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481dac2-01db-4484-88b9-efec1d865094 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:04.371351 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349dfeb-55bb-4694-a296-007174e4f0dc None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:04.371638 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349dfeb-55bb-4694-a296-007174e4f0dc None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:04.371909 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349dfeb-55bb-4694-a296-007174e4f0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:04.398873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-a349dfeb-55bb-4694-a296-007174e4f0dc None None] MFA Rules not processed for user `ebf77f3040d04bfcac1aa410ed6e952b`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:04.400074 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a349dfeb-55bb-4694-a296-007174e4f0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:04.429826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6b34a-b977-4ca5-a49f-291452c2ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:04.430522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6b34a-b977-4ca5-a49f-291452c2ce57 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:04.430809 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6b34a-b977-4ca5-a49f-291452c2ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:04.431081 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6b34a-b977-4ca5-a49f-291452c2ce57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:04.431768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6b34a-b977-4ca5-a49f-291452c2ce57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:04.433787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6b34a-b977-4ca5-a49f-291452c2ce57 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:04.491012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:04.496981 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1252/2479] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:22:04.510048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1228/2480] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:22:04 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:22:04.518025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349dfeb-55bb-4694-a296-007174e4f0dc None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:04.518477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6b34a-b977-4ca5-a49f-291452c2ce57 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:04.520063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a349dfeb-55bb-4694-a296-007174e4f0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:04.613012 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6b34a-b977-4ca5-a49f-291452c2ce57 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:04.620614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70175b9-2e6d-4f94-8cd6-f738ced608ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:04.625172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70175b9-2e6d-4f94-8cd6-f738ced608ff admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:04.625172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70175b9-2e6d-4f94-8cd6-f738ced608ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:04.625172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70175b9-2e6d-4f94-8cd6-f738ced608ff admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:04.625172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70175b9-2e6d-4f94-8cd6-f738ced608ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:04.626274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349dfeb-55bb-4694-a296-007174e4f0dc None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:04.626812 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70175b9-2e6d-4f94-8cd6-f738ced608ff admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:04.689866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8671a3-b179-405f-abbb-0837d7d39d82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:04.690660 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8671a3-b179-405f-abbb-0837d7d39d82 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:04.690950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8671a3-b179-405f-abbb-0837d7d39d82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:04.691382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8671a3-b179-405f-abbb-0837d7d39d82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:04.694253 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3e8671a3-b179-405f-abbb-0837d7d39d82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:04.746413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1229/2481] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:22:04 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:04.752868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70175b9-2e6d-4f94-8cd6-f738ced608ff admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:04.766267 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:04.773087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70175b9-2e6d-4f94-8cd6-f738ced608ff admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:04.782164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec22b6-f34f-411f-860c-cc5538f7beec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:04.782955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec22b6-f34f-411f-860c-cc5538f7beec admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:04.783245 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec22b6-f34f-411f-860c-cc5538f7beec admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:04.783523 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec22b6-f34f-411f-860c-cc5538f7beec admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:04.784789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec22b6-f34f-411f-860c-cc5538f7beec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:04.795135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec22b6-f34f-411f-860c-cc5538f7beec admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:04.819749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1230/2482] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:04.823955 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec22b6-f34f-411f-860c-cc5538f7beec admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:04.835662 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec22b6-f34f-411f-860c-cc5538f7beec admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:04.841199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35015c-07f1-4b29-a5ff-29535c260b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:04.842748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35015c-07f1-4b29-a5ff-29535c260b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:04.843145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35015c-07f1-4b29-a5ff-29535c260b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:04.843479 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35015c-07f1-4b29-a5ff-29535c260b29 admin admin] PATH_INFO: `/v3/projects/7c60a300261a479f85de9416da3da8b9/users/dc8c772617764e13b4453143d0d52bc3/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:04.854398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8671a3-b179-405f-abbb-0837d7d39d82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:04.856406 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8671a3-b179-405f-abbb-0837d7d39d82 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:04.873092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1253/2483] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:04.879890 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35015c-07f1-4b29-a5ff-29535c260b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c60a300261a479f85de9416da3da8b9, user_id=dc8c772617764e13b4453143d0d52bc3, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:04.883586 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35015c-07f1-4b29-a5ff-29535c260b29 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:04.956255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1231/2484] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:04 2022] PUT /identity/v3/projects/7c60a300261a479f85de9416da3da8b9/users/dc8c772617764e13b4453143d0d52bc3/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:04.960037 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8671a3-b179-405f-abbb-0837d7d39d82 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:04.974532 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8671a3-b179-405f-abbb-0837d7d39d82 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:05.063572 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4512e-29eb-487a-b901-4981a3a47460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:05.065048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4512e-29eb-487a-b901-4981a3a47460 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:05.066262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4512e-29eb-487a-b901-4981a3a47460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:05.071177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4512e-29eb-487a-b901-4981a3a47460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:05.071177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4512e-29eb-487a-b901-4981a3a47460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:05.071177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4512e-29eb-487a-b901-4981a3a47460 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:05.083730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1254/2485] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:05.088351 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35015c-07f1-4b29-a5ff-29535c260b29 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:05.100650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35015c-07f1-4b29-a5ff-29535c260b29 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:05.106657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4547b07-defe-49c6-95ef-926c8010db9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:05.107741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4547b07-defe-49c6-95ef-926c8010db9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:05.108020 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4547b07-defe-49c6-95ef-926c8010db9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:05.108298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4547b07-defe-49c6-95ef-926c8010db9f admin admin] PATH_INFO: `/v3/projects/7c60a300261a479f85de9416da3da8b9/users/dc8c772617764e13b4453143d0d52bc3/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:05.110450 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4547b07-defe-49c6-95ef-926c8010db9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c60a300261a479f85de9416da3da8b9, user_id=dc8c772617764e13b4453143d0d52bc3, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:05.113912 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4547b07-defe-49c6-95ef-926c8010db9f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:05.137055 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1232/2486] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:05 2022] PUT /identity/v3/projects/7c60a300261a479f85de9416da3da8b9/users/dc8c772617764e13b4453143d0d52bc3/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:05.138475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca5739-a80a-4296-a546-d2d47d152799 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:05.138974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca5739-a80a-4296-a546-d2d47d152799 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:05.139381 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca5739-a80a-4296-a546-d2d47d152799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:05.157988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=100 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:05.178979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-d4ca5739-a80a-4296-a546-d2d47d152799 None None] MFA Rules not processed for user `dc8c772617764e13b4453143d0d52bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:05.181315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d4ca5739-a80a-4296-a546-d2d47d152799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:05.277096 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1255/2487] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:05.291074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4547b07-defe-49c6-95ef-926c8010db9f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:05.293492 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a4547b07-defe-49c6-95ef-926c8010db9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:05.391100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4547b07-defe-49c6-95ef-926c8010db9f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:05.396591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3a337-d129-49a6-84d5-2e81ca4e8120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:05.397509 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3a337-d129-49a6-84d5-2e81ca4e8120 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:05.397964 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3a337-d129-49a6-84d5-2e81ca4e8120 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:05.398437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3a337-d129-49a6-84d5-2e81ca4e8120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:05.409641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3a337-d129-49a6-84d5-2e81ca4e8120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:05.411515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3a337-d129-49a6-84d5-2e81ca4e8120 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:05.422786 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1233/2488] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:06.329869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca5739-a80a-4296-a546-d2d47d152799 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:06.398833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca5739-a80a-4296-a546-d2d47d152799 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:06.403574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ce4d8-b2f7-4a2a-a246-07d9bdc0514e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:06.404456 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ce4d8-b2f7-4a2a-a246-07d9bdc0514e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:06.404734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ce4d8-b2f7-4a2a-a246-07d9bdc0514e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:06.405042 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ce4d8-b2f7-4a2a-a246-07d9bdc0514e admin admin] PATH_INFO: `/v3/users/5d98c6e8a60747d59e98e9894fa52fb8` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:06.406230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ce4d8-b2f7-4a2a-a246-07d9bdc0514e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d98c6e8a60747d59e98e9894fa52fb8)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:06.408444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ce4d8-b2f7-4a2a-a246-07d9bdc0514e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:06.646142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-421ce4d8-b2f7-4a2a-a246-07d9bdc0514e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d98c6e8a60747d59e98e9894fa52fb8'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:06.735715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-421ce4d8-b2f7-4a2a-a246-07d9bdc0514e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d98c6e8a60747d59e98e9894fa52fb8'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:06.744144 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-421ce4d8-b2f7-4a2a-a246-07d9bdc0514e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d98c6e8a60747d59e98e9894fa52fb8'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:06.744783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-421ce4d8-b2f7-4a2a-a246-07d9bdc0514e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d98c6e8a60747d59e98e9894fa52fb8'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:06.758084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-421ce4d8-b2f7-4a2a-a246-07d9bdc0514e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d98c6e8a60747d59e98e9894fa52fb8'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:06.764222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1256/2489] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:06 2022] DELETE /identity/v3/users/5d98c6e8a60747d59e98e9894fa52fb8 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:06.769123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c9ccf-2bcb-4337-9103-15ea2bfc27c2 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:06.769632 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c9ccf-2bcb-4337-9103-15ea2bfc27c2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:06.776052 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c9ccf-2bcb-4337-9103-15ea2bfc27c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:06.786575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-403c9ccf-2bcb-4337-9103-15ea2bfc27c2 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:06.787818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-403c9ccf-2bcb-4337-9103-15ea2bfc27c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:06.850684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1234/2490] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:06.860590 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ce4d8-b2f7-4a2a-a246-07d9bdc0514e admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:06.862090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-421ce4d8-b2f7-4a2a-a246-07d9bdc0514e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:06.876375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:06.922000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ce4d8-b2f7-4a2a-a246-07d9bdc0514e admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:06.926564 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7ee3b-3a95-40a0-b382-4706484d979f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:06.927256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7ee3b-3a95-40a0-b382-4706484d979f service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:06.927535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7ee3b-3a95-40a0-b382-4706484d979f service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:06.927808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7ee3b-3a95-40a0-b382-4706484d979f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:06.936840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7ee3b-3a95-40a0-b382-4706484d979f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:06.938285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7ee3b-3a95-40a0-b382-4706484d979f service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:06.948954 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1257/2491] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:07.418787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c9ccf-2bcb-4337-9103-15ea2bfc27c2 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:07.422149 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-403c9ccf-2bcb-4337-9103-15ea2bfc27c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:07.437743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c9ccf-2bcb-4337-9103-15ea2bfc27c2 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:07.444025 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da36a35-adad-4d65-9425-09e949c02be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:07.445096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da36a35-adad-4d65-9425-09e949c02be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:07.445412 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da36a35-adad-4d65-9425-09e949c02be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:07.445838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da36a35-adad-4d65-9425-09e949c02be2 admin admin] PATH_INFO: `/v3/projects/b8b6fd339f434b3da30af496fd614a7a` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:07.447508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da36a35-adad-4d65-9425-09e949c02be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b6fd339f434b3da30af496fd614a7a)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:07.450070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da36a35-adad-4d65-9425-09e949c02be2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:07.566810 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5da36a35-adad-4d65-9425-09e949c02be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b6fd339f434b3da30af496fd614a7a', 'request_id': 'req-5da36a35-adad-4d65-9425-09e949c02be2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:07.572600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5da36a35-adad-4d65-9425-09e949c02be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b6fd339f434b3da30af496fd614a7a', 'request_id': 'req-5da36a35-adad-4d65-9425-09e949c02be2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:07.574603 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:07.615008 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5da36a35-adad-4d65-9425-09e949c02be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b6fd339f434b3da30af496fd614a7a', 'request_id': 'req-5da36a35-adad-4d65-9425-09e949c02be2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:07.625311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5da36a35-adad-4d65-9425-09e949c02be2 admin admin] The token cache is being invalidate because project b8b6fd339f434b3da30af496fd614a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:07.625676 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5da36a35-adad-4d65-9425-09e949c02be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:07.626328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5da36a35-adad-4d65-9425-09e949c02be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:07.628412 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1235/2492] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:07 2022] DELETE /identity/v3/projects/b8b6fd339f434b3da30af496fd614a7a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:07.632560 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7ee3b-3a95-40a0-b382-4706484d979f service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:07.642480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7ee3b-3a95-40a0-b382-4706484d979f service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:07.704465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407dac8-49e8-463e-9935-0841e350fabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:07.705382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407dac8-49e8-463e-9935-0841e350fabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:07.705821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407dac8-49e8-463e-9935-0841e350fabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:07.706901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407dac8-49e8-463e-9935-0841e350fabb admin admin] PATH_INFO: `/v3/users/dc8c772617764e13b4453143d0d52bc3` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:07.708223 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407dac8-49e8-463e-9935-0841e350fabb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8c772617764e13b4453143d0d52bc3)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:07.710213 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407dac8-49e8-463e-9935-0841e350fabb admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:07.943489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-a407dac8-49e8-463e-9935-0841e350fabb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8c772617764e13b4453143d0d52bc3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:08.038534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-a407dac8-49e8-463e-9935-0841e350fabb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8c772617764e13b4453143d0d52bc3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:08.048303 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-a407dac8-49e8-463e-9935-0841e350fabb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8c772617764e13b4453143d0d52bc3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:08.048303 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-a407dac8-49e8-463e-9935-0841e350fabb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8c772617764e13b4453143d0d52bc3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:08.060221 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da36a35-adad-4d65-9425-09e949c02be2 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:08.060761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-a407dac8-49e8-463e-9935-0841e350fabb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8c772617764e13b4453143d0d52bc3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:08.061756 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-5da36a35-adad-4d65-9425-09e949c02be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:08.067164 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1258/2493] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:07 2022] DELETE /identity/v3/users/dc8c772617764e13b4453143d0d52bc3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:08.126769 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da36a35-adad-4d65-9425-09e949c02be2 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:08.184477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7af545-81e5-485d-8510-2c6f1b2fb83c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:08.185167 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7af545-81e5-485d-8510-2c6f1b2fb83c service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:08.185457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7af545-81e5-485d-8510-2c6f1b2fb83c service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:08.185737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7af545-81e5-485d-8510-2c6f1b2fb83c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:08.187575 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7b7af545-81e5-485d-8510-2c6f1b2fb83c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:08.254020 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7af545-81e5-485d-8510-2c6f1b2fb83c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:08.254020 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7af545-81e5-485d-8510-2c6f1b2fb83c service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:08.263480 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1236/2494] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:22:08.502557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407dac8-49e8-463e-9935-0841e350fabb admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:08.510694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a407dac8-49e8-463e-9935-0841e350fabb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:08.543746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:08.575083 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407dac8-49e8-463e-9935-0841e350fabb admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:08.579181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f8150-1d89-4b31-b4f6-120c192217f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:08.580109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f8150-1d89-4b31-b4f6-120c192217f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:08.580391 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f8150-1d89-4b31-b4f6-120c192217f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:08.580664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f8150-1d89-4b31-b4f6-120c192217f3 admin admin] PATH_INFO: `/v3/projects/7c60a300261a479f85de9416da3da8b9` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:08.582051 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f8150-1d89-4b31-b4f6-120c192217f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c60a300261a479f85de9416da3da8b9)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:08.583952 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f8150-1d89-4b31-b4f6-120c192217f3 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:08.756423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-579f8150-1d89-4b31-b4f6-120c192217f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c60a300261a479f85de9416da3da8b9', 'request_id': 'req-579f8150-1d89-4b31-b4f6-120c192217f3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:08.762737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-579f8150-1d89-4b31-b4f6-120c192217f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c60a300261a479f85de9416da3da8b9', 'request_id': 'req-579f8150-1d89-4b31-b4f6-120c192217f3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:08.889760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-579f8150-1d89-4b31-b4f6-120c192217f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c60a300261a479f85de9416da3da8b9', 'request_id': 'req-579f8150-1d89-4b31-b4f6-120c192217f3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:08.902049 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-579f8150-1d89-4b31-b4f6-120c192217f3 admin admin] The token cache is being invalidate because project 7c60a300261a479f85de9416da3da8b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:08.902337 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-579f8150-1d89-4b31-b4f6-120c192217f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:08.902991 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-579f8150-1d89-4b31-b4f6-120c192217f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:08.904627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1259/2495] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:08 2022] DELETE /identity/v3/projects/7c60a300261a479f85de9416da3da8b9 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:08.911140 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33017c-3a35-4db7-9d3f-3d6bd9aa5fdc None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:08.912041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33017c-3a35-4db7-9d3f-3d6bd9aa5fdc None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:08.912869 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33017c-3a35-4db7-9d3f-3d6bd9aa5fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:08.936638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1a33017c-3a35-4db7-9d3f-3d6bd9aa5fdc None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:08.938855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1a33017c-3a35-4db7-9d3f-3d6bd9aa5fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:08.991658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:09.004260 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1237/2496] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:09.013425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f28d8-5e55-484c-a950-f635e8cc8466 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:09.013975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f28d8-5e55-484c-a950-f635e8cc8466 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:09.015645 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f28d8-5e55-484c-a950-f635e8cc8466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:09.037907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-744f28d8-5e55-484c-a950-f635e8cc8466 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:09.039127 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-744f28d8-5e55-484c-a950-f635e8cc8466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:09.047265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1260/2497] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:09.051934 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33017c-3a35-4db7-9d3f-3d6bd9aa5fdc None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:09.061834 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33017c-3a35-4db7-9d3f-3d6bd9aa5fdc None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:09.068593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa78606-208d-420f-9e09-be70b7b3c07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:09.069293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa78606-208d-420f-9e09-be70b7b3c07f admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:09.069573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa78606-208d-420f-9e09-be70b7b3c07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:09.069855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa78606-208d-420f-9e09-be70b7b3c07f admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:09.070593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa78606-208d-420f-9e09-be70b7b3c07f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:22:09.070905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa78606-208d-420f-9e09-be70b7b3c07f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:09.072585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa78606-208d-420f-9e09-be70b7b3c07f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:09.086026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1238/2498] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:22:09.090775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f28d8-5e55-484c-a950-f635e8cc8466 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:09.104557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f28d8-5e55-484c-a950-f635e8cc8466 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:09.110419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee8827-01d8-4537-975c-99eb0c0cb917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:09.111103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee8827-01d8-4537-975c-99eb0c0cb917 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:09.111390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee8827-01d8-4537-975c-99eb0c0cb917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:09.111740 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee8827-01d8-4537-975c-99eb0c0cb917 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:09.112994 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee8827-01d8-4537-975c-99eb0c0cb917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:09.115241 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee8827-01d8-4537-975c-99eb0c0cb917 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:09.247959 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1261/2499] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:22:09 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:09.252257 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa78606-208d-420f-9e09-be70b7b3c07f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:09.262564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa78606-208d-420f-9e09-be70b7b3c07f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:09.323919 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c9318-fb38-4326-891d-64ecc70cde24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:09.324287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c9318-fb38-4326-891d-64ecc70cde24 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:09.324576 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c9318-fb38-4326-891d-64ecc70cde24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:09.324859 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c9318-fb38-4326-891d-64ecc70cde24 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:09.325654 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c9318-fb38-4326-891d-64ecc70cde24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:09.327537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c9318-fb38-4326-891d-64ecc70cde24 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:09.434238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1239/2500] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:22:09 2022] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:09.438196 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee8827-01d8-4537-975c-99eb0c0cb917 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:09.450433 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee8827-01d8-4537-975c-99eb0c0cb917 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:09.455530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3b4f4-b855-41e2-962d-407f0dc51e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:09.456366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3b4f4-b855-41e2-962d-407f0dc51e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:09.456902 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3b4f4-b855-41e2-962d-407f0dc51e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:09.457265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3b4f4-b855-41e2-962d-407f0dc51e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:09.462279 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3b4f4-b855-41e2-962d-407f0dc51e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:09.462279 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3b4f4-b855-41e2-962d-407f0dc51e5a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:09.475281 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1262/2501] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:09.476644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c9318-fb38-4326-891d-64ecc70cde24 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:09.486901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c9318-fb38-4326-891d-64ecc70cde24 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:09.492194 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c94cf-ae36-4546-be61-ca3cee9114fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:09.492927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c94cf-ae36-4546-be61-ca3cee9114fb admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:09.493307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c94cf-ae36-4546-be61-ca3cee9114fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:09.493652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c94cf-ae36-4546-be61-ca3cee9114fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:09.494510 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c94cf-ae36-4546-be61-ca3cee9114fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:09.497239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c94cf-ae36-4546-be61-ca3cee9114fb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:09.508507 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1240/2502] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:09.511885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3b4f4-b855-41e2-962d-407f0dc51e5a admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:09.522931 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3b4f4-b855-41e2-962d-407f0dc51e5a admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:09.527622 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3d6e6-599e-4665-b7d1-e66563d3dcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:09.528595 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3d6e6-599e-4665-b7d1-e66563d3dcc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:09.528817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3d6e6-599e-4665-b7d1-e66563d3dcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:09.529128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3d6e6-599e-4665-b7d1-e66563d3dcc7 admin admin] PATH_INFO: `/v3/projects/22edc89c41e34077a67885774e3a9344/users/fa7110a7721447bca028581c06ed2da1/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:09.545366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3d6e6-599e-4665-b7d1-e66563d3dcc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22edc89c41e34077a67885774e3a9344, user_id=fa7110a7721447bca028581c06ed2da1, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:09.548045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3d6e6-599e-4665-b7d1-e66563d3dcc7 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:09.611858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1263/2503] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:09 2022] PUT /identity/v3/projects/22edc89c41e34077a67885774e3a9344/users/fa7110a7721447bca028581c06ed2da1/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:09.623884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03104081-9f87-4295-97ac-3613ca3d91ac None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:09.628093 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03104081-9f87-4295-97ac-3613ca3d91ac None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:09.628093 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03104081-9f87-4295-97ac-3613ca3d91ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:09.653276 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-03104081-9f87-4295-97ac-3613ca3d91ac None None] MFA Rules not processed for user `fa7110a7721447bca028581c06ed2da1`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:09.654560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-03104081-9f87-4295-97ac-3613ca3d91ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:09.732252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1241/2504] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:09.737345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3d6e6-599e-4665-b7d1-e66563d3dcc7 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:09.802354 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3d6e6-599e-4665-b7d1-e66563d3dcc7 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:09.807443 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febefea7-88de-4a54-845a-454dcfdfbf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:09.808234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febefea7-88de-4a54-845a-454dcfdfbf0a admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:09.808589 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febefea7-88de-4a54-845a-454dcfdfbf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:09.808931 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febefea7-88de-4a54-845a-454dcfdfbf0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:09.809672 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febefea7-88de-4a54-845a-454dcfdfbf0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:09.811664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febefea7-88de-4a54-845a-454dcfdfbf0a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:09.816931 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:09.842160 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03104081-9f87-4295-97ac-3613ca3d91ac None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:09.843819 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-03104081-9f87-4295-97ac-3613ca3d91ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:09.908966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1264/2505] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:22:09 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:09.911135 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febefea7-88de-4a54-845a-454dcfdfbf0a admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:09.938018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:09.946251 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03104081-9f87-4295-97ac-3613ca3d91ac None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:10.001883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febefea7-88de-4a54-845a-454dcfdfbf0a admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:10.008430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0146d90-996c-4f6a-a012-77736d48d9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:10.009392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0146d90-996c-4f6a-a012-77736d48d9db admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:10.009680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0146d90-996c-4f6a-a012-77736d48d9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:10.009953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0146d90-996c-4f6a-a012-77736d48d9db admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:10.010678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0146d90-996c-4f6a-a012-77736d48d9db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:10.012679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0146d90-996c-4f6a-a012-77736d48d9db admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:10.019465 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dac06-e7cf-4097-b6eb-1442ea84ab5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:10.020229 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dac06-e7cf-4097-b6eb-1442ea84ab5c service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:10.020597 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dac06-e7cf-4097-b6eb-1442ea84ab5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:10.020972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941dac06-e7cf-4097-b6eb-1442ea84ab5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:10.024571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-941dac06-e7cf-4097-b6eb-1442ea84ab5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:10.096444 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dac06-e7cf-4097-b6eb-1442ea84ab5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:10.098250 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941dac06-e7cf-4097-b6eb-1442ea84ab5c service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:10.108302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1265/2506] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:22:09 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:10.115352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1242/2507] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:10.115500 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0146d90-996c-4f6a-a012-77736d48d9db admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:10.124217 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0146d90-996c-4f6a-a012-77736d48d9db admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:10.129592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a02559-7e1f-48fe-8e87-102d84f97d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:10.130274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a02559-7e1f-48fe-8e87-102d84f97d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:10.130559 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a02559-7e1f-48fe-8e87-102d84f97d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:10.130837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a02559-7e1f-48fe-8e87-102d84f97d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:10.131686 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a02559-7e1f-48fe-8e87-102d84f97d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:10.133250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a02559-7e1f-48fe-8e87-102d84f97d49 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:10.146648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1266/2508] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 18:22:10.152906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dac06-e7cf-4097-b6eb-1442ea84ab5c service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:10.164323 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941dac06-e7cf-4097-b6eb-1442ea84ab5c service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:10.169030 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185441c-a92e-4f0e-9f93-4bee6899f7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:10.169926 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185441c-a92e-4f0e-9f93-4bee6899f7c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:10.170244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185441c-a92e-4f0e-9f93-4bee6899f7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:10.170569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185441c-a92e-4f0e-9f93-4bee6899f7c5 admin admin] PATH_INFO: `/v3/projects/12103a6258aa449cb05cc87d70d6dc10/users/be4952219ff942b4936b21973ba74c78/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:10.187260 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185441c-a92e-4f0e-9f93-4bee6899f7c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12103a6258aa449cb05cc87d70d6dc10, user_id=be4952219ff942b4936b21973ba74c78, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:10.190259 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185441c-a92e-4f0e-9f93-4bee6899f7c5 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:10.284817 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1243/2509] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:10 2022] PUT /identity/v3/projects/12103a6258aa449cb05cc87d70d6dc10/users/be4952219ff942b4936b21973ba74c78/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:10.288820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a02559-7e1f-48fe-8e87-102d84f97d49 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:10.298723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a02559-7e1f-48fe-8e87-102d84f97d49 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:10.357977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a1f35-21f4-438d-a35a-776788457917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:10.358661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a1f35-21f4-438d-a35a-776788457917 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:10.358947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a1f35-21f4-438d-a35a-776788457917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:10.359231 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a1f35-21f4-438d-a35a-776788457917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:10.360095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a1f35-21f4-438d-a35a-776788457917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:10.364855 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a1f35-21f4-438d-a35a-776788457917 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:10.376617 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1267/2510] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:10.377906 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185441c-a92e-4f0e-9f93-4bee6899f7c5 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:10.390680 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185441c-a92e-4f0e-9f93-4bee6899f7c5 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:10.396223 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8461105-aabf-48c8-bc9d-d4205777e338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:10.397173 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8461105-aabf-48c8-bc9d-d4205777e338 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:10.397459 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8461105-aabf-48c8-bc9d-d4205777e338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:10.397738 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8461105-aabf-48c8-bc9d-d4205777e338 admin admin] PATH_INFO: `/v3/projects/12103a6258aa449cb05cc87d70d6dc10/users/be4952219ff942b4936b21973ba74c78/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:10.399725 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8461105-aabf-48c8-bc9d-d4205777e338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12103a6258aa449cb05cc87d70d6dc10, user_id=be4952219ff942b4936b21973ba74c78, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:10.402580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8461105-aabf-48c8-bc9d-d4205777e338 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:10.413310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1244/2511] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:10 2022] PUT /identity/v3/projects/12103a6258aa449cb05cc87d70d6dc10/users/be4952219ff942b4936b21973ba74c78/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:10.423550 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be34be-aab3-4133-adde-34baf5fd2328 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:10.423836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be34be-aab3-4133-adde-34baf5fd2328 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:10.424112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be34be-aab3-4133-adde-34baf5fd2328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:10.450763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b9be34be-aab3-4133-adde-34baf5fd2328 None None] MFA Rules not processed for user `be4952219ff942b4936b21973ba74c78`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:10.452021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b9be34be-aab3-4133-adde-34baf5fd2328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:10.502136 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:10.524391 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1268/2512] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:22:10.536442 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8461105-aabf-48c8-bc9d-d4205777e338 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:10.592051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8461105-aabf-48c8-bc9d-d4205777e338 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:10.595732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731fe11-7473-4b2e-8207-df5d59d7e788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:10.596375 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731fe11-7473-4b2e-8207-df5d59d7e788 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:10.596755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731fe11-7473-4b2e-8207-df5d59d7e788 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:10.597800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731fe11-7473-4b2e-8207-df5d59d7e788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:10.606788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731fe11-7473-4b2e-8207-df5d59d7e788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:10.608159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731fe11-7473-4b2e-8207-df5d59d7e788 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:10.617693 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1245/2513] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:10.646013 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be34be-aab3-4133-adde-34baf5fd2328 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:10.711905 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be34be-aab3-4133-adde-34baf5fd2328 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:10.716491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920cde2-0cbd-4730-9d5b-e85c291a061d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:10.717401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920cde2-0cbd-4730-9d5b-e85c291a061d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:10.717688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920cde2-0cbd-4730-9d5b-e85c291a061d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:10.717965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920cde2-0cbd-4730-9d5b-e85c291a061d admin admin] PATH_INFO: `/v3/users/fa7110a7721447bca028581c06ed2da1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:10.719152 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920cde2-0cbd-4730-9d5b-e85c291a061d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7110a7721447bca028581c06ed2da1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:10.721112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920cde2-0cbd-4730-9d5b-e85c291a061d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:10.857219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-4920cde2-0cbd-4730-9d5b-e85c291a061d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7110a7721447bca028581c06ed2da1'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:10.924227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-4920cde2-0cbd-4730-9d5b-e85c291a061d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7110a7721447bca028581c06ed2da1'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:10.932442 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-4920cde2-0cbd-4730-9d5b-e85c291a061d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7110a7721447bca028581c06ed2da1'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:10.933142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-4920cde2-0cbd-4730-9d5b-e85c291a061d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7110a7721447bca028581c06ed2da1'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:10.946458 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-4920cde2-0cbd-4730-9d5b-e85c291a061d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7110a7721447bca028581c06ed2da1'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:10.952907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1269/2514] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:10 2022] DELETE /identity/v3/users/fa7110a7721447bca028581c06ed2da1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:10.958286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304275b0-1c8c-4a27-a925-8cba611c55bd None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:10.958578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304275b0-1c8c-4a27-a925-8cba611c55bd None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:10.960068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304275b0-1c8c-4a27-a925-8cba611c55bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:10.978780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-304275b0-1c8c-4a27-a925-8cba611c55bd None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:10.980041 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-304275b0-1c8c-4a27-a925-8cba611c55bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:10.995168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:11.046856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1246/2515] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:11.056875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920cde2-0cbd-4730-9d5b-e85c291a061d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:11.058293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4920cde2-0cbd-4730-9d5b-e85c291a061d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:11.134960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920cde2-0cbd-4730-9d5b-e85c291a061d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:11.142045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dea835-b8a4-4dd3-ba31-0be28f76bd80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:11.142969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dea835-b8a4-4dd3-ba31-0be28f76bd80 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:11.143316 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dea835-b8a4-4dd3-ba31-0be28f76bd80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:11.143697 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dea835-b8a4-4dd3-ba31-0be28f76bd80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:11.154428 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dea835-b8a4-4dd3-ba31-0be28f76bd80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:11.155867 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dea835-b8a4-4dd3-ba31-0be28f76bd80 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:11.169045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1270/2516] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:11.853688 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304275b0-1c8c-4a27-a925-8cba611c55bd None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:11.855762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-304275b0-1c8c-4a27-a925-8cba611c55bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:11.869074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304275b0-1c8c-4a27-a925-8cba611c55bd None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:11.874355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68601fe8-8a59-4725-a025-f1bb6c92a960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:11.875247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68601fe8-8a59-4725-a025-f1bb6c92a960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:11.875534 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68601fe8-8a59-4725-a025-f1bb6c92a960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:11.875846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68601fe8-8a59-4725-a025-f1bb6c92a960 admin admin] PATH_INFO: `/v3/projects/22edc89c41e34077a67885774e3a9344` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:11.877525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68601fe8-8a59-4725-a025-f1bb6c92a960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22edc89c41e34077a67885774e3a9344)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:11.879723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68601fe8-8a59-4725-a025-f1bb6c92a960 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:12.000605 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-68601fe8-8a59-4725-a025-f1bb6c92a960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22edc89c41e34077a67885774e3a9344', 'request_id': 'req-68601fe8-8a59-4725-a025-f1bb6c92a960'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:12.008437 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-68601fe8-8a59-4725-a025-f1bb6c92a960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22edc89c41e34077a67885774e3a9344', 'request_id': 'req-68601fe8-8a59-4725-a025-f1bb6c92a960'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:12.101183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-68601fe8-8a59-4725-a025-f1bb6c92a960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22edc89c41e34077a67885774e3a9344', 'request_id': 'req-68601fe8-8a59-4725-a025-f1bb6c92a960'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:12.113038 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-68601fe8-8a59-4725-a025-f1bb6c92a960 admin admin] The token cache is being invalidate because project 22edc89c41e34077a67885774e3a9344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:12.121961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-68601fe8-8a59-4725-a025-f1bb6c92a960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:12.121961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-68601fe8-8a59-4725-a025-f1bb6c92a960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:12.121961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1247/2517] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:11 2022] DELETE /identity/v3/projects/22edc89c41e34077a67885774e3a9344 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:12.122321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dea835-b8a4-4dd3-ba31-0be28f76bd80 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:12.129689 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dea835-b8a4-4dd3-ba31-0be28f76bd80 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:12.133393 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:12.189573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad10f58-bf61-45e5-976d-e7e0a1eaf7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:12.190995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad10f58-bf61-45e5-976d-e7e0a1eaf7aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:12.191288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad10f58-bf61-45e5-976d-e7e0a1eaf7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:12.191564 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad10f58-bf61-45e5-976d-e7e0a1eaf7aa admin admin] PATH_INFO: `/v3/users/be4952219ff942b4936b21973ba74c78` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:12.192874 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad10f58-bf61-45e5-976d-e7e0a1eaf7aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=be4952219ff942b4936b21973ba74c78)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:12.194837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad10f58-bf61-45e5-976d-e7e0a1eaf7aa admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:12.430561 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9ad10f58-bf61-45e5-976d-e7e0a1eaf7aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be4952219ff942b4936b21973ba74c78'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:12.507058 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9ad10f58-bf61-45e5-976d-e7e0a1eaf7aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be4952219ff942b4936b21973ba74c78'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:12.515193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9ad10f58-bf61-45e5-976d-e7e0a1eaf7aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be4952219ff942b4936b21973ba74c78'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:12.516508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9ad10f58-bf61-45e5-976d-e7e0a1eaf7aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be4952219ff942b4936b21973ba74c78'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:12.530186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9ad10f58-bf61-45e5-976d-e7e0a1eaf7aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be4952219ff942b4936b21973ba74c78'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:12.537663 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1271/2518] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:12 2022] DELETE /identity/v3/users/be4952219ff942b4936b21973ba74c78 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:12.954781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68601fe8-8a59-4725-a025-f1bb6c92a960 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:12.958115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-68601fe8-8a59-4725-a025-f1bb6c92a960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:12.971165 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68601fe8-8a59-4725-a025-f1bb6c92a960 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:13.032085 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84917927-8456-44b2-a4d1-194e0b253db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:13.033386 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84917927-8456-44b2-a4d1-194e0b253db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:13.033673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84917927-8456-44b2-a4d1-194e0b253db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:13.033951 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84917927-8456-44b2-a4d1-194e0b253db3 admin admin] PATH_INFO: `/v3/projects/12103a6258aa449cb05cc87d70d6dc10` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:13.035711 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84917927-8456-44b2-a4d1-194e0b253db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12103a6258aa449cb05cc87d70d6dc10)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:13.037767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84917927-8456-44b2-a4d1-194e0b253db3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:13.185558 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:13.188823 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-84917927-8456-44b2-a4d1-194e0b253db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12103a6258aa449cb05cc87d70d6dc10', 'request_id': 'req-84917927-8456-44b2-a4d1-194e0b253db3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:13.196812 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-84917927-8456-44b2-a4d1-194e0b253db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12103a6258aa449cb05cc87d70d6dc10', 'request_id': 'req-84917927-8456-44b2-a4d1-194e0b253db3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:13.267335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-84917927-8456-44b2-a4d1-194e0b253db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12103a6258aa449cb05cc87d70d6dc10', 'request_id': 'req-84917927-8456-44b2-a4d1-194e0b253db3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:13.291851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-84917927-8456-44b2-a4d1-194e0b253db3 admin admin] The token cache is being invalidate because project 12103a6258aa449cb05cc87d70d6dc10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:13.292569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-84917927-8456-44b2-a4d1-194e0b253db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:13.293678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-84917927-8456-44b2-a4d1-194e0b253db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:13.296068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1248/2519] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:12 2022] DELETE /identity/v3/projects/12103a6258aa449cb05cc87d70d6dc10 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:13.302577 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4322b-bcd1-4ac0-a757-b5015eceea0c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:13.303311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4322b-bcd1-4ac0-a757-b5015eceea0c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:13.303311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4322b-bcd1-4ac0-a757-b5015eceea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:13.330520 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-6eb4322b-bcd1-4ac0-a757-b5015eceea0c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:13.332451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6eb4322b-bcd1-4ac0-a757-b5015eceea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:13.418319 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1272/2520] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:13.427191 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b2b1f-fbee-4ea8-bbbe-664c5eae55a1 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:13.427482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b2b1f-fbee-4ea8-bbbe-664c5eae55a1 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:13.428004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b2b1f-fbee-4ea8-bbbe-664c5eae55a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:13.450483 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a94b2b1f-fbee-4ea8-bbbe-664c5eae55a1 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:13.452668 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a94b2b1f-fbee-4ea8-bbbe-664c5eae55a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:13.468093 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1249/2521] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:13.473001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4322b-bcd1-4ac0-a757-b5015eceea0c None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:13.492325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4322b-bcd1-4ac0-a757-b5015eceea0c None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:13.499306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b6742-790f-48c2-be06-091b7e4a3458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:13.500127 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b6742-790f-48c2-be06-091b7e4a3458 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:13.500599 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b6742-790f-48c2-be06-091b7e4a3458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:13.501123 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b6742-790f-48c2-be06-091b7e4a3458 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:13.502604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b6742-790f-48c2-be06-091b7e4a3458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:22:13.502604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b6742-790f-48c2-be06-091b7e4a3458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:13.504652 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b6742-790f-48c2-be06-091b7e4a3458 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:13.516984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1273/2522] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:22:13.522441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b2b1f-fbee-4ea8-bbbe-664c5eae55a1 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:13.532665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b2b1f-fbee-4ea8-bbbe-664c5eae55a1 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:13.538365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0dfc-6485-4cf0-a338-c2319887fe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:13.545927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0dfc-6485-4cf0-a338-c2319887fe57 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:13.545927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0dfc-6485-4cf0-a338-c2319887fe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:13.545927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0dfc-6485-4cf0-a338-c2319887fe57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:13.545927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d0dfc-6485-4cf0-a338-c2319887fe57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:13.545927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d0dfc-6485-4cf0-a338-c2319887fe57 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:13.657126 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1250/2523] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:22:13 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:13.658311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b6742-790f-48c2-be06-091b7e4a3458 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:13.669278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b6742-790f-48c2-be06-091b7e4a3458 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:13.679065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:13.732426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6414d3-87e7-4516-8560-7a998285de47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:13.733157 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6414d3-87e7-4516-8560-7a998285de47 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:13.733448 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6414d3-87e7-4516-8560-7a998285de47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:13.733731 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6414d3-87e7-4516-8560-7a998285de47 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:13.734531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6414d3-87e7-4516-8560-7a998285de47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:13.736494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6414d3-87e7-4516-8560-7a998285de47 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:13.817238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1274/2524] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:22:13 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:13.821291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0dfc-6485-4cf0-a338-c2319887fe57 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:13.832524 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0dfc-6485-4cf0-a338-c2319887fe57 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:13.838703 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b1c36-7665-43bb-8b4b-8a4c16c8c3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:13.839625 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b1c36-7665-43bb-8b4b-8a4c16c8c3ec admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:13.839914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b1c36-7665-43bb-8b4b-8a4c16c8c3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:13.840194 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b1c36-7665-43bb-8b4b-8a4c16c8c3ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:13.840930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b1c36-7665-43bb-8b4b-8a4c16c8c3ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:13.842779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b1c36-7665-43bb-8b4b-8a4c16c8c3ec admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:13.854415 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1251/2525] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:13.858418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6414d3-87e7-4516-8560-7a998285de47 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:13.869523 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6414d3-87e7-4516-8560-7a998285de47 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:13.875044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f92573-39a9-4025-85a5-b044252bc06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:13.875721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f92573-39a9-4025-85a5-b044252bc06d admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:13.876007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f92573-39a9-4025-85a5-b044252bc06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:13.876292 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f92573-39a9-4025-85a5-b044252bc06d admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:13.877082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f92573-39a9-4025-85a5-b044252bc06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:13.878769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f92573-39a9-4025-85a5-b044252bc06d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:13.891207 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1275/2526] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:13.895915 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b1c36-7665-43bb-8b4b-8a4c16c8c3ec admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:13.907858 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b1c36-7665-43bb-8b4b-8a4c16c8c3ec admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:13.914470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e64f70-bd2a-46ba-8c38-15181854e6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:13.915487 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e64f70-bd2a-46ba-8c38-15181854e6f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:13.915847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e64f70-bd2a-46ba-8c38-15181854e6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:13.916417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e64f70-bd2a-46ba-8c38-15181854e6f7 admin admin] PATH_INFO: `/v3/projects/c2278507b60a4b7e81983e366f941b42/users/cccea24bae1640d29adffa9a05c864a3/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:13.934112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e64f70-bd2a-46ba-8c38-15181854e6f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2278507b60a4b7e81983e366f941b42, user_id=cccea24bae1640d29adffa9a05c864a3, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:13.936881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e64f70-bd2a-46ba-8c38-15181854e6f7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:14.017143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1252/2527] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:13 2022] PUT /identity/v3/projects/c2278507b60a4b7e81983e366f941b42/users/cccea24bae1640d29adffa9a05c864a3/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:14.080107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af74e-141b-4c79-a7e4-139bf0ba28f5 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:14.080400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af74e-141b-4c79-a7e4-139bf0ba28f5 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:14.082615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af74e-141b-4c79-a7e4-139bf0ba28f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:14.125972 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-298af74e-141b-4c79-a7e4-139bf0ba28f5 None None] MFA Rules not processed for user `cccea24bae1640d29adffa9a05c864a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:14.128156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-298af74e-141b-4c79-a7e4-139bf0ba28f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:14.246437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1276/2528] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:14.251563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e64f70-bd2a-46ba-8c38-15181854e6f7 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:14.346613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e64f70-bd2a-46ba-8c38-15181854e6f7 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:14.357391 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea12ec-3ff0-4297-ae11-8acecb7d2731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:14.357391 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea12ec-3ff0-4297-ae11-8acecb7d2731 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:14.357391 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea12ec-3ff0-4297-ae11-8acecb7d2731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:14.357391 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea12ec-3ff0-4297-ae11-8acecb7d2731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:14.357845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea12ec-3ff0-4297-ae11-8acecb7d2731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:14.358567 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea12ec-3ff0-4297-ae11-8acecb7d2731 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:14.481330 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1253/2529] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:22:14 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:14.485567 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af74e-141b-4c79-a7e4-139bf0ba28f5 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:14.502148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af74e-141b-4c79-a7e4-139bf0ba28f5 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:14.577302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c8d36-0b43-4647-a345-9c8d58ce1cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:14.578000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c8d36-0b43-4647-a345-9c8d58ce1cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:14.578361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c8d36-0b43-4647-a345-9c8d58ce1cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:14.578580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c8d36-0b43-4647-a345-9c8d58ce1cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:14.579288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c8d36-0b43-4647-a345-9c8d58ce1cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:14.581944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c8d36-0b43-4647-a345-9c8d58ce1cc6 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:14.668307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1277/2530] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:22:14 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:22:14.676689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea12ec-3ff0-4297-ae11-8acecb7d2731 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:14.687551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea12ec-3ff0-4297-ae11-8acecb7d2731 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:14.693106 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed717a37-4035-4dd4-a3f4-7ab61f42305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:14.693773 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed717a37-4035-4dd4-a3f4-7ab61f42305b admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:14.694054 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed717a37-4035-4dd4-a3f4-7ab61f42305b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:14.694328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed717a37-4035-4dd4-a3f4-7ab61f42305b admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:14.695081 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed717a37-4035-4dd4-a3f4-7ab61f42305b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:14.696658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed717a37-4035-4dd4-a3f4-7ab61f42305b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:14.707480 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1254/2531] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:14.711591 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c8d36-0b43-4647-a345-9c8d58ce1cc6 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:14.721715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c8d36-0b43-4647-a345-9c8d58ce1cc6 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:14.727302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ddf5a-5d5c-4e8e-9f3d-a39ceeb954d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:14.727971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ddf5a-5d5c-4e8e-9f3d-a39ceeb954d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:14.728308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ddf5a-5d5c-4e8e-9f3d-a39ceeb954d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:14.728594 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ddf5a-5d5c-4e8e-9f3d-a39ceeb954d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:14.729368 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ddf5a-5d5c-4e8e-9f3d-a39ceeb954d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:14.730984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ddf5a-5d5c-4e8e-9f3d-a39ceeb954d1 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:14.736208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:14.741921 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1278/2532] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:14.746005 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed717a37-4035-4dd4-a3f4-7ab61f42305b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:14.756591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed717a37-4035-4dd4-a3f4-7ab61f42305b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:14.771568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a1fb-8510-4be1-8be2-0316e8dda8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:14.771568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a1fb-8510-4be1-8be2-0316e8dda8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:14.771568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a1fb-8510-4be1-8be2-0316e8dda8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:14.771568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92a1fb-8510-4be1-8be2-0316e8dda8f1 admin admin] PATH_INFO: `/v3/projects/712e760a5cc8472fab481d46a076d875/users/05234144c965499c815029def5a8cae4/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:14.778778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92a1fb-8510-4be1-8be2-0316e8dda8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=712e760a5cc8472fab481d46a076d875, user_id=05234144c965499c815029def5a8cae4, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:14.781889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92a1fb-8510-4be1-8be2-0316e8dda8f1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:14.872852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1255/2533] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:14 2022] PUT /identity/v3/projects/712e760a5cc8472fab481d46a076d875/users/05234144c965499c815029def5a8cae4/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:22:14.875126 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af69bf-a0d8-4364-bdf4-2ebdd94376ab None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:14.875805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af69bf-a0d8-4364-bdf4-2ebdd94376ab None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:14.876264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af69bf-a0d8-4364-bdf4-2ebdd94376ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:14.911660 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b7af69bf-a0d8-4364-bdf4-2ebdd94376ab None None] MFA Rules not processed for user `05234144c965499c815029def5a8cae4`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:14.912889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b7af69bf-a0d8-4364-bdf4-2ebdd94376ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:14.998681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1279/2534] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:15.004075 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a1fb-8510-4be1-8be2-0316e8dda8f1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:15.026873 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:15.069379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92a1fb-8510-4be1-8be2-0316e8dda8f1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:15.074978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e98c15-b4b7-441b-9b1f-29700a10c099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:15.075648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e98c15-b4b7-441b-9b1f-29700a10c099 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:15.075931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e98c15-b4b7-441b-9b1f-29700a10c099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:15.076207 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e98c15-b4b7-441b-9b1f-29700a10c099 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:15.076910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e98c15-b4b7-441b-9b1f-29700a10c099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:15.078926 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e98c15-b4b7-441b-9b1f-29700a10c099 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:15.194044 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1256/2535] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:22:15 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:15.195344 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af69bf-a0d8-4364-bdf4-2ebdd94376ab None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:15.208807 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af69bf-a0d8-4364-bdf4-2ebdd94376ab None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:15.317667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fb642-4abc-46e8-a8b8-00370e5a51ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:15.317667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb642-4abc-46e8-a8b8-00370e5a51ae admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:15.317667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb642-4abc-46e8-a8b8-00370e5a51ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:15.317667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb642-4abc-46e8-a8b8-00370e5a51ae admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:15.318122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fb642-4abc-46e8-a8b8-00370e5a51ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:15.318122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fb642-4abc-46e8-a8b8-00370e5a51ae admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:15.437027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1280/2536] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:22:15 2022] POST /identity/v3/users => generated 296 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:22:15.438374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e98c15-b4b7-441b-9b1f-29700a10c099 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:15.449282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e98c15-b4b7-441b-9b1f-29700a10c099 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:15.454514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624fe18-519e-4ecb-9639-55f28b979f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:15.455555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624fe18-519e-4ecb-9639-55f28b979f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:15.456098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624fe18-519e-4ecb-9639-55f28b979f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:15.456601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624fe18-519e-4ecb-9639-55f28b979f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:15.457622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624fe18-519e-4ecb-9639-55f28b979f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:15.459812 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624fe18-519e-4ecb-9639-55f28b979f32 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:15.473008 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1257/2537] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 18:22:15.480471 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fb642-4abc-46e8-a8b8-00370e5a51ae admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:15.493133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fb642-4abc-46e8-a8b8-00370e5a51ae admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:15.499667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a7fd4-534a-489f-8bd3-b93c10644204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:15.501142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a7fd4-534a-489f-8bd3-b93c10644204 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:15.501610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a7fd4-534a-489f-8bd3-b93c10644204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:15.502057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a7fd4-534a-489f-8bd3-b93c10644204 admin admin] PATH_INFO: `/v3/projects/0730d030278743fa9a695e2941065e2f/users/ff8d2596f84841ad9b9edd90dc53f10e/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:15.521350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a7fd4-534a-489f-8bd3-b93c10644204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0730d030278743fa9a695e2941065e2f, user_id=ff8d2596f84841ad9b9edd90dc53f10e, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:15.524104 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a7fd4-534a-489f-8bd3-b93c10644204 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:15.612073 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1281/2538] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:15 2022] PUT /identity/v3/projects/0730d030278743fa9a695e2941065e2f/users/ff8d2596f84841ad9b9edd90dc53f10e/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:15.616034 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624fe18-519e-4ecb-9639-55f28b979f32 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:15.628371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624fe18-519e-4ecb-9639-55f28b979f32 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:15.694164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d8913-4287-4832-9a9e-43fc2154578a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:15.695165 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d8913-4287-4832-9a9e-43fc2154578a admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:15.695551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d8913-4287-4832-9a9e-43fc2154578a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:15.695930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d8913-4287-4832-9a9e-43fc2154578a admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:15.696767 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d8913-4287-4832-9a9e-43fc2154578a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:15.698516 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d8913-4287-4832-9a9e-43fc2154578a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:15.710222 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1258/2539] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:15.714667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a7fd4-534a-489f-8bd3-b93c10644204 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:15.727086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a7fd4-534a-489f-8bd3-b93c10644204 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:15.733284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28370ba-8549-46c8-a6db-75d91d13c2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:15.734437 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28370ba-8549-46c8-a6db-75d91d13c2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:15.735066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28370ba-8549-46c8-a6db-75d91d13c2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:15.735206 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28370ba-8549-46c8-a6db-75d91d13c2a6 admin admin] PATH_INFO: `/v3/projects/0730d030278743fa9a695e2941065e2f/users/ff8d2596f84841ad9b9edd90dc53f10e/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:15.737480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28370ba-8549-46c8-a6db-75d91d13c2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0730d030278743fa9a695e2941065e2f, user_id=ff8d2596f84841ad9b9edd90dc53f10e, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:15.740363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28370ba-8549-46c8-a6db-75d91d13c2a6 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:15.756566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1282/2540] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:15 2022] PUT /identity/v3/projects/0730d030278743fa9a695e2941065e2f/users/ff8d2596f84841ad9b9edd90dc53f10e/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:15.767953 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f59578-24e7-4754-8a4d-f75271cc018c None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:15.768248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f59578-24e7-4754-8a4d-f75271cc018c None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:15.768535 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f59578-24e7-4754-8a4d-f75271cc018c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:15.804828 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e1f59578-24e7-4754-8a4d-f75271cc018c None None] MFA Rules not processed for user `ff8d2596f84841ad9b9edd90dc53f10e`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:15.806193 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e1f59578-24e7-4754-8a4d-f75271cc018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:15.889961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1259/2541] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:15.903350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28370ba-8549-46c8-a6db-75d91d13c2a6 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:15.905103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b28370ba-8549-46c8-a6db-75d91d13c2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:15.955693 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:15.969090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28370ba-8549-46c8-a6db-75d91d13c2a6 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:15.973331 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108f58c-3511-4959-869c-fef068fa8eb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:15.973989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108f58c-3511-4959-869c-fef068fa8eb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:15.974274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108f58c-3511-4959-869c-fef068fa8eb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:15.974556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108f58c-3511-4959-869c-fef068fa8eb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:15.983715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108f58c-3511-4959-869c-fef068fa8eb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:15.985172 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108f58c-3511-4959-869c-fef068fa8eb3 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:15.994825 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1283/2542] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:16.092838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f59578-24e7-4754-8a4d-f75271cc018c None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:16.094419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e1f59578-24e7-4754-8a4d-f75271cc018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:16.108046 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f59578-24e7-4754-8a4d-f75271cc018c None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:16.112006 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02cf79-53fb-4478-ac23-e44a8eca879d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:16.113409 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02cf79-53fb-4478-ac23-e44a8eca879d service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:16.113409 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02cf79-53fb-4478-ac23-e44a8eca879d service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:16.114125 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02cf79-53fb-4478-ac23-e44a8eca879d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:16.126242 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:16.173426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02cf79-53fb-4478-ac23-e44a8eca879d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:16.175713 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02cf79-53fb-4478-ac23-e44a8eca879d service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:16.188281 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1260/2543] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:16.256735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108f58c-3511-4959-869c-fef068fa8eb3 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:16.258240 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8108f58c-3511-4959-869c-fef068fa8eb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:16.340720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108f58c-3511-4959-869c-fef068fa8eb3 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:16.345792 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39188df9-d6ad-4ad0-a3e9-7ff5e2b237b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:16.347574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39188df9-d6ad-4ad0-a3e9-7ff5e2b237b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:16.348090 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39188df9-d6ad-4ad0-a3e9-7ff5e2b237b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:16.348443 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39188df9-d6ad-4ad0-a3e9-7ff5e2b237b3 admin admin] PATH_INFO: `/v3/users/e5743a51a07342fca9ce5efed60bef53` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:16.349904 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39188df9-d6ad-4ad0-a3e9-7ff5e2b237b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5743a51a07342fca9ce5efed60bef53)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:16.352137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39188df9-d6ad-4ad0-a3e9-7ff5e2b237b3 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:16.547008 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-39188df9-d6ad-4ad0-a3e9-7ff5e2b237b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5743a51a07342fca9ce5efed60bef53'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:16.616055 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-39188df9-d6ad-4ad0-a3e9-7ff5e2b237b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5743a51a07342fca9ce5efed60bef53'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:16.624163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-39188df9-d6ad-4ad0-a3e9-7ff5e2b237b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5743a51a07342fca9ce5efed60bef53'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:16.624851 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-39188df9-d6ad-4ad0-a3e9-7ff5e2b237b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5743a51a07342fca9ce5efed60bef53'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:16.637570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-39188df9-d6ad-4ad0-a3e9-7ff5e2b237b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5743a51a07342fca9ce5efed60bef53'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:16.643622 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1284/2544] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:16 2022] DELETE /identity/v3/users/e5743a51a07342fca9ce5efed60bef53 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:16.649431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef0d19-c056-4769-8a80-2d57c01ae7f7 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:16.649671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef0d19-c056-4769-8a80-2d57c01ae7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:16.649959 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef0d19-c056-4769-8a80-2d57c01ae7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:16.667776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-baef0d19-c056-4769-8a80-2d57c01ae7f7 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:16.669019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-baef0d19-c056-4769-8a80-2d57c01ae7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:16.729058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1261/2545] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:16.739347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39188df9-d6ad-4ad0-a3e9-7ff5e2b237b3 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:16.740755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-39188df9-d6ad-4ad0-a3e9-7ff5e2b237b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:16.798912 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39188df9-d6ad-4ad0-a3e9-7ff5e2b237b3 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:16.802988 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb17915-48d8-4f94-b5fb-14921301ef50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:16.803635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb17915-48d8-4f94-b5fb-14921301ef50 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:16.803913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb17915-48d8-4f94-b5fb-14921301ef50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:16.804191 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb17915-48d8-4f94-b5fb-14921301ef50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:16.813221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb17915-48d8-4f94-b5fb-14921301ef50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:16.814651 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb17915-48d8-4f94-b5fb-14921301ef50 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:16.824688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1285/2546] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:17.294844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef0d19-c056-4769-8a80-2d57c01ae7f7 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:17.297407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-baef0d19-c056-4769-8a80-2d57c01ae7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:17.310442 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef0d19-c056-4769-8a80-2d57c01ae7f7 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:17.315033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5029ecd-ae32-4357-95c7-28d42efa75a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:17.316187 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5029ecd-ae32-4357-95c7-28d42efa75a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:17.316631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5029ecd-ae32-4357-95c7-28d42efa75a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:17.316899 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5029ecd-ae32-4357-95c7-28d42efa75a4 admin admin] PATH_INFO: `/v3/projects/6e3e0cfcdc984d6894430ec637152380` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:17.318244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5029ecd-ae32-4357-95c7-28d42efa75a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e3e0cfcdc984d6894430ec637152380)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:17.320128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5029ecd-ae32-4357-95c7-28d42efa75a4 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:17.429632 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a5029ecd-ae32-4357-95c7-28d42efa75a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e3e0cfcdc984d6894430ec637152380', 'request_id': 'req-a5029ecd-ae32-4357-95c7-28d42efa75a4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:17.436371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a5029ecd-ae32-4357-95c7-28d42efa75a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e3e0cfcdc984d6894430ec637152380', 'request_id': 'req-a5029ecd-ae32-4357-95c7-28d42efa75a4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:17.489881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a5029ecd-ae32-4357-95c7-28d42efa75a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e3e0cfcdc984d6894430ec637152380', 'request_id': 'req-a5029ecd-ae32-4357-95c7-28d42efa75a4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:17.500842 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a5029ecd-ae32-4357-95c7-28d42efa75a4 admin admin] The token cache is being invalidate because project 6e3e0cfcdc984d6894430ec637152380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:17.501162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a5029ecd-ae32-4357-95c7-28d42efa75a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:17.501786 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a5029ecd-ae32-4357-95c7-28d42efa75a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:17.503886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1262/2547] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:17 2022] DELETE /identity/v3/projects/6e3e0cfcdc984d6894430ec637152380 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:17.507985 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb17915-48d8-4f94-b5fb-14921301ef50 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:17.517794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb17915-48d8-4f94-b5fb-14921301ef50 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:17.522294 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:17.576128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56247a-8294-4d26-983b-d96321616bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:17.577140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56247a-8294-4d26-983b-d96321616bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:17.582046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56247a-8294-4d26-983b-d96321616bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:17.582046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56247a-8294-4d26-983b-d96321616bbe admin admin] PATH_INFO: `/v3/users/effe306002e840569b0e1edef04bcd02` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:17.582046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56247a-8294-4d26-983b-d96321616bbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=effe306002e840569b0e1edef04bcd02)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:17.582046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56247a-8294-4d26-983b-d96321616bbe admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:17.710479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2a56247a-8294-4d26-983b-d96321616bbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'effe306002e840569b0e1edef04bcd02'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:17.752815 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2a56247a-8294-4d26-983b-d96321616bbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'effe306002e840569b0e1edef04bcd02'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:17.761375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2a56247a-8294-4d26-983b-d96321616bbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'effe306002e840569b0e1edef04bcd02'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:17.762085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2a56247a-8294-4d26-983b-d96321616bbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'effe306002e840569b0e1edef04bcd02'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:17.775289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-2a56247a-8294-4d26-983b-d96321616bbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'effe306002e840569b0e1edef04bcd02'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:17.781361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1286/2548] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:17 2022] DELETE /identity/v3/users/effe306002e840569b0e1edef04bcd02 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:18.292642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5029ecd-ae32-4357-95c7-28d42efa75a4 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:18.295466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a5029ecd-ae32-4357-95c7-28d42efa75a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:18.311083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5029ecd-ae32-4357-95c7-28d42efa75a4 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:18.363555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:18.386513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aba1cf-2d1e-4167-8afd-915569b5b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:18.387617 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aba1cf-2d1e-4167-8afd-915569b5b577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:18.388247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aba1cf-2d1e-4167-8afd-915569b5b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:18.388567 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aba1cf-2d1e-4167-8afd-915569b5b577 admin admin] PATH_INFO: `/v3/projects/1b80ce8a51634eda97a2c9c3e2139c01` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:18.389794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aba1cf-2d1e-4167-8afd-915569b5b577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b80ce8a51634eda97a2c9c3e2139c01)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:18.391727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aba1cf-2d1e-4167-8afd-915569b5b577 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:18.525476 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-28aba1cf-2d1e-4167-8afd-915569b5b577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b80ce8a51634eda97a2c9c3e2139c01', 'request_id': 'req-28aba1cf-2d1e-4167-8afd-915569b5b577'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:18.531819 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-28aba1cf-2d1e-4167-8afd-915569b5b577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b80ce8a51634eda97a2c9c3e2139c01', 'request_id': 'req-28aba1cf-2d1e-4167-8afd-915569b5b577'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:18.609885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-28aba1cf-2d1e-4167-8afd-915569b5b577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b80ce8a51634eda97a2c9c3e2139c01', 'request_id': 'req-28aba1cf-2d1e-4167-8afd-915569b5b577'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:18.620905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-28aba1cf-2d1e-4167-8afd-915569b5b577 admin admin] The token cache is being invalidate because project 1b80ce8a51634eda97a2c9c3e2139c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:18.621215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-28aba1cf-2d1e-4167-8afd-915569b5b577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:18.621839 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-28aba1cf-2d1e-4167-8afd-915569b5b577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:18.623366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1263/2549] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:18 2022] DELETE /identity/v3/projects/1b80ce8a51634eda97a2c9c3e2139c01 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:18.627448 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56247a-8294-4d26-983b-d96321616bbe admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:18.628993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-2a56247a-8294-4d26-983b-d96321616bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:18.642027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56247a-8294-4d26-983b-d96321616bbe admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:18.700853 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49442cab-c93e-4399-a167-27ff107be0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:18.701759 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49442cab-c93e-4399-a167-27ff107be0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:18.702040 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49442cab-c93e-4399-a167-27ff107be0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:18.702316 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49442cab-c93e-4399-a167-27ff107be0e4 admin admin] PATH_INFO: `/v3/users/ebf77f3040d04bfcac1aa410ed6e952b` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:18.703517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49442cab-c93e-4399-a167-27ff107be0e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf77f3040d04bfcac1aa410ed6e952b)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:18.705528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49442cab-c93e-4399-a167-27ff107be0e4 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:18.828780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:18.904482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-49442cab-c93e-4399-a167-27ff107be0e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf77f3040d04bfcac1aa410ed6e952b'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:18.981893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-49442cab-c93e-4399-a167-27ff107be0e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf77f3040d04bfcac1aa410ed6e952b'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:18.989704 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-49442cab-c93e-4399-a167-27ff107be0e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf77f3040d04bfcac1aa410ed6e952b'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:18.990341 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-49442cab-c93e-4399-a167-27ff107be0e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf77f3040d04bfcac1aa410ed6e952b'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:19.002338 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-49442cab-c93e-4399-a167-27ff107be0e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf77f3040d04bfcac1aa410ed6e952b'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:19.008788 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1287/2550] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:18 2022] DELETE /identity/v3/users/ebf77f3040d04bfcac1aa410ed6e952b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:19.463206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aba1cf-2d1e-4167-8afd-915569b5b577 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:19.467347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-28aba1cf-2d1e-4167-8afd-915569b5b577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:19.479477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aba1cf-2d1e-4167-8afd-915569b5b577 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:19.550670 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc345077-475a-424b-85e2-c68a9e5436ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:19.551883 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc345077-475a-424b-85e2-c68a9e5436ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:19.555287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc345077-475a-424b-85e2-c68a9e5436ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:19.555287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc345077-475a-424b-85e2-c68a9e5436ed admin admin] PATH_INFO: `/v3/projects/836d070843c1408fa1446be69f4f0435` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:19.555287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc345077-475a-424b-85e2-c68a9e5436ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=836d070843c1408fa1446be69f4f0435)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:19.556578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc345077-475a-424b-85e2-c68a9e5436ed admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:19.682444 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bc345077-475a-424b-85e2-c68a9e5436ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836d070843c1408fa1446be69f4f0435', 'request_id': 'req-bc345077-475a-424b-85e2-c68a9e5436ed'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:19.688954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bc345077-475a-424b-85e2-c68a9e5436ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836d070843c1408fa1446be69f4f0435', 'request_id': 'req-bc345077-475a-424b-85e2-c68a9e5436ed'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:19.776091 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bc345077-475a-424b-85e2-c68a9e5436ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836d070843c1408fa1446be69f4f0435', 'request_id': 'req-bc345077-475a-424b-85e2-c68a9e5436ed'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:19.783638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:19.789373 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bc345077-475a-424b-85e2-c68a9e5436ed admin admin] The token cache is being invalidate because project 836d070843c1408fa1446be69f4f0435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:19.789670 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bc345077-475a-424b-85e2-c68a9e5436ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:19.790515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bc345077-475a-424b-85e2-c68a9e5436ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:19.791860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1264/2551] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:19 2022] DELETE /identity/v3/projects/836d070843c1408fa1446be69f4f0435 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:19.796856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5534113-9e51-464d-9d08-7e186db06e18 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:19.797409 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5534113-9e51-464d-9d08-7e186db06e18 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:19.797588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5534113-9e51-464d-9d08-7e186db06e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:19.817561 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-a5534113-9e51-464d-9d08-7e186db06e18 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:19.818774 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a5534113-9e51-464d-9d08-7e186db06e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:19.883349 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1288/2552] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:19.891386 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f6c15-5ff1-4461-8585-7b1d6f061652 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:19.891685 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f6c15-5ff1-4461-8585-7b1d6f061652 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:19.891971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f6c15-5ff1-4461-8585-7b1d6f061652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:19.911537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c34f6c15-5ff1-4461-8585-7b1d6f061652 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:19.917359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c34f6c15-5ff1-4461-8585-7b1d6f061652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:19.920669 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1265/2553] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:22:19.925239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5534113-9e51-464d-9d08-7e186db06e18 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:19.935113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5534113-9e51-464d-9d08-7e186db06e18 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:19.940418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e484b2e-36f8-4798-9ab8-f55f79fecf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:19.940418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e484b2e-36f8-4798-9ab8-f55f79fecf60 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:19.941330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e484b2e-36f8-4798-9ab8-f55f79fecf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:19.941454 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e484b2e-36f8-4798-9ab8-f55f79fecf60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:19.942095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e484b2e-36f8-4798-9ab8-f55f79fecf60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:22:19.942396 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e484b2e-36f8-4798-9ab8-f55f79fecf60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:19.944007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e484b2e-36f8-4798-9ab8-f55f79fecf60 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:19.955665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1289/2554] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:22:19.968256 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f6c15-5ff1-4461-8585-7b1d6f061652 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:19.978345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f6c15-5ff1-4461-8585-7b1d6f061652 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:19.984792 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84e3d0-07fb-4d81-a9a9-fdb57970c0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:19.986436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84e3d0-07fb-4d81-a9a9-fdb57970c0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:19.986436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84e3d0-07fb-4d81-a9a9-fdb57970c0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:19.986436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84e3d0-07fb-4d81-a9a9-fdb57970c0e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:19.986908 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84e3d0-07fb-4d81-a9a9-fdb57970c0e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:19.989116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84e3d0-07fb-4d81-a9a9-fdb57970c0e0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:20.096377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1266/2555] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:22:19 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:20.097917 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e484b2e-36f8-4798-9ab8-f55f79fecf60 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:20.109022 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e484b2e-36f8-4798-9ab8-f55f79fecf60 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:20.166826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190f535-d45d-4eec-9a33-b6a30965d074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:20.167587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190f535-d45d-4eec-9a33-b6a30965d074 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:20.167891 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190f535-d45d-4eec-9a33-b6a30965d074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:20.168174 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190f535-d45d-4eec-9a33-b6a30965d074 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:20.168910 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190f535-d45d-4eec-9a33-b6a30965d074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:20.170887 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190f535-d45d-4eec-9a33-b6a30965d074 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:20.279461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1290/2556] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:22:20 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:22:20.283658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84e3d0-07fb-4d81-a9a9-fdb57970c0e0 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:20.294366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84e3d0-07fb-4d81-a9a9-fdb57970c0e0 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:20.299013 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a13082-d0b5-4d2a-ad6d-ed61c448b826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:20.299688 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a13082-d0b5-4d2a-ad6d-ed61c448b826 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:20.299977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a13082-d0b5-4d2a-ad6d-ed61c448b826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:20.300750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a13082-d0b5-4d2a-ad6d-ed61c448b826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:20.301781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a13082-d0b5-4d2a-ad6d-ed61c448b826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:20.303385 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a13082-d0b5-4d2a-ad6d-ed61c448b826 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:20.313808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1267/2557] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 18:22:20.318827 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190f535-d45d-4eec-9a33-b6a30965d074 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:20.329681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190f535-d45d-4eec-9a33-b6a30965d074 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:20.334541 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd815b-cff5-4bda-bbab-7886e7eca5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:20.335210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd815b-cff5-4bda-bbab-7886e7eca5ea admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:20.335610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd815b-cff5-4bda-bbab-7886e7eca5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:20.335888 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd815b-cff5-4bda-bbab-7886e7eca5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:20.337257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd815b-cff5-4bda-bbab-7886e7eca5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:20.338265 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd815b-cff5-4bda-bbab-7886e7eca5ea admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:20.349347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1291/2558] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:20.353757 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a13082-d0b5-4d2a-ad6d-ed61c448b826 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:20.364623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a13082-d0b5-4d2a-ad6d-ed61c448b826 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:20.369580 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cb11e-dc8c-467e-ac72-cba4992a211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:20.370585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb11e-dc8c-467e-ac72-cba4992a211c admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:20.370868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb11e-dc8c-467e-ac72-cba4992a211c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:20.371144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb11e-dc8c-467e-ac72-cba4992a211c admin admin] PATH_INFO: `/v3/projects/c6ac07e01ba54580a05c52b60f5aa4e2/users/1e10cf32263c4cf68a61db232f59809b/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:20.386444 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cb11e-dc8c-467e-ac72-cba4992a211c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ac07e01ba54580a05c52b60f5aa4e2, user_id=1e10cf32263c4cf68a61db232f59809b, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:20.389139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cb11e-dc8c-467e-ac72-cba4992a211c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:20.467122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1268/2559] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:20 2022] PUT /identity/v3/projects/c6ac07e01ba54580a05c52b60f5aa4e2/users/1e10cf32263c4cf68a61db232f59809b/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:20.478055 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6d3d1-7be3-405f-8424-e7e6b0802d3c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:20.478349 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6d3d1-7be3-405f-8424-e7e6b0802d3c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:20.478634 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6d3d1-7be3-405f-8424-e7e6b0802d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:20.498907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:20.507047 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-3ff6d3d1-7be3-405f-8424-e7e6b0802d3c None None] MFA Rules not processed for user `1e10cf32263c4cf68a61db232f59809b`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:20.508335 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3ff6d3d1-7be3-405f-8424-e7e6b0802d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:20.572857 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1292/2560] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:20.585047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cb11e-dc8c-467e-ac72-cba4992a211c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:20.586865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9c0cb11e-dc8c-467e-ac72-cba4992a211c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:20.647280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cb11e-dc8c-467e-ac72-cba4992a211c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:20.651135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0a869-d8a4-428d-b506-95fa8b09d21e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:20.651789 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0a869-d8a4-428d-b506-95fa8b09d21e service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:20.652078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0a869-d8a4-428d-b506-95fa8b09d21e service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:20.652360 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0a869-d8a4-428d-b506-95fa8b09d21e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:20.661315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0a869-d8a4-428d-b506-95fa8b09d21e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:20.662754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0a869-d8a4-428d-b506-95fa8b09d21e service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:20.671651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1269/2561] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:22:21.186678 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6d3d1-7be3-405f-8424-e7e6b0802d3c None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:21.188189 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3ff6d3d1-7be3-405f-8424-e7e6b0802d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:21.252770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6d3d1-7be3-405f-8424-e7e6b0802d3c None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:21.262359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a13aa-cc95-4014-9e22-85c9b3bb1fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:21.262359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a13aa-cc95-4014-9e22-85c9b3bb1fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:21.262359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a13aa-cc95-4014-9e22-85c9b3bb1fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:21.262359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a13aa-cc95-4014-9e22-85c9b3bb1fb4 admin admin] PATH_INFO: `/v3/users/cccea24bae1640d29adffa9a05c864a3` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:21.262859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a13aa-cc95-4014-9e22-85c9b3bb1fb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cccea24bae1640d29adffa9a05c864a3)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:21.262859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a13aa-cc95-4014-9e22-85c9b3bb1fb4 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:21.452342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c09a13aa-cc95-4014-9e22-85c9b3bb1fb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cccea24bae1640d29adffa9a05c864a3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:21.518661 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c09a13aa-cc95-4014-9e22-85c9b3bb1fb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cccea24bae1640d29adffa9a05c864a3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:21.526749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c09a13aa-cc95-4014-9e22-85c9b3bb1fb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cccea24bae1640d29adffa9a05c864a3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:21.527376 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c09a13aa-cc95-4014-9e22-85c9b3bb1fb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cccea24bae1640d29adffa9a05c864a3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:21.539568 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c09a13aa-cc95-4014-9e22-85c9b3bb1fb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cccea24bae1640d29adffa9a05c864a3'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:21.545601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1293/2562] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:21 2022] DELETE /identity/v3/users/cccea24bae1640d29adffa9a05c864a3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:21.550148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351c5ca-6691-433d-9b0b-5bac48025002 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:21.550684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351c5ca-6691-433d-9b0b-5bac48025002 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:21.550800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351c5ca-6691-433d-9b0b-5bac48025002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:21.568461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1351c5ca-6691-433d-9b0b-5bac48025002 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:21.569699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1351c5ca-6691-433d-9b0b-5bac48025002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:21.629008 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1270/2563] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:21.638718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a13aa-cc95-4014-9e22-85c9b3bb1fb4 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:21.640176 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-c09a13aa-cc95-4014-9e22-85c9b3bb1fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:21.662217 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:21.697850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a13aa-cc95-4014-9e22-85c9b3bb1fb4 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:21.701574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c28b91-68da-40fd-881c-10c806cdcb43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:21.702222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c28b91-68da-40fd-881c-10c806cdcb43 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:21.702503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c28b91-68da-40fd-881c-10c806cdcb43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:21.702778 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c28b91-68da-40fd-881c-10c806cdcb43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:21.712071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c28b91-68da-40fd-881c-10c806cdcb43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:21.713553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c28b91-68da-40fd-881c-10c806cdcb43 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:21.723089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1294/2564] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:22.114579 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351c5ca-6691-433d-9b0b-5bac48025002 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:22.116018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1351c5ca-6691-433d-9b0b-5bac48025002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:22.127975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351c5ca-6691-433d-9b0b-5bac48025002 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:22.132658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ac369-e855-4fe9-98e9-b93cb4e93ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:22.133649 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ac369-e855-4fe9-98e9-b93cb4e93ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:22.133929 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ac369-e855-4fe9-98e9-b93cb4e93ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:22.134200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ac369-e855-4fe9-98e9-b93cb4e93ac9 admin admin] PATH_INFO: `/v3/projects/c2278507b60a4b7e81983e366f941b42` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:22.135396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ac369-e855-4fe9-98e9-b93cb4e93ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2278507b60a4b7e81983e366f941b42)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:22.137362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ac369-e855-4fe9-98e9-b93cb4e93ac9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:22.267843 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:22.280264 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-318ac369-e855-4fe9-98e9-b93cb4e93ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2278507b60a4b7e81983e366f941b42', 'request_id': 'req-318ac369-e855-4fe9-98e9-b93cb4e93ac9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:22.287051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-318ac369-e855-4fe9-98e9-b93cb4e93ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2278507b60a4b7e81983e366f941b42', 'request_id': 'req-318ac369-e855-4fe9-98e9-b93cb4e93ac9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:22.352737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-318ac369-e855-4fe9-98e9-b93cb4e93ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2278507b60a4b7e81983e366f941b42', 'request_id': 'req-318ac369-e855-4fe9-98e9-b93cb4e93ac9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:22.364248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-318ac369-e855-4fe9-98e9-b93cb4e93ac9 admin admin] The token cache is being invalidate because project c2278507b60a4b7e81983e366f941b42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:22.364508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-318ac369-e855-4fe9-98e9-b93cb4e93ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:22.365205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-318ac369-e855-4fe9-98e9-b93cb4e93ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:22.366742 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1271/2565] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:22 2022] DELETE /identity/v3/projects/c2278507b60a4b7e81983e366f941b42 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:22.370725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c28b91-68da-40fd-881c-10c806cdcb43 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:22.380688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c28b91-68da-40fd-881c-10c806cdcb43 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:22.438600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18680366-4ac4-4d84-a942-170607e67f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:22.439515 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18680366-4ac4-4d84-a942-170607e67f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:22.439801 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18680366-4ac4-4d84-a942-170607e67f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:22.440096 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18680366-4ac4-4d84-a942-170607e67f75 admin admin] PATH_INFO: `/v3/users/05234144c965499c815029def5a8cae4` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:22.441331 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18680366-4ac4-4d84-a942-170607e67f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05234144c965499c815029def5a8cae4)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:22.443261 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18680366-4ac4-4d84-a942-170607e67f75 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:22.670223 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-18680366-4ac4-4d84-a942-170607e67f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05234144c965499c815029def5a8cae4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:22.758612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-18680366-4ac4-4d84-a942-170607e67f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05234144c965499c815029def5a8cae4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:22.765829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-18680366-4ac4-4d84-a942-170607e67f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05234144c965499c815029def5a8cae4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:22.766517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-18680366-4ac4-4d84-a942-170607e67f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05234144c965499c815029def5a8cae4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:22.779187 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-18680366-4ac4-4d84-a942-170607e67f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05234144c965499c815029def5a8cae4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:22.785560 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1295/2566] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:22 2022] DELETE /identity/v3/users/05234144c965499c815029def5a8cae4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:23.258168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ac369-e855-4fe9-98e9-b93cb4e93ac9 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:23.259738 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-318ac369-e855-4fe9-98e9-b93cb4e93ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:23.275854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ac369-e855-4fe9-98e9-b93cb4e93ac9 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:23.335975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb073-40e0-445a-804b-6c159bfb2d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:23.336847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb073-40e0-445a-804b-6c159bfb2d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:23.337161 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb073-40e0-445a-804b-6c159bfb2d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:23.337438 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdb073-40e0-445a-804b-6c159bfb2d59 admin admin] PATH_INFO: `/v3/projects/712e760a5cc8472fab481d46a076d875` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:23.338621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdb073-40e0-445a-804b-6c159bfb2d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=712e760a5cc8472fab481d46a076d875)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:23.340545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdb073-40e0-445a-804b-6c159bfb2d59 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:23.457245 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-eacdb073-40e0-445a-804b-6c159bfb2d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712e760a5cc8472fab481d46a076d875', 'request_id': 'req-eacdb073-40e0-445a-804b-6c159bfb2d59'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:23.463981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-eacdb073-40e0-445a-804b-6c159bfb2d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712e760a5cc8472fab481d46a076d875', 'request_id': 'req-eacdb073-40e0-445a-804b-6c159bfb2d59'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:23.530093 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-eacdb073-40e0-445a-804b-6c159bfb2d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712e760a5cc8472fab481d46a076d875', 'request_id': 'req-eacdb073-40e0-445a-804b-6c159bfb2d59'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:23.541810 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-eacdb073-40e0-445a-804b-6c159bfb2d59 admin admin] The token cache is being invalidate because project 712e760a5cc8472fab481d46a076d875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:23.542095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-eacdb073-40e0-445a-804b-6c159bfb2d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:23.542734 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-eacdb073-40e0-445a-804b-6c159bfb2d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:23.544273 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1272/2567] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:23 2022] DELETE /identity/v3/projects/712e760a5cc8472fab481d46a076d875 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:23.548209 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18680366-4ac4-4d84-a942-170607e67f75 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:23.549648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-18680366-4ac4-4d84-a942-170607e67f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:23.563703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18680366-4ac4-4d84-a942-170607e67f75 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:23.605865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:23.622985 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba20515-eba1-4813-8cf0-61bd1eccec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:23.623943 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba20515-eba1-4813-8cf0-61bd1eccec38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:23.624230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba20515-eba1-4813-8cf0-61bd1eccec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:23.624514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba20515-eba1-4813-8cf0-61bd1eccec38 admin admin] PATH_INFO: `/v3/users/ff8d2596f84841ad9b9edd90dc53f10e` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:23.625799 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba20515-eba1-4813-8cf0-61bd1eccec38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff8d2596f84841ad9b9edd90dc53f10e)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:23.627729 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba20515-eba1-4813-8cf0-61bd1eccec38 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:23.823232 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-cba20515-eba1-4813-8cf0-61bd1eccec38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff8d2596f84841ad9b9edd90dc53f10e'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:23.890109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-cba20515-eba1-4813-8cf0-61bd1eccec38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff8d2596f84841ad9b9edd90dc53f10e'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:23.898222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-cba20515-eba1-4813-8cf0-61bd1eccec38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff8d2596f84841ad9b9edd90dc53f10e'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:23.898891 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-cba20515-eba1-4813-8cf0-61bd1eccec38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff8d2596f84841ad9b9edd90dc53f10e'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:23.911765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-cba20515-eba1-4813-8cf0-61bd1eccec38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff8d2596f84841ad9b9edd90dc53f10e'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:23.917788 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1296/2568] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:23 2022] DELETE /identity/v3/users/ff8d2596f84841ad9b9edd90dc53f10e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:24.354109 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb073-40e0-445a-804b-6c159bfb2d59 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:24.355610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-eacdb073-40e0-445a-804b-6c159bfb2d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:24.368837 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdb073-40e0-445a-804b-6c159bfb2d59 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:24.419550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:24.430776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50471b0e-69a8-4370-8034-c242af9e5a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:24.431667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50471b0e-69a8-4370-8034-c242af9e5a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:24.431951 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50471b0e-69a8-4370-8034-c242af9e5a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:24.432237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50471b0e-69a8-4370-8034-c242af9e5a64 admin admin] PATH_INFO: `/v3/projects/0730d030278743fa9a695e2941065e2f` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:24.433520 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50471b0e-69a8-4370-8034-c242af9e5a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0730d030278743fa9a695e2941065e2f)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:24.435725 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50471b0e-69a8-4370-8034-c242af9e5a64 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:24.542552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-50471b0e-69a8-4370-8034-c242af9e5a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0730d030278743fa9a695e2941065e2f', 'request_id': 'req-50471b0e-69a8-4370-8034-c242af9e5a64'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:24.548753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-50471b0e-69a8-4370-8034-c242af9e5a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0730d030278743fa9a695e2941065e2f', 'request_id': 'req-50471b0e-69a8-4370-8034-c242af9e5a64'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:24.592376 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-50471b0e-69a8-4370-8034-c242af9e5a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0730d030278743fa9a695e2941065e2f', 'request_id': 'req-50471b0e-69a8-4370-8034-c242af9e5a64'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:24.603393 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-50471b0e-69a8-4370-8034-c242af9e5a64 admin admin] The token cache is being invalidate because project 0730d030278743fa9a695e2941065e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:24.603613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-50471b0e-69a8-4370-8034-c242af9e5a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:24.604244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-50471b0e-69a8-4370-8034-c242af9e5a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:24.605834 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1273/2569] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:24 2022] DELETE /identity/v3/projects/0730d030278743fa9a695e2941065e2f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:24.611913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e4f9b-01a4-42dc-9b2f-ee60b3abb555 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:24.612416 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e4f9b-01a4-42dc-9b2f-ee60b3abb555 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:24.612519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e4f9b-01a4-42dc-9b2f-ee60b3abb555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:24.631150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-019e4f9b-01a4-42dc-9b2f-ee60b3abb555 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:24.632337 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-019e4f9b-01a4-42dc-9b2f-ee60b3abb555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:24.689244 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1297/2570] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:24.697905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687b0ce-31a2-409f-a216-725275393daf None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:24.698195 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687b0ce-31a2-409f-a216-725275393daf None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:24.698479 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687b0ce-31a2-409f-a216-725275393daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:24.716313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0687b0ce-31a2-409f-a216-725275393daf None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:24.717553 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0687b0ce-31a2-409f-a216-725275393daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:24.725408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1274/2571] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:24.729499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e4f9b-01a4-42dc-9b2f-ee60b3abb555 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:24.739876 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e4f9b-01a4-42dc-9b2f-ee60b3abb555 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:24.744530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302ca31-385e-4f4e-8ebd-029da0a57df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:24.745283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302ca31-385e-4f4e-8ebd-029da0a57df4 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:24.745601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302ca31-385e-4f4e-8ebd-029da0a57df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:24.745883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302ca31-385e-4f4e-8ebd-029da0a57df4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:24.746616 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302ca31-385e-4f4e-8ebd-029da0a57df4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:22:24.746929 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302ca31-385e-4f4e-8ebd-029da0a57df4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:24.748577 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302ca31-385e-4f4e-8ebd-029da0a57df4 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:24.760709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1298/2572] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:22:24.764893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687b0ce-31a2-409f-a216-725275393daf None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:24.774573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687b0ce-31a2-409f-a216-725275393daf None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:24.779158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f03027-2f7d-4dc2-81c7-dbabf5df6613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:24.779811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f03027-2f7d-4dc2-81c7-dbabf5df6613 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:24.780097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f03027-2f7d-4dc2-81c7-dbabf5df6613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:24.780366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f03027-2f7d-4dc2-81c7-dbabf5df6613 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:24.781090 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f03027-2f7d-4dc2-81c7-dbabf5df6613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:24.782994 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f03027-2f7d-4dc2-81c7-dbabf5df6613 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:24.869675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1275/2573] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:22:24 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:24.873851 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302ca31-385e-4f4e-8ebd-029da0a57df4 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:24.884421 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302ca31-385e-4f4e-8ebd-029da0a57df4 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:24.932048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:24.944318 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010286b-1460-4daf-a7b6-01e30479465a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:24.945031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010286b-1460-4daf-a7b6-01e30479465a admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:24.945320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010286b-1460-4daf-a7b6-01e30479465a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:24.945600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010286b-1460-4daf-a7b6-01e30479465a admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:24.946295 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010286b-1460-4daf-a7b6-01e30479465a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:24.948251 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010286b-1460-4daf-a7b6-01e30479465a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:25.004682 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1299/2574] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:22:24 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:25.009044 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f03027-2f7d-4dc2-81c7-dbabf5df6613 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:25.020305 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f03027-2f7d-4dc2-81c7-dbabf5df6613 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:25.024870 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5c9f8-c754-45a4-b4cc-60de6743121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:25.025562 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5c9f8-c754-45a4-b4cc-60de6743121f admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:25.025847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5c9f8-c754-45a4-b4cc-60de6743121f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:25.026220 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5c9f8-c754-45a4-b4cc-60de6743121f admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:25.026970 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5c9f8-c754-45a4-b4cc-60de6743121f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:25.028571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5c9f8-c754-45a4-b4cc-60de6743121f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:25.039551 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1276/2575] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:25.043667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010286b-1460-4daf-a7b6-01e30479465a admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:25.054103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010286b-1460-4daf-a7b6-01e30479465a admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:25.058831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dbb92-d6d0-49e7-88aa-97f0a974557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:25.059489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dbb92-d6d0-49e7-88aa-97f0a974557e admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:25.059775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dbb92-d6d0-49e7-88aa-97f0a974557e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:25.060054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dbb92-d6d0-49e7-88aa-97f0a974557e admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:25.060838 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dbb92-d6d0-49e7-88aa-97f0a974557e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:25.063212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dbb92-d6d0-49e7-88aa-97f0a974557e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:25.073736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1300/2576] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 18:22:25.077695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5c9f8-c754-45a4-b4cc-60de6743121f admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:25.088290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5c9f8-c754-45a4-b4cc-60de6743121f admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:25.093267 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a920b-1a2e-4c03-b9a8-5a6155d6146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:25.094148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a920b-1a2e-4c03-b9a8-5a6155d6146a admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:25.094434 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a920b-1a2e-4c03-b9a8-5a6155d6146a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:25.094717 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a920b-1a2e-4c03-b9a8-5a6155d6146a admin admin] PATH_INFO: `/v3/projects/7b3b85975bb445f7b7f7f8b8dc65cab7/users/f37934e42409480eae4d5ef129f1d856/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:25.109253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a920b-1a2e-4c03-b9a8-5a6155d6146a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3b85975bb445f7b7f7f8b8dc65cab7, user_id=f37934e42409480eae4d5ef129f1d856, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:25.112068 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a920b-1a2e-4c03-b9a8-5a6155d6146a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:25.163843 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1277/2577] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:25 2022] PUT /identity/v3/projects/7b3b85975bb445f7b7f7f8b8dc65cab7/users/f37934e42409480eae4d5ef129f1d856/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:25.174938 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e03b2-4eda-4cd0-9673-b2e754e8c3a4 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:25.175232 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e03b2-4eda-4cd0-9673-b2e754e8c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:25.175569 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e03b2-4eda-4cd0-9673-b2e754e8c3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:25.202586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-727e03b2-4eda-4cd0-9673-b2e754e8c3a4 None None] MFA Rules not processed for user `f37934e42409480eae4d5ef129f1d856`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:25.203814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-727e03b2-4eda-4cd0-9673-b2e754e8c3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:25.270419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1301/2578] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:25.274858 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a920b-1a2e-4c03-b9a8-5a6155d6146a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:25.337161 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a920b-1a2e-4c03-b9a8-5a6155d6146a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:25.341885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cc88f-dec4-4eb6-a52d-c16452ca5b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:25.342548 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cc88f-dec4-4eb6-a52d-c16452ca5b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:25.342839 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cc88f-dec4-4eb6-a52d-c16452ca5b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:25.343123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cc88f-dec4-4eb6-a52d-c16452ca5b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:25.343834 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cc88f-dec4-4eb6-a52d-c16452ca5b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:25.345827 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cc88f-dec4-4eb6-a52d-c16452ca5b0b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:25.469753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1278/2579] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:22:25 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:22:25.473924 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e03b2-4eda-4cd0-9673-b2e754e8c3a4 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:25.486314 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e03b2-4eda-4cd0-9673-b2e754e8c3a4 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:25.547197 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a42cd-1251-43a1-866c-c8b25dc6ed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:25.547879 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a42cd-1251-43a1-866c-c8b25dc6ed2d admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:25.548169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a42cd-1251-43a1-866c-c8b25dc6ed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:25.548451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a42cd-1251-43a1-866c-c8b25dc6ed2d admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:25.549176 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a42cd-1251-43a1-866c-c8b25dc6ed2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:25.551925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a42cd-1251-43a1-866c-c8b25dc6ed2d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:25.650720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1302/2580] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:22:25 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:25.654644 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cc88f-dec4-4eb6-a52d-c16452ca5b0b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:25.660145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:25.665357 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cc88f-dec4-4eb6-a52d-c16452ca5b0b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:25.670016 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282a6b0-437c-4a9a-b445-bd752d4c7662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:25.670674 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282a6b0-437c-4a9a-b445-bd752d4c7662 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:25.670961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282a6b0-437c-4a9a-b445-bd752d4c7662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:25.671241 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282a6b0-437c-4a9a-b445-bd752d4c7662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:25.672018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282a6b0-437c-4a9a-b445-bd752d4c7662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:25.673682 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282a6b0-437c-4a9a-b445-bd752d4c7662 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:25.685290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1279/2581] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:25.689435 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a42cd-1251-43a1-866c-c8b25dc6ed2d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:25.699910 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a42cd-1251-43a1-866c-c8b25dc6ed2d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:25.704460 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0e2f9-6b8f-47db-99be-d25e93590cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:25.705385 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0e2f9-6b8f-47db-99be-d25e93590cde admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:25.706453 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0e2f9-6b8f-47db-99be-d25e93590cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:25.706453 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0e2f9-6b8f-47db-99be-d25e93590cde admin admin] PATH_INFO: `/v3/projects/1a645ee3e78e41e3ad72afdef1d80d49/users/0afe8ec228044f879f18c4adf0e0f32d/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:25.721488 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0e2f9-6b8f-47db-99be-d25e93590cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a645ee3e78e41e3ad72afdef1d80d49, user_id=0afe8ec228044f879f18c4adf0e0f32d, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:25.725685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0e2f9-6b8f-47db-99be-d25e93590cde admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:25.827591 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1303/2582] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:25 2022] PUT /identity/v3/projects/1a645ee3e78e41e3ad72afdef1d80d49/users/0afe8ec228044f879f18c4adf0e0f32d/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:25.831640 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282a6b0-437c-4a9a-b445-bd752d4c7662 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:25.842024 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282a6b0-437c-4a9a-b445-bd752d4c7662 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:25.900449 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0fb6f-cdb6-4e10-ad28-47af31db4bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:25.901151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0fb6f-cdb6-4e10-ad28-47af31db4bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:25.901442 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0fb6f-cdb6-4e10-ad28-47af31db4bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:25.901726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0fb6f-cdb6-4e10-ad28-47af31db4bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:25.902458 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0fb6f-cdb6-4e10-ad28-47af31db4bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:25.904060 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0fb6f-cdb6-4e10-ad28-47af31db4bc4 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:25.914209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1280/2583] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:25.918361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0e2f9-6b8f-47db-99be-d25e93590cde admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:25.929983 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0e2f9-6b8f-47db-99be-d25e93590cde admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:25.934772 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13729cba-e0f2-418b-9619-260b82afa24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:25.935710 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13729cba-e0f2-418b-9619-260b82afa24a admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:25.935999 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13729cba-e0f2-418b-9619-260b82afa24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:25.936355 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13729cba-e0f2-418b-9619-260b82afa24a admin admin] PATH_INFO: `/v3/projects/1a645ee3e78e41e3ad72afdef1d80d49/users/0afe8ec228044f879f18c4adf0e0f32d/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:25.938385 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13729cba-e0f2-418b-9619-260b82afa24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a645ee3e78e41e3ad72afdef1d80d49, user_id=0afe8ec228044f879f18c4adf0e0f32d, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:25.941250 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13729cba-e0f2-418b-9619-260b82afa24a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:25.951584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1304/2584] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:25 2022] PUT /identity/v3/projects/1a645ee3e78e41e3ad72afdef1d80d49/users/0afe8ec228044f879f18c4adf0e0f32d/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:25.962941 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b23846-4113-4719-b789-882c98014e3e None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:25.963235 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b23846-4113-4719-b789-882c98014e3e None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:25.963522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b23846-4113-4719-b789-882c98014e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:25.990246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b9b23846-4113-4719-b789-882c98014e3e None None] MFA Rules not processed for user `0afe8ec228044f879f18c4adf0e0f32d`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:25.991389 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b9b23846-4113-4719-b789-882c98014e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:26.063372 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1281/2585] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:26.075023 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13729cba-e0f2-418b-9619-260b82afa24a admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:26.076681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-13729cba-e0f2-418b-9619-260b82afa24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:26.088068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:26.133425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13729cba-e0f2-418b-9619-260b82afa24a admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:26.137046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4643d-1f66-4190-98ee-b4e57afb2283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:26.137683 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4643d-1f66-4190-98ee-b4e57afb2283 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:26.137965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4643d-1f66-4190-98ee-b4e57afb2283 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:26.138239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4643d-1f66-4190-98ee-b4e57afb2283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:26.194614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4643d-1f66-4190-98ee-b4e57afb2283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:26.196059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4643d-1f66-4190-98ee-b4e57afb2283 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:26.205036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1305/2586] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:33.238195 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b23846-4113-4719-b789-882c98014e3e None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:33.240296 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b9b23846-4113-4719-b789-882c98014e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:33.307101 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b23846-4113-4719-b789-882c98014e3e None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:33.311679 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f33b08-b637-473f-a95a-3c113edf71c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:33.312663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f33b08-b637-473f-a95a-3c113edf71c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:33.313112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f33b08-b637-473f-a95a-3c113edf71c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:33.313402 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f33b08-b637-473f-a95a-3c113edf71c4 admin admin] PATH_INFO: `/v3/users/1e10cf32263c4cf68a61db232f59809b` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:33.314610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f33b08-b637-473f-a95a-3c113edf71c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e10cf32263c4cf68a61db232f59809b)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:33.316562 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f33b08-b637-473f-a95a-3c113edf71c4 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:33.331536 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:33.469472 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-44f33b08-b637-473f-a95a-3c113edf71c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e10cf32263c4cf68a61db232f59809b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:33.558787 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-44f33b08-b637-473f-a95a-3c113edf71c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e10cf32263c4cf68a61db232f59809b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:33.566280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-44f33b08-b637-473f-a95a-3c113edf71c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e10cf32263c4cf68a61db232f59809b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:33.566967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-44f33b08-b637-473f-a95a-3c113edf71c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e10cf32263c4cf68a61db232f59809b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:33.579230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-44f33b08-b637-473f-a95a-3c113edf71c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e10cf32263c4cf68a61db232f59809b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:33.585911 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1282/2587] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:33 2022] DELETE /identity/v3/users/1e10cf32263c4cf68a61db232f59809b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:33.590518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b93dd-c2bf-4886-b41d-24f88964b0e8 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:33.591026 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b93dd-c2bf-4886-b41d-24f88964b0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:33.591134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b93dd-c2bf-4886-b41d-24f88964b0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:33.609912 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-570b93dd-c2bf-4886-b41d-24f88964b0e8 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:33.611244 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-570b93dd-c2bf-4886-b41d-24f88964b0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:33.672889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1306/2588] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:33.683086 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f33b08-b637-473f-a95a-3c113edf71c4 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:33.684477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-44f33b08-b637-473f-a95a-3c113edf71c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:33.742680 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f33b08-b637-473f-a95a-3c113edf71c4 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:33.746326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266d107-34d7-4f51-9161-aaa92b2909fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:33.746972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266d107-34d7-4f51-9161-aaa92b2909fb service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:33.747256 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266d107-34d7-4f51-9161-aaa92b2909fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:33.747552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266d107-34d7-4f51-9161-aaa92b2909fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:33.757796 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266d107-34d7-4f51-9161-aaa92b2909fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:33.759481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266d107-34d7-4f51-9161-aaa92b2909fb service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:33.770480 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1283/2589] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:34.169105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b93dd-c2bf-4886-b41d-24f88964b0e8 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:34.170518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-570b93dd-c2bf-4886-b41d-24f88964b0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:34.186534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b93dd-c2bf-4886-b41d-24f88964b0e8 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:34.191759 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5b4f9-1e8c-45f5-881f-8852c38098db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:34.194512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5b4f9-1e8c-45f5-881f-8852c38098db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:34.194942 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5b4f9-1e8c-45f5-881f-8852c38098db admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:34.195070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5b4f9-1e8c-45f5-881f-8852c38098db admin admin] PATH_INFO: `/v3/projects/c6ac07e01ba54580a05c52b60f5aa4e2` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:34.196808 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5b4f9-1e8c-45f5-881f-8852c38098db admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ac07e01ba54580a05c52b60f5aa4e2)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:34.198809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5b4f9-1e8c-45f5-881f-8852c38098db admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:34.325194 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-1aa5b4f9-1e8c-45f5-881f-8852c38098db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ac07e01ba54580a05c52b60f5aa4e2', 'request_id': 'req-1aa5b4f9-1e8c-45f5-881f-8852c38098db'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:34.331558 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-1aa5b4f9-1e8c-45f5-881f-8852c38098db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ac07e01ba54580a05c52b60f5aa4e2', 'request_id': 'req-1aa5b4f9-1e8c-45f5-881f-8852c38098db'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:34.336048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:34.415880 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-1aa5b4f9-1e8c-45f5-881f-8852c38098db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ac07e01ba54580a05c52b60f5aa4e2', 'request_id': 'req-1aa5b4f9-1e8c-45f5-881f-8852c38098db'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:34.426788 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-1aa5b4f9-1e8c-45f5-881f-8852c38098db admin admin] The token cache is being invalidate because project c6ac07e01ba54580a05c52b60f5aa4e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:34.427107 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-1aa5b4f9-1e8c-45f5-881f-8852c38098db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:34.427699 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-1aa5b4f9-1e8c-45f5-881f-8852c38098db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:34.429282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1307/2590] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:34 2022] DELETE /identity/v3/projects/c6ac07e01ba54580a05c52b60f5aa4e2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:34.434121 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1d807-ac1e-4c4a-aab5-77ff025290d6 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:34.434591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1d807-ac1e-4c4a-aab5-77ff025290d6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:34.434710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1d807-ac1e-4c4a-aab5-77ff025290d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:34.453526 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f1d1d807-ac1e-4c4a-aab5-77ff025290d6 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:34.454785 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f1d1d807-ac1e-4c4a-aab5-77ff025290d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:34.515861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1284/2591] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:34.525424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792cf72-5245-45ce-abc0-2c176646721f None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:34.525719 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792cf72-5245-45ce-abc0-2c176646721f None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:34.526002 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792cf72-5245-45ce-abc0-2c176646721f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:34.545105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-6792cf72-5245-45ce-abc0-2c176646721f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:34.546370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6792cf72-5245-45ce-abc0-2c176646721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:34.555171 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1308/2592] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:34.559322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1d807-ac1e-4c4a-aab5-77ff025290d6 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:34.569414 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1d807-ac1e-4c4a-aab5-77ff025290d6 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:34.574067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3319f1-f860-407a-af04-30077511e3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:34.574748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3319f1-f860-407a-af04-30077511e3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:34.575034 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3319f1-f860-407a-af04-30077511e3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:34.575311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3319f1-f860-407a-af04-30077511e3d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:34.576043 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3319f1-f860-407a-af04-30077511e3d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:22:34.576349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3319f1-f860-407a-af04-30077511e3d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:34.578034 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3319f1-f860-407a-af04-30077511e3d8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:34.591036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1285/2593] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:22:34.595233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792cf72-5245-45ce-abc0-2c176646721f None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:34.605323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792cf72-5245-45ce-abc0-2c176646721f None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:34.610221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dde3fe-818e-4fbd-8a8a-9bdd7c68f04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:34.610937 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dde3fe-818e-4fbd-8a8a-9bdd7c68f04c admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:34.611226 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dde3fe-818e-4fbd-8a8a-9bdd7c68f04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:34.611531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dde3fe-818e-4fbd-8a8a-9bdd7c68f04c admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:34.612260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dde3fe-818e-4fbd-8a8a-9bdd7c68f04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:34.614260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dde3fe-818e-4fbd-8a8a-9bdd7c68f04c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:34.737230 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1309/2594] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:22:34 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:34.741476 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3319f1-f860-407a-af04-30077511e3d8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:34.751354 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3319f1-f860-407a-af04-30077511e3d8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:34.771073 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:34.809866 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262e8a5-3b38-4100-9c2f-8bfc45f63166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:34.810546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262e8a5-3b38-4100-9c2f-8bfc45f63166 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:34.810836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262e8a5-3b38-4100-9c2f-8bfc45f63166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:34.811118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262e8a5-3b38-4100-9c2f-8bfc45f63166 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:34.811832 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262e8a5-3b38-4100-9c2f-8bfc45f63166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:34.814070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262e8a5-3b38-4100-9c2f-8bfc45f63166 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:34.885703 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1286/2595] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:22:34 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:34.889926 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dde3fe-818e-4fbd-8a8a-9bdd7c68f04c admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:34.901595 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dde3fe-818e-4fbd-8a8a-9bdd7c68f04c admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:34.906325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0faaf4-4b7d-48ac-8d2c-351c07ff0b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:34.906994 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0faaf4-4b7d-48ac-8d2c-351c07ff0b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:34.907283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0faaf4-4b7d-48ac-8d2c-351c07ff0b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:34.907566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0faaf4-4b7d-48ac-8d2c-351c07ff0b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:34.908295 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0faaf4-4b7d-48ac-8d2c-351c07ff0b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:34.910012 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0faaf4-4b7d-48ac-8d2c-351c07ff0b0c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:34.920663 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1310/2596] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:34.924773 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262e8a5-3b38-4100-9c2f-8bfc45f63166 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:34.935027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262e8a5-3b38-4100-9c2f-8bfc45f63166 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:34.939706 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f49a03-2818-4572-a263-fc700b456ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:34.940415 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f49a03-2818-4572-a263-fc700b456ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:34.940701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f49a03-2818-4572-a263-fc700b456ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:34.941011 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f49a03-2818-4572-a263-fc700b456ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:34.941742 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f49a03-2818-4572-a263-fc700b456ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:34.944211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f49a03-2818-4572-a263-fc700b456ad6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:34.955078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1287/2597] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:34.959510 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0faaf4-4b7d-48ac-8d2c-351c07ff0b0c admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:34.969785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0faaf4-4b7d-48ac-8d2c-351c07ff0b0c admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:34.975212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d894d48-9dd1-44ac-a7ee-b60a383e5cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:34.982050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d894d48-9dd1-44ac-a7ee-b60a383e5cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:34.982050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d894d48-9dd1-44ac-a7ee-b60a383e5cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:34.982050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d894d48-9dd1-44ac-a7ee-b60a383e5cb3 admin admin] PATH_INFO: `/v3/projects/e123b81cb0184199b10178daaec87afa/users/18a80024ffd74ee1ab439e2fee5513c6/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:34.993239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d894d48-9dd1-44ac-a7ee-b60a383e5cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e123b81cb0184199b10178daaec87afa, user_id=18a80024ffd74ee1ab439e2fee5513c6, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:34.995869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d894d48-9dd1-44ac-a7ee-b60a383e5cb3 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:35.096147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1311/2598] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:34 2022] PUT /identity/v3/projects/e123b81cb0184199b10178daaec87afa/users/18a80024ffd74ee1ab439e2fee5513c6/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:22:35.106400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60888d83-9804-4c0c-8c54-cdc00ef6aabe None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:35.106695 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60888d83-9804-4c0c-8c54-cdc00ef6aabe None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:35.106979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60888d83-9804-4c0c-8c54-cdc00ef6aabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:35.134704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-60888d83-9804-4c0c-8c54-cdc00ef6aabe None None] MFA Rules not processed for user `18a80024ffd74ee1ab439e2fee5513c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:35.135901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-60888d83-9804-4c0c-8c54-cdc00ef6aabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:35.203446 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1288/2599] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:35.217456 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d894d48-9dd1-44ac-a7ee-b60a383e5cb3 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:35.220842 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6d894d48-9dd1-44ac-a7ee-b60a383e5cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:35.279403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d894d48-9dd1-44ac-a7ee-b60a383e5cb3 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:35.283146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dc950-7337-4b5b-995b-d5cabc9e05be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:35.283774 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dc950-7337-4b5b-995b-d5cabc9e05be service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:35.284134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dc950-7337-4b5b-995b-d5cabc9e05be service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:35.284419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dc950-7337-4b5b-995b-d5cabc9e05be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:35.292855 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dc950-7337-4b5b-995b-d5cabc9e05be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:35.294320 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dc950-7337-4b5b-995b-d5cabc9e05be service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:35.303880 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1312/2600] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:35.328657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60888d83-9804-4c0c-8c54-cdc00ef6aabe None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:35.395952 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60888d83-9804-4c0c-8c54-cdc00ef6aabe None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:35.400560 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821d6b5-70b9-4d52-a38b-6dbba5e6483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:35.401471 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821d6b5-70b9-4d52-a38b-6dbba5e6483b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:35.401764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821d6b5-70b9-4d52-a38b-6dbba5e6483b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:35.402047 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821d6b5-70b9-4d52-a38b-6dbba5e6483b admin admin] PATH_INFO: `/v3/users/18a80024ffd74ee1ab439e2fee5513c6` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:35.403251 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821d6b5-70b9-4d52-a38b-6dbba5e6483b admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a80024ffd74ee1ab439e2fee5513c6)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:35.405240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821d6b5-70b9-4d52-a38b-6dbba5e6483b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:35.588694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:35.601746 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1821d6b5-70b9-4d52-a38b-6dbba5e6483b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a80024ffd74ee1ab439e2fee5513c6'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:35.707168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1821d6b5-70b9-4d52-a38b-6dbba5e6483b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a80024ffd74ee1ab439e2fee5513c6'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:35.714489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1821d6b5-70b9-4d52-a38b-6dbba5e6483b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a80024ffd74ee1ab439e2fee5513c6'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:35.717960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1821d6b5-70b9-4d52-a38b-6dbba5e6483b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a80024ffd74ee1ab439e2fee5513c6'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:35.727361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-1821d6b5-70b9-4d52-a38b-6dbba5e6483b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a80024ffd74ee1ab439e2fee5513c6'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:35.733340 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1289/2601] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:35 2022] DELETE /identity/v3/users/18a80024ffd74ee1ab439e2fee5513c6 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:35.738079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1f29-504c-4e97-8cb8-40c3bac6c518 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:35.738614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1f29-504c-4e97-8cb8-40c3bac6c518 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:35.738747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1f29-504c-4e97-8cb8-40c3bac6c518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:35.756533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-f76c1f29-504c-4e97-8cb8-40c3bac6c518 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:35.757853 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f76c1f29-504c-4e97-8cb8-40c3bac6c518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:35.821132 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1313/2602] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:35.830777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821d6b5-70b9-4d52-a38b-6dbba5e6483b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:35.832317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1821d6b5-70b9-4d52-a38b-6dbba5e6483b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:35.913282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821d6b5-70b9-4d52-a38b-6dbba5e6483b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:35.916918 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45622a39-3de4-4861-8f8e-3e5e159106f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:35.917661 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45622a39-3de4-4861-8f8e-3e5e159106f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:35.917931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45622a39-3de4-4861-8f8e-3e5e159106f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:35.918212 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45622a39-3de4-4861-8f8e-3e5e159106f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:35.927546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45622a39-3de4-4861-8f8e-3e5e159106f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:35.929008 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45622a39-3de4-4861-8f8e-3e5e159106f1 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:35.938300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1290/2603] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:36.390131 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c1f29-504c-4e97-8cb8-40c3bac6c518 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:36.391588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f76c1f29-504c-4e97-8cb8-40c3bac6c518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:36.413939 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c1f29-504c-4e97-8cb8-40c3bac6c518 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:36.422340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d1e49-a5d1-47a5-b400-6f35b6182c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:36.423327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d1e49-a5d1-47a5-b400-6f35b6182c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:36.424327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d1e49-a5d1-47a5-b400-6f35b6182c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:36.424639 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d1e49-a5d1-47a5-b400-6f35b6182c13 admin admin] PATH_INFO: `/v3/projects/e123b81cb0184199b10178daaec87afa` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:36.426439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d1e49-a5d1-47a5-b400-6f35b6182c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e123b81cb0184199b10178daaec87afa)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:36.428608 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d1e49-a5d1-47a5-b400-6f35b6182c13 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:36.454755 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:36.555145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-889d1e49-a5d1-47a5-b400-6f35b6182c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e123b81cb0184199b10178daaec87afa', 'request_id': 'req-889d1e49-a5d1-47a5-b400-6f35b6182c13'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:36.561318 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-889d1e49-a5d1-47a5-b400-6f35b6182c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e123b81cb0184199b10178daaec87afa', 'request_id': 'req-889d1e49-a5d1-47a5-b400-6f35b6182c13'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:36.644691 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-889d1e49-a5d1-47a5-b400-6f35b6182c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e123b81cb0184199b10178daaec87afa', 'request_id': 'req-889d1e49-a5d1-47a5-b400-6f35b6182c13'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:36.657594 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-889d1e49-a5d1-47a5-b400-6f35b6182c13 admin admin] The token cache is being invalidate because project e123b81cb0184199b10178daaec87afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:36.657954 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-889d1e49-a5d1-47a5-b400-6f35b6182c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:36.658703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-889d1e49-a5d1-47a5-b400-6f35b6182c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:36.660402 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1314/2604] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:36 2022] DELETE /identity/v3/projects/e123b81cb0184199b10178daaec87afa => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:38.856377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45622a39-3de4-4861-8f8e-3e5e159106f1 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:38.857852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-45622a39-3de4-4861-8f8e-3e5e159106f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:38.921161 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45622a39-3de4-4861-8f8e-3e5e159106f1 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:38.970202 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:38.974761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eec8e-f703-47a4-a03e-83f946f5c239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:38.975413 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eec8e-f703-47a4-a03e-83f946f5c239 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:38.975702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eec8e-f703-47a4-a03e-83f946f5c239 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:38.975981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eec8e-f703-47a4-a03e-83f946f5c239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:38.977799 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-615eec8e-f703-47a4-a03e-83f946f5c239 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:39.039515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615eec8e-f703-47a4-a03e-83f946f5c239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:39.040984 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615eec8e-f703-47a4-a03e-83f946f5c239 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:39.050397 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1291/2605] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:45.482874 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d1e49-a5d1-47a5-b400-6f35b6182c13 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:45.484011 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-889d1e49-a5d1-47a5-b400-6f35b6182c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:45.500132 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d1e49-a5d1-47a5-b400-6f35b6182c13 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:45.503971 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd21ac8-1e9c-4801-9c39-43436aa94436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:45.505339 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd21ac8-1e9c-4801-9c39-43436aa94436 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:45.505619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd21ac8-1e9c-4801-9c39-43436aa94436 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:45.505960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd21ac8-1e9c-4801-9c39-43436aa94436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:45.509368 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7cd21ac8-1e9c-4801-9c39-43436aa94436 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:45.576667 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd21ac8-1e9c-4801-9c39-43436aa94436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:45.578278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd21ac8-1e9c-4801-9c39-43436aa94436 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:45.587839 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1315/2606] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:45.799261 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eec8e-f703-47a4-a03e-83f946f5c239 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:45.800846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-615eec8e-f703-47a4-a03e-83f946f5c239 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:45.879176 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eec8e-f703-47a4-a03e-83f946f5c239 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:45.886923 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a857f25-bc4c-4ac7-9671-934fd43394da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:45.887861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a857f25-bc4c-4ac7-9671-934fd43394da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:45.888143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a857f25-bc4c-4ac7-9671-934fd43394da admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:45.888419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a857f25-bc4c-4ac7-9671-934fd43394da admin admin] PATH_INFO: `/v3/users/f37934e42409480eae4d5ef129f1d856` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:45.889659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a857f25-bc4c-4ac7-9671-934fd43394da admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37934e42409480eae4d5ef129f1d856)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:45.891585 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a857f25-bc4c-4ac7-9671-934fd43394da admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:46.088232 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a857f25-bc4c-4ac7-9671-934fd43394da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37934e42409480eae4d5ef129f1d856'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:46.143175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a857f25-bc4c-4ac7-9671-934fd43394da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37934e42409480eae4d5ef129f1d856'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:46.153212 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a857f25-bc4c-4ac7-9671-934fd43394da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37934e42409480eae4d5ef129f1d856'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:46.153936 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a857f25-bc4c-4ac7-9671-934fd43394da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37934e42409480eae4d5ef129f1d856'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:46.167741 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-7a857f25-bc4c-4ac7-9671-934fd43394da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37934e42409480eae4d5ef129f1d856'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:46.174156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1292/2607] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:45 2022] DELETE /identity/v3/users/f37934e42409480eae4d5ef129f1d856 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:46.179858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1189172-dd25-4c55-8c9b-5687832f394b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:46.180223 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1189172-dd25-4c55-8c9b-5687832f394b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:46.180733 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1189172-dd25-4c55-8c9b-5687832f394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:46.200113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-d1189172-dd25-4c55-8c9b-5687832f394b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:46.201345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d1189172-dd25-4c55-8c9b-5687832f394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:46.261471 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1316/2608] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:46.271071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a857f25-bc4c-4ac7-9671-934fd43394da admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:46.272485 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7a857f25-bc4c-4ac7-9671-934fd43394da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:46.295099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:46.334256 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a857f25-bc4c-4ac7-9671-934fd43394da admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:46.337883 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee8533-0e85-4af3-b0dd-bae304ce374d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:46.338539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee8533-0e85-4af3-b0dd-bae304ce374d service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:46.338829 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee8533-0e85-4af3-b0dd-bae304ce374d service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:46.339111 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee8533-0e85-4af3-b0dd-bae304ce374d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:46.348146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee8533-0e85-4af3-b0dd-bae304ce374d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:46.349830 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee8533-0e85-4af3-b0dd-bae304ce374d service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:46.359559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1293/2609] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:46.737362 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1189172-dd25-4c55-8c9b-5687832f394b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:46.738827 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d1189172-dd25-4c55-8c9b-5687832f394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:46.751489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1189172-dd25-4c55-8c9b-5687832f394b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:46.756400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5669a0-cce9-4bb0-922d-6c0f536ee239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:46.757316 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5669a0-cce9-4bb0-922d-6c0f536ee239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:46.757660 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5669a0-cce9-4bb0-922d-6c0f536ee239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:46.758006 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5669a0-cce9-4bb0-922d-6c0f536ee239 admin admin] PATH_INFO: `/v3/projects/7b3b85975bb445f7b7f7f8b8dc65cab7` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:46.759078 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5669a0-cce9-4bb0-922d-6c0f536ee239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3b85975bb445f7b7f7f8b8dc65cab7)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:46.761021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5669a0-cce9-4bb0-922d-6c0f536ee239 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:46.847391 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:46.851955 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-1b5669a0-cce9-4bb0-922d-6c0f536ee239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3b85975bb445f7b7f7f8b8dc65cab7', 'request_id': 'req-1b5669a0-cce9-4bb0-922d-6c0f536ee239'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:46.858232 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-1b5669a0-cce9-4bb0-922d-6c0f536ee239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3b85975bb445f7b7f7f8b8dc65cab7', 'request_id': 'req-1b5669a0-cce9-4bb0-922d-6c0f536ee239'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:46.913492 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-1b5669a0-cce9-4bb0-922d-6c0f536ee239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3b85975bb445f7b7f7f8b8dc65cab7', 'request_id': 'req-1b5669a0-cce9-4bb0-922d-6c0f536ee239'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:46.924572 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-1b5669a0-cce9-4bb0-922d-6c0f536ee239 admin admin] The token cache is being invalidate because project 7b3b85975bb445f7b7f7f8b8dc65cab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:46.924856 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-1b5669a0-cce9-4bb0-922d-6c0f536ee239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:46.925519 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-1b5669a0-cce9-4bb0-922d-6c0f536ee239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:46.927747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1317/2610] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:46 2022] DELETE /identity/v3/projects/7b3b85975bb445f7b7f7f8b8dc65cab7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:22:46.931687 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee8533-0e85-4af3-b0dd-bae304ce374d service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:46.941354 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee8533-0e85-4af3-b0dd-bae304ce374d service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:46.997650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a1d22-bc17-40bf-9490-b97278559b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:46.998527 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a1d22-bc17-40bf-9490-b97278559b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:46.998815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a1d22-bc17-40bf-9490-b97278559b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:46.999096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a1d22-bc17-40bf-9490-b97278559b87 admin admin] PATH_INFO: `/v3/users/0afe8ec228044f879f18c4adf0e0f32d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:47.000284 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a1d22-bc17-40bf-9490-b97278559b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0afe8ec228044f879f18c4adf0e0f32d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:47.002247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a1d22-bc17-40bf-9490-b97278559b87 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:47.190036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-403a1d22-bc17-40bf-9490-b97278559b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0afe8ec228044f879f18c4adf0e0f32d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:47.256102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-403a1d22-bc17-40bf-9490-b97278559b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0afe8ec228044f879f18c4adf0e0f32d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:47.263160 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-403a1d22-bc17-40bf-9490-b97278559b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0afe8ec228044f879f18c4adf0e0f32d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:47.263794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-403a1d22-bc17-40bf-9490-b97278559b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0afe8ec228044f879f18c4adf0e0f32d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:47.276197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-403a1d22-bc17-40bf-9490-b97278559b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0afe8ec228044f879f18c4adf0e0f32d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:47.282126 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1294/2611] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:22:46 2022] DELETE /identity/v3/users/0afe8ec228044f879f18c4adf0e0f32d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:47.640623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5669a0-cce9-4bb0-922d-6c0f536ee239 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:47.641985 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-1b5669a0-cce9-4bb0-922d-6c0f536ee239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:47.659777 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5669a0-cce9-4bb0-922d-6c0f536ee239 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:47.713773 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593e095-aaf0-43f5-be1c-c4419c2077cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:47.714690 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593e095-aaf0-43f5-be1c-c4419c2077cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:47.714973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593e095-aaf0-43f5-be1c-c4419c2077cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:47.715253 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593e095-aaf0-43f5-be1c-c4419c2077cc admin admin] PATH_INFO: `/v3/projects/1a645ee3e78e41e3ad72afdef1d80d49` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:47.716443 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593e095-aaf0-43f5-be1c-c4419c2077cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a645ee3e78e41e3ad72afdef1d80d49)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:47.718452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593e095-aaf0-43f5-be1c-c4419c2077cc admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:47.828891 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e593e095-aaf0-43f5-be1c-c4419c2077cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a645ee3e78e41e3ad72afdef1d80d49', 'request_id': 'req-e593e095-aaf0-43f5-be1c-c4419c2077cc'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:47.835356 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e593e095-aaf0-43f5-be1c-c4419c2077cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a645ee3e78e41e3ad72afdef1d80d49', 'request_id': 'req-e593e095-aaf0-43f5-be1c-c4419c2077cc'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:47.895979 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e593e095-aaf0-43f5-be1c-c4419c2077cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a645ee3e78e41e3ad72afdef1d80d49', 'request_id': 'req-e593e095-aaf0-43f5-be1c-c4419c2077cc'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:47.906840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e593e095-aaf0-43f5-be1c-c4419c2077cc admin admin] The token cache is being invalidate because project 1a645ee3e78e41e3ad72afdef1d80d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:22:47.910843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e593e095-aaf0-43f5-be1c-c4419c2077cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:47.910843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e593e095-aaf0-43f5-be1c-c4419c2077cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:22:47.910843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1318/2612] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:22:47 2022] DELETE /identity/v3/projects/1a645ee3e78e41e3ad72afdef1d80d49 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:47.915732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf370a2-b0c9-453f-b947-a4acd9184c33 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:47.916022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf370a2-b0c9-453f-b947-a4acd9184c33 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:47.916299 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf370a2-b0c9-453f-b947-a4acd9184c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:47.935598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-adf370a2-b0c9-453f-b947-a4acd9184c33 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:47.939558 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-adf370a2-b0c9-453f-b947-a4acd9184c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:47.970444 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:47.997146 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1295/2613] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:48.005783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07495de-caca-484c-a7af-b18ba8cd284b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:48.006078 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07495de-caca-484c-a7af-b18ba8cd284b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:48.006354 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07495de-caca-484c-a7af-b18ba8cd284b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:48.025427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-f07495de-caca-484c-a7af-b18ba8cd284b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:48.026627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f07495de-caca-484c-a7af-b18ba8cd284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:48.034482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1319/2614] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:48.039416 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf370a2-b0c9-453f-b947-a4acd9184c33 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:48.049136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf370a2-b0c9-453f-b947-a4acd9184c33 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:48.054598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd65341-c7b3-437d-a786-5485149409ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:48.055252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd65341-c7b3-437d-a786-5485149409ba admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:48.055535 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd65341-c7b3-437d-a786-5485149409ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:48.055814 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd65341-c7b3-437d-a786-5485149409ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:48.056535 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd65341-c7b3-437d-a786-5485149409ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:22:48.056844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd65341-c7b3-437d-a786-5485149409ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:48.058484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd65341-c7b3-437d-a786-5485149409ba admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:48.070073 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1296/2615] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 18:22:48.074368 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07495de-caca-484c-a7af-b18ba8cd284b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:48.083499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07495de-caca-484c-a7af-b18ba8cd284b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:48.088239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb1c1a-600a-4d10-b33c-547a3c95e8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:48.088899 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb1c1a-600a-4d10-b33c-547a3c95e8be admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:48.089211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb1c1a-600a-4d10-b33c-547a3c95e8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:48.089487 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb1c1a-600a-4d10-b33c-547a3c95e8be admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:48.090182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb1c1a-600a-4d10-b33c-547a3c95e8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:48.092065 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb1c1a-600a-4d10-b33c-547a3c95e8be admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:48.263523 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1320/2616] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:22:48 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:48.267620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd65341-c7b3-437d-a786-5485149409ba admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:48.278280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd65341-c7b3-437d-a786-5485149409ba admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:48.335634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fc12e-799c-48f4-b2fa-9adc141f49b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:48.336300 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fc12e-799c-48f4-b2fa-9adc141f49b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:48.336590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fc12e-799c-48f4-b2fa-9adc141f49b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:48.336875 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fc12e-799c-48f4-b2fa-9adc141f49b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:48.337601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623fc12e-799c-48f4-b2fa-9adc141f49b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:48.339545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623fc12e-799c-48f4-b2fa-9adc141f49b8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:48.416412 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1297/2617] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:22:48 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:22:48.420818 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb1c1a-600a-4d10-b33c-547a3c95e8be admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:48.432184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb1c1a-600a-4d10-b33c-547a3c95e8be admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:48.437061 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a1a2c-8ed9-4ff5-ab53-392626656f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:48.437814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a1a2c-8ed9-4ff5-ab53-392626656f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:48.438100 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a1a2c-8ed9-4ff5-ab53-392626656f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:48.438383 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a1a2c-8ed9-4ff5-ab53-392626656f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:48.439142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a1a2c-8ed9-4ff5-ab53-392626656f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:48.440925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a1a2c-8ed9-4ff5-ab53-392626656f17 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:48.451411 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1321/2618] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:48.455382 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fc12e-799c-48f4-b2fa-9adc141f49b8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:48.465961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fc12e-799c-48f4-b2fa-9adc141f49b8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:48.470491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72097f-4e07-4c1a-b189-78b0d6fc06c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:48.471149 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72097f-4e07-4c1a-b189-78b0d6fc06c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:48.471432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72097f-4e07-4c1a-b189-78b0d6fc06c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:48.471708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72097f-4e07-4c1a-b189-78b0d6fc06c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:48.472434 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72097f-4e07-4c1a-b189-78b0d6fc06c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:48.474045 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72097f-4e07-4c1a-b189-78b0d6fc06c3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:48.484886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1298/2619] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:22:48.488990 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a1a2c-8ed9-4ff5-ab53-392626656f17 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:48.499247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a1a2c-8ed9-4ff5-ab53-392626656f17 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:48.503943 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb3a70-bd1a-46d0-9b82-4d9348b9d34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:48.504819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb3a70-bd1a-46d0-9b82-4d9348b9d34f admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:48.505139 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb3a70-bd1a-46d0-9b82-4d9348b9d34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:48.505420 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb3a70-bd1a-46d0-9b82-4d9348b9d34f admin admin] PATH_INFO: `/v3/projects/b6bbb691d10f4b839816dd8977124f64/users/70e698c33a13427685839a1e063f414d/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:48.519838 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb3a70-bd1a-46d0-9b82-4d9348b9d34f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bbb691d10f4b839816dd8977124f64, user_id=70e698c33a13427685839a1e063f414d, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:48.523459 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb3a70-bd1a-46d0-9b82-4d9348b9d34f admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:48.576920 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:48.582365 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1322/2620] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:22:48 2022] PUT /identity/v3/projects/b6bbb691d10f4b839816dd8977124f64/users/70e698c33a13427685839a1e063f414d/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:22:48.595419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb947d8-b2dc-4009-8ce7-2d6ab37a7524 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:48.595718 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb947d8-b2dc-4009-8ce7-2d6ab37a7524 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:48.596036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb947d8-b2dc-4009-8ce7-2d6ab37a7524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:48.622293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-cdb947d8-b2dc-4009-8ce7-2d6ab37a7524 None None] MFA Rules not processed for user `70e698c33a13427685839a1e063f414d`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:22:48.623565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cdb947d8-b2dc-4009-8ce7-2d6ab37a7524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:48.687696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1299/2621] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:22:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:22:48.699140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb3a70-bd1a-46d0-9b82-4d9348b9d34f admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:22:48.700863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0ddb3a70-bd1a-46d0-9b82-4d9348b9d34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:22:48.757836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb3a70-bd1a-46d0-9b82-4d9348b9d34f admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:22:48.761494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca6b93-d1c3-4f3d-93a0-4f4b953f7fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:22:48.762139 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca6b93-d1c3-4f3d-93a0-4f4b953f7fca service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:22:48.762424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca6b93-d1c3-4f3d-93a0-4f4b953f7fca service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:22:48.762698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca6b93-d1c3-4f3d-93a0-4f4b953f7fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:22:48.770925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca6b93-d1c3-4f3d-93a0-4f4b953f7fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:22:48.773234 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca6b93-d1c3-4f3d-93a0-4f4b953f7fca service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:22:48.781889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1323/2622] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:22:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:22:58.684702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:22:58.777896 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=27 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:23:06.176913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb947d8-b2dc-4009-8ce7-2d6ab37a7524 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:06.239843 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb947d8-b2dc-4009-8ce7-2d6ab37a7524 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:06.245706 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7b8b6-155c-4886-a8ae-c53c5e267010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:06.246619 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7b8b6-155c-4886-a8ae-c53c5e267010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:06.246905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7b8b6-155c-4886-a8ae-c53c5e267010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:06.247183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7b8b6-155c-4886-a8ae-c53c5e267010 admin admin] PATH_INFO: `/v3/users/70e698c33a13427685839a1e063f414d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:06.248381 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7b8b6-155c-4886-a8ae-c53c5e267010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e698c33a13427685839a1e063f414d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:06.250425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7b8b6-155c-4886-a8ae-c53c5e267010 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:06.424427 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2eb7b8b6-155c-4886-a8ae-c53c5e267010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e698c33a13427685839a1e063f414d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:06.502369 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2eb7b8b6-155c-4886-a8ae-c53c5e267010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e698c33a13427685839a1e063f414d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:06.510541 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2eb7b8b6-155c-4886-a8ae-c53c5e267010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e698c33a13427685839a1e063f414d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:06.511174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2eb7b8b6-155c-4886-a8ae-c53c5e267010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e698c33a13427685839a1e063f414d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:06.523500 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2eb7b8b6-155c-4886-a8ae-c53c5e267010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e698c33a13427685839a1e063f414d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:06.529556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1300/2623] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:23:06 2022] DELETE /identity/v3/users/70e698c33a13427685839a1e063f414d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:23:06.534155 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c6071-b873-4d5d-bc01-cedb171af041 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:06.534663 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c6071-b873-4d5d-bc01-cedb171af041 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:06.534783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c6071-b873-4d5d-bc01-cedb171af041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:06.563679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-171c6071-b873-4d5d-bc01-cedb171af041 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:23:06.564925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-171c6071-b873-4d5d-bc01-cedb171af041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:06.623671 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1324/2624] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:23:06.633672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7b8b6-155c-4886-a8ae-c53c5e267010 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:06.635269 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2eb7b8b6-155c-4886-a8ae-c53c5e267010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:06.694011 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7b8b6-155c-4886-a8ae-c53c5e267010 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:06.697863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83abaed-a34d-433e-803d-00f5c22067c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:06.698496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83abaed-a34d-433e-803d-00f5c22067c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:06.698785 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83abaed-a34d-433e-803d-00f5c22067c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:06.699069 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83abaed-a34d-433e-803d-00f5c22067c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:06.708476 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83abaed-a34d-433e-803d-00f5c22067c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:06.710571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83abaed-a34d-433e-803d-00f5c22067c6 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:06.720363 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1301/2625] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:23:07.120419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c6071-b873-4d5d-bc01-cedb171af041 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:07.121916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-171c6071-b873-4d5d-bc01-cedb171af041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:07.138138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c6071-b873-4d5d-bc01-cedb171af041 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:07.142865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d93667-4012-4632-9c39-a0e3df440fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:07.143741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d93667-4012-4632-9c39-a0e3df440fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:07.144074 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d93667-4012-4632-9c39-a0e3df440fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:07.144414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d93667-4012-4632-9c39-a0e3df440fef admin admin] PATH_INFO: `/v3/projects/b6bbb691d10f4b839816dd8977124f64` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:07.145601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d93667-4012-4632-9c39-a0e3df440fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6bbb691d10f4b839816dd8977124f64)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:07.148181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d93667-4012-4632-9c39-a0e3df440fef admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:07.251032 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-61d93667-4012-4632-9c39-a0e3df440fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6bbb691d10f4b839816dd8977124f64', 'request_id': 'req-61d93667-4012-4632-9c39-a0e3df440fef'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:07.258042 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-61d93667-4012-4632-9c39-a0e3df440fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6bbb691d10f4b839816dd8977124f64', 'request_id': 'req-61d93667-4012-4632-9c39-a0e3df440fef'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:07.313765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-61d93667-4012-4632-9c39-a0e3df440fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6bbb691d10f4b839816dd8977124f64', 'request_id': 'req-61d93667-4012-4632-9c39-a0e3df440fef'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:07.325977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-61d93667-4012-4632-9c39-a0e3df440fef admin admin] The token cache is being invalidate because project b6bbb691d10f4b839816dd8977124f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:23:07.326278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-61d93667-4012-4632-9c39-a0e3df440fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:07.326927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-61d93667-4012-4632-9c39-a0e3df440fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:07.328464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1325/2626] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:23:07 2022] DELETE /identity/v3/projects/b6bbb691d10f4b839816dd8977124f64 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:23:07.333487 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a71338-d007-4869-9ebf-e9caf18cd924 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:07.333953 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a71338-d007-4869-9ebf-e9caf18cd924 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:07.334066 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a71338-d007-4869-9ebf-e9caf18cd924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:07.355725 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-50a71338-d007-4869-9ebf-e9caf18cd924 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:23:07.356913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-50a71338-d007-4869-9ebf-e9caf18cd924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:07.374615 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:23:07.415653 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1302/2627] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:23:07.423718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d770f-3dba-4fb9-bca2-71c8c858a2ea None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:07.424042 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d770f-3dba-4fb9-bca2-71c8c858a2ea None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:07.424330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d770f-3dba-4fb9-bca2-71c8c858a2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:07.445113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-c57d770f-3dba-4fb9-bca2-71c8c858a2ea None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:23:07.449787 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-c57d770f-3dba-4fb9-bca2-71c8c858a2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:07.455659 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1326/2628] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:23:07.460076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a71338-d007-4869-9ebf-e9caf18cd924 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:07.470000 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a71338-d007-4869-9ebf-e9caf18cd924 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:07.474651 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8741d-d5bd-4d2a-950e-a86da8ddfc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:07.475354 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8741d-d5bd-4d2a-950e-a86da8ddfc91 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:07.475722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8741d-d5bd-4d2a-950e-a86da8ddfc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:07.476005 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8741d-d5bd-4d2a-950e-a86da8ddfc91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:07.476734 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8741d-d5bd-4d2a-950e-a86da8ddfc91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:23:07.477083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8741d-d5bd-4d2a-950e-a86da8ddfc91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:07.478697 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8741d-d5bd-4d2a-950e-a86da8ddfc91 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:07.490432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1303/2629] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:23:07.495640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d770f-3dba-4fb9-bca2-71c8c858a2ea None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:07.504833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d770f-3dba-4fb9-bca2-71c8c858a2ea None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:07.510396 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f272b-8897-4185-827c-5a626fc3a662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:07.511068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f272b-8897-4185-827c-5a626fc3a662 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:07.511349 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f272b-8897-4185-827c-5a626fc3a662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:07.511668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f272b-8897-4185-827c-5a626fc3a662 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:07.512347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f272b-8897-4185-827c-5a626fc3a662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:07.514291 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f272b-8897-4185-827c-5a626fc3a662 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:07.606751 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1327/2630] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:23:07 2022] POST /identity/v3/projects => generated 399 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:23:07.610981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8741d-d5bd-4d2a-950e-a86da8ddfc91 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:07.622102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8741d-d5bd-4d2a-950e-a86da8ddfc91 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:07.679168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabe85d-3748-4c26-9663-78fbd1369ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:07.679404 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabe85d-3748-4c26-9663-78fbd1369ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:07.679639 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabe85d-3748-4c26-9663-78fbd1369ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:07.679912 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabe85d-3748-4c26-9663-78fbd1369ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:07.680604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabe85d-3748-4c26-9663-78fbd1369ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:07.682545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabe85d-3748-4c26-9663-78fbd1369ac7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:07.765501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1304/2631] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:23:07 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:23:07.769552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f272b-8897-4185-827c-5a626fc3a662 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:07.780020 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f272b-8897-4185-827c-5a626fc3a662 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:07.784744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ea654-984e-42e0-9f7c-7d581df233f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:07.785490 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ea654-984e-42e0-9f7c-7d581df233f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:07.785764 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ea654-984e-42e0-9f7c-7d581df233f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:07.786046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ea654-984e-42e0-9f7c-7d581df233f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:07.786776 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ea654-984e-42e0-9f7c-7d581df233f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:07.788908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ea654-984e-42e0-9f7c-7d581df233f0 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:07.799448 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1328/2632] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:23:07.804279 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabe85d-3748-4c26-9663-78fbd1369ac7 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:07.814387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabe85d-3748-4c26-9663-78fbd1369ac7 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:07.819341 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72335e0-f6fb-47e0-ae2f-c163c8c7d10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:07.820051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72335e0-f6fb-47e0-ae2f-c163c8c7d10a admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:07.820295 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72335e0-f6fb-47e0-ae2f-c163c8c7d10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:07.820582 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72335e0-f6fb-47e0-ae2f-c163c8c7d10a admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:07.821380 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72335e0-f6fb-47e0-ae2f-c163c8c7d10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:07.825686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72335e0-f6fb-47e0-ae2f-c163c8c7d10a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:07.833064 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1305/2633] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:23:07.837096 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ea654-984e-42e0-9f7c-7d581df233f0 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:07.846871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ea654-984e-42e0-9f7c-7d581df233f0 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:07.856447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e307bf-058d-445a-951b-be6433d05314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:07.856447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e307bf-058d-445a-951b-be6433d05314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:07.856447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e307bf-058d-445a-951b-be6433d05314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:07.856447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e307bf-058d-445a-951b-be6433d05314 admin admin] PATH_INFO: `/v3/projects/37c4970a52684f31ac9b05dc61e584ac/users/953fb3007f384fe0a4ae053aa1334ae5/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:07.869149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e307bf-058d-445a-951b-be6433d05314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c4970a52684f31ac9b05dc61e584ac, user_id=953fb3007f384fe0a4ae053aa1334ae5, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:07.871910 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e307bf-058d-445a-951b-be6433d05314 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:07.999659 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1329/2634] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:23:07 2022] PUT /identity/v3/projects/37c4970a52684f31ac9b05dc61e584ac/users/953fb3007f384fe0a4ae053aa1334ae5/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:23:08.010412 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2058643-6684-4718-8866-bf3e21e76145 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:08.010707 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2058643-6684-4718-8866-bf3e21e76145 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:08.010993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2058643-6684-4718-8866-bf3e21e76145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:08.040452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a2058643-6684-4718-8866-bf3e21e76145 None None] MFA Rules not processed for user `953fb3007f384fe0a4ae053aa1334ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:23:08.041701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a2058643-6684-4718-8866-bf3e21e76145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:08.107228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1306/2635] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:23:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:23:08.118999 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e307bf-058d-445a-951b-be6433d05314 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:08.120684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-45e307bf-058d-445a-951b-be6433d05314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:08.135257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:23:08.195092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e307bf-058d-445a-951b-be6433d05314 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:08.198879 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142372c-52e0-40b6-8a81-02e62263db56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:08.199528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142372c-52e0-40b6-8a81-02e62263db56 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:08.199834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142372c-52e0-40b6-8a81-02e62263db56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:08.200111 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142372c-52e0-40b6-8a81-02e62263db56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:08.208576 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142372c-52e0-40b6-8a81-02e62263db56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:08.210128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142372c-52e0-40b6-8a81-02e62263db56 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:08.219840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1330/2636] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:23:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:23:17.993675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2058643-6684-4718-8866-bf3e21e76145 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:18.012274 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:23:18.056278 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2058643-6684-4718-8866-bf3e21e76145 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:18.060817 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eda30-0dd2-4157-a54e-3f877802581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:18.061758 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eda30-0dd2-4157-a54e-3f877802581a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:18.062048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eda30-0dd2-4157-a54e-3f877802581a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:18.062334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eda30-0dd2-4157-a54e-3f877802581a admin admin] PATH_INFO: `/v3/users/953fb3007f384fe0a4ae053aa1334ae5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:18.063565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eda30-0dd2-4157-a54e-3f877802581a admin admin] RBAC: Authorizing `identity:delete_user(user_id=953fb3007f384fe0a4ae053aa1334ae5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:18.065550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eda30-0dd2-4157-a54e-3f877802581a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:18.207236 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a79eda30-0dd2-4157-a54e-3f877802581a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953fb3007f384fe0a4ae053aa1334ae5'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:18.244852 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=25 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:23:18.262275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a79eda30-0dd2-4157-a54e-3f877802581a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953fb3007f384fe0a4ae053aa1334ae5'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:18.269386 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a79eda30-0dd2-4157-a54e-3f877802581a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953fb3007f384fe0a4ae053aa1334ae5'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:18.274298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a79eda30-0dd2-4157-a54e-3f877802581a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953fb3007f384fe0a4ae053aa1334ae5'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:18.282417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-a79eda30-0dd2-4157-a54e-3f877802581a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953fb3007f384fe0a4ae053aa1334ae5'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:18.288375 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1307/2637] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:23:17 2022] DELETE /identity/v3/users/953fb3007f384fe0a4ae053aa1334ae5 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:23:18.293453 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350d29a-e14e-4ba9-9aba-e3309c671104 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:18.293744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350d29a-e14e-4ba9-9aba-e3309c671104 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:18.294023 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350d29a-e14e-4ba9-9aba-e3309c671104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:18.311369 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-0350d29a-e14e-4ba9-9aba-e3309c671104 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:23:18.312622 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0350d29a-e14e-4ba9-9aba-e3309c671104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:18.372085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1331/2638] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:23:18.381663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eda30-0dd2-4157-a54e-3f877802581a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:18.383274 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a79eda30-0dd2-4157-a54e-3f877802581a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:18.444648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eda30-0dd2-4157-a54e-3f877802581a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:18.449185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ced356-7997-4988-bdda-cbda4c21adc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:18.451763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ced356-7997-4988-bdda-cbda4c21adc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:18.451763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ced356-7997-4988-bdda-cbda4c21adc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:18.451763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ced356-7997-4988-bdda-cbda4c21adc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:18.459840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ced356-7997-4988-bdda-cbda4c21adc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:18.461526 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ced356-7997-4988-bdda-cbda4c21adc4 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:18.471777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1308/2639] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:23:18.820503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350d29a-e14e-4ba9-9aba-e3309c671104 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:18.822084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0350d29a-e14e-4ba9-9aba-e3309c671104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:18.837451 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350d29a-e14e-4ba9-9aba-e3309c671104 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:18.842961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822735a-e54e-4623-ab55-25b316d48371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:18.843875 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822735a-e54e-4623-ab55-25b316d48371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:18.844159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822735a-e54e-4623-ab55-25b316d48371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:18.844436 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822735a-e54e-4623-ab55-25b316d48371 admin admin] PATH_INFO: `/v3/projects/37c4970a52684f31ac9b05dc61e584ac` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:18.845650 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822735a-e54e-4623-ab55-25b316d48371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c4970a52684f31ac9b05dc61e584ac)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:18.847611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822735a-e54e-4623-ab55-25b316d48371 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:18.978181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e822735a-e54e-4623-ab55-25b316d48371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c4970a52684f31ac9b05dc61e584ac', 'request_id': 'req-e822735a-e54e-4623-ab55-25b316d48371'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:18.984464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e822735a-e54e-4623-ab55-25b316d48371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c4970a52684f31ac9b05dc61e584ac', 'request_id': 'req-e822735a-e54e-4623-ab55-25b316d48371'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:19.033540 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e822735a-e54e-4623-ab55-25b316d48371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c4970a52684f31ac9b05dc61e584ac', 'request_id': 'req-e822735a-e54e-4623-ab55-25b316d48371'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:19.045076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e822735a-e54e-4623-ab55-25b316d48371 admin admin] The token cache is being invalidate because project 37c4970a52684f31ac9b05dc61e584ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:23:19.046115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e822735a-e54e-4623-ab55-25b316d48371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:19.046115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e822735a-e54e-4623-ab55-25b316d48371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:19.047542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1332/2640] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:23:18 2022] DELETE /identity/v3/projects/37c4970a52684f31ac9b05dc61e584ac => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:23:19.053221 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a631ed1-d9d9-493f-a6fa-c001fd1a7aa6 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:19.053710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a631ed1-d9d9-493f-a6fa-c001fd1a7aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:19.053848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a631ed1-d9d9-493f-a6fa-c001fd1a7aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:19.071915 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6a631ed1-d9d9-493f-a6fa-c001fd1a7aa6 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:23:19.073139 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6a631ed1-d9d9-493f-a6fa-c001fd1a7aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:19.107868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:23:19.133272 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1309/2641] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:23:19.141316 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8123f-9886-4bcd-8ea4-ae90683d9aa8 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:19.141612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8123f-9886-4bcd-8ea4-ae90683d9aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:19.141896 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8123f-9886-4bcd-8ea4-ae90683d9aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:19.160725 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-d2d8123f-9886-4bcd-8ea4-ae90683d9aa8 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:23:19.163576 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d2d8123f-9886-4bcd-8ea4-ae90683d9aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:19.170200 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1333/2642] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:23:19.174362 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a631ed1-d9d9-493f-a6fa-c001fd1a7aa6 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:19.185217 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a631ed1-d9d9-493f-a6fa-c001fd1a7aa6 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:19.189880 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38317e-8a71-4910-b8e3-c6cd97aeb638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:19.192209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38317e-8a71-4910-b8e3-c6cd97aeb638 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:19.192209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38317e-8a71-4910-b8e3-c6cd97aeb638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:19.192209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38317e-8a71-4910-b8e3-c6cd97aeb638 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:19.192209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38317e-8a71-4910-b8e3-c6cd97aeb638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:23:19.192209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38317e-8a71-4910-b8e3-c6cd97aeb638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:19.193875 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38317e-8a71-4910-b8e3-c6cd97aeb638 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:19.205599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1310/2643] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 18:23:19.209863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8123f-9886-4bcd-8ea4-ae90683d9aa8 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:19.219527 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8123f-9886-4bcd-8ea4-ae90683d9aa8 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:19.224144 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d433837-54c7-4d6d-8825-77e2402e368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:19.224789 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d433837-54c7-4d6d-8825-77e2402e368f admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:19.225173 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d433837-54c7-4d6d-8825-77e2402e368f admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:19.225446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d433837-54c7-4d6d-8825-77e2402e368f admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:19.226125 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d433837-54c7-4d6d-8825-77e2402e368f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:19.228620 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d433837-54c7-4d6d-8825-77e2402e368f admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:19.338400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1334/2644] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:23:19 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:23:19.342453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38317e-8a71-4910-b8e3-c6cd97aeb638 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:19.352898 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38317e-8a71-4910-b8e3-c6cd97aeb638 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:19.409947 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc8570-5cde-448f-a428-e1c3ba894f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:19.410625 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc8570-5cde-448f-a428-e1c3ba894f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:19.410913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc8570-5cde-448f-a428-e1c3ba894f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:19.411195 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc8570-5cde-448f-a428-e1c3ba894f7a admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:19.411897 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc8570-5cde-448f-a428-e1c3ba894f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:19.413885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc8570-5cde-448f-a428-e1c3ba894f7a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:19.486048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1311/2645] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:23:19 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:23:19.490990 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d433837-54c7-4d6d-8825-77e2402e368f admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:19.500888 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d433837-54c7-4d6d-8825-77e2402e368f admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:19.505595 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baa2ab-97c9-4813-8171-f690814911d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:19.506256 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baa2ab-97c9-4813-8171-f690814911d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:19.506539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baa2ab-97c9-4813-8171-f690814911d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:19.506816 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baa2ab-97c9-4813-8171-f690814911d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:19.507546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baa2ab-97c9-4813-8171-f690814911d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:19.509783 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baa2ab-97c9-4813-8171-f690814911d7 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:19.520917 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1335/2646] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:23:19.526160 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc8570-5cde-448f-a428-e1c3ba894f7a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:19.537478 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc8570-5cde-448f-a428-e1c3ba894f7a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:19.542928 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9e68d-a2b3-40b2-bf3d-88f4ed16619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:19.543596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9e68d-a2b3-40b2-bf3d-88f4ed16619f admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:19.543881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9e68d-a2b3-40b2-bf3d-88f4ed16619f admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:19.544158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9e68d-a2b3-40b2-bf3d-88f4ed16619f admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:19.544889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9e68d-a2b3-40b2-bf3d-88f4ed16619f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:19.546570 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9e68d-a2b3-40b2-bf3d-88f4ed16619f admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:19.558008 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1312/2647] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:23:19.562340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baa2ab-97c9-4813-8171-f690814911d7 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:19.573184 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baa2ab-97c9-4813-8171-f690814911d7 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:19.578015 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed529f-7cd1-47e8-8504-4b377af49633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:19.578992 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed529f-7cd1-47e8-8504-4b377af49633 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:19.579411 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed529f-7cd1-47e8-8504-4b377af49633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:19.579701 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed529f-7cd1-47e8-8504-4b377af49633 admin admin] PATH_INFO: `/v3/projects/5000174fef0c48f3bf9c775ed2a236c8/users/1beeb2f4efbb462ebc8a00ac0693e797/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:19.595997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed529f-7cd1-47e8-8504-4b377af49633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5000174fef0c48f3bf9c775ed2a236c8, user_id=1beeb2f4efbb462ebc8a00ac0693e797, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:19.598718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed529f-7cd1-47e8-8504-4b377af49633 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:19.644796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1336/2648] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:23:19 2022] PUT /identity/v3/projects/5000174fef0c48f3bf9c775ed2a236c8/users/1beeb2f4efbb462ebc8a00ac0693e797/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:23:19.650692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87226f2-b3e7-4e7e-92af-f1e9d9078130 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:19.651004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87226f2-b3e7-4e7e-92af-f1e9d9078130 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:19.651267 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87226f2-b3e7-4e7e-92af-f1e9d9078130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:19.668641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a87226f2-b3e7-4e7e-92af-f1e9d9078130 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:23:19.670004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a87226f2-b3e7-4e7e-92af-f1e9d9078130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:19.727619 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1313/2649] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:23:19.737181 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed529f-7cd1-47e8-8504-4b377af49633 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:19.738860 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-38ed529f-7cd1-47e8-8504-4b377af49633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:19.761780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:23:19.797282 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed529f-7cd1-47e8-8504-4b377af49633 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:19.801007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f2b1d-ed38-45da-998a-9b2e6befe33a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:19.801657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f2b1d-ed38-45da-998a-9b2e6befe33a service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:19.801940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f2b1d-ed38-45da-998a-9b2e6befe33a service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:19.802217 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f2b1d-ed38-45da-998a-9b2e6befe33a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:19.813140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f2b1d-ed38-45da-998a-9b2e6befe33a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:19.814570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f2b1d-ed38-45da-998a-9b2e6befe33a service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:19.824893 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1337/2650] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:23:21.264557 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87226f2-b3e7-4e7e-92af-f1e9d9078130 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:21.266045 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a87226f2-b3e7-4e7e-92af-f1e9d9078130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:21.278968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87226f2-b3e7-4e7e-92af-f1e9d9078130 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:21.282638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fc13c-e118-49aa-81ba-ba681db05cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:21.283318 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fc13c-e118-49aa-81ba-ba681db05cfd service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:21.283603 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fc13c-e118-49aa-81ba-ba681db05cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:21.283931 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fc13c-e118-49aa-81ba-ba681db05cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:21.285738 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-384fc13c-e118-49aa-81ba-ba681db05cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:21.298257 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fc13c-e118-49aa-81ba-ba681db05cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:21.299701 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fc13c-e118-49aa-81ba-ba681db05cfd service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:21.311322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1314/2651] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:23:22.209749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f2b1d-ed38-45da-998a-9b2e6befe33a service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:22.209749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e05f2b1d-ed38-45da-998a-9b2e6befe33a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:22.224106 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f2b1d-ed38-45da-998a-9b2e6befe33a service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:22.230650 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c5b9a-e0d0-4308-9c43-6a8547f49f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:22.231670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c5b9a-e0d0-4308-9c43-6a8547f49f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:22.231956 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c5b9a-e0d0-4308-9c43-6a8547f49f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:22.232238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c5b9a-e0d0-4308-9c43-6a8547f49f69 admin admin] PATH_INFO: `/v3/users/62fcfe1e52ca41b78ea48626dafbd1b9` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:22.233515 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c5b9a-e0d0-4308-9c43-6a8547f49f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62fcfe1e52ca41b78ea48626dafbd1b9)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:22.235489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c5b9a-e0d0-4308-9c43-6a8547f49f69 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:22.393741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7f0c5b9a-e0d0-4308-9c43-6a8547f49f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62fcfe1e52ca41b78ea48626dafbd1b9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:22.451327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7f0c5b9a-e0d0-4308-9c43-6a8547f49f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62fcfe1e52ca41b78ea48626dafbd1b9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:22.468259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7f0c5b9a-e0d0-4308-9c43-6a8547f49f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62fcfe1e52ca41b78ea48626dafbd1b9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:22.469055 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7f0c5b9a-e0d0-4308-9c43-6a8547f49f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62fcfe1e52ca41b78ea48626dafbd1b9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:22.491238 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7f0c5b9a-e0d0-4308-9c43-6a8547f49f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62fcfe1e52ca41b78ea48626dafbd1b9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:22.498462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1338/2652] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:23:22 2022] DELETE /identity/v3/users/62fcfe1e52ca41b78ea48626dafbd1b9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:23:22.895467 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fc13c-e118-49aa-81ba-ba681db05cfd service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:22.907966 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fc13c-e118-49aa-81ba-ba681db05cfd service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:22.945502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:23:22.978514 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:22.979381 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:22.979668 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:22.979951 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9 admin admin] PATH_INFO: `/v3/projects/6f5d0a17ce8d4584ada21257eea2abfa` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:22.981258 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f5d0a17ce8d4584ada21257eea2abfa)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:22.986346 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:23.103735 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f5d0a17ce8d4584ada21257eea2abfa', 'request_id': 'req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:23.110206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f5d0a17ce8d4584ada21257eea2abfa', 'request_id': 'req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:23.210910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f5d0a17ce8d4584ada21257eea2abfa', 'request_id': 'req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:23.222840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9 admin admin] The token cache is being invalidate because project 6f5d0a17ce8d4584ada21257eea2abfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:23:23.223132 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:23.223975 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:23:23.225577 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1315/2653] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:23:22 2022] DELETE /identity/v3/projects/6f5d0a17ce8d4584ada21257eea2abfa => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:23:25.473343 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894aee0-2613-4285-938b-1e642e3acffa None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:25.473894 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894aee0-2613-4285-938b-1e642e3acffa None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:25.473894 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894aee0-2613-4285-938b-1e642e3acffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:25.512156 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-1894aee0-2613-4285-938b-1e642e3acffa None None] MFA Rules not processed for user `1beeb2f4efbb462ebc8a00ac0693e797`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:23:25.513474 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-1894aee0-2613-4285-938b-1e642e3acffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:25.592336 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1339/2654] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:23:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:23:25.596416 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:25.597853 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:25.669865 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f576e-6877-4173-a901-b7c3b8f8bfd9 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:25.674796 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06b234-2e2a-4764-94a2-0ef090fca256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:25.675476 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06b234-2e2a-4764-94a2-0ef090fca256 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:25.676395 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06b234-2e2a-4764-94a2-0ef090fca256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:25.676395 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06b234-2e2a-4764-94a2-0ef090fca256 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:25.676738 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06b234-2e2a-4764-94a2-0ef090fca256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:25.678977 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06b234-2e2a-4764-94a2-0ef090fca256 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:25.744129 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1316/2655] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:23:25 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:23:25.748119 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894aee0-2613-4285-938b-1e642e3acffa None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:25.759562 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894aee0-2613-4285-938b-1e642e3acffa None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:25.780337 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:23:25.820122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c432334-feed-4ae7-87dd-73178eb7df26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:25.821237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c432334-feed-4ae7-87dd-73178eb7df26 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:25.821542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c432334-feed-4ae7-87dd-73178eb7df26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:25.821879 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c432334-feed-4ae7-87dd-73178eb7df26 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:25.822588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c432334-feed-4ae7-87dd-73178eb7df26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:25.824543 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c432334-feed-4ae7-87dd-73178eb7df26 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:25.943836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1340/2656] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:23:25 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:23:25.947498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06b234-2e2a-4764-94a2-0ef090fca256 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:25.957712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06b234-2e2a-4764-94a2-0ef090fca256 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:25.962875 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3298a4d-0483-4b87-b0b9-4911c9425806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:25.963541 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3298a4d-0483-4b87-b0b9-4911c9425806 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:25.963829 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3298a4d-0483-4b87-b0b9-4911c9425806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:25.964108 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3298a4d-0483-4b87-b0b9-4911c9425806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:25.964849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3298a4d-0483-4b87-b0b9-4911c9425806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:25.966479 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3298a4d-0483-4b87-b0b9-4911c9425806 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:25.979081 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1317/2657] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:23:25.983386 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c432334-feed-4ae7-87dd-73178eb7df26 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:25.993542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c432334-feed-4ae7-87dd-73178eb7df26 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:25.998134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95960281-dfe3-431a-b3d1-47e3c2a0dd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:26.001271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95960281-dfe3-431a-b3d1-47e3c2a0dd65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:26.001271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95960281-dfe3-431a-b3d1-47e3c2a0dd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:26.001271 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95960281-dfe3-431a-b3d1-47e3c2a0dd65 admin admin] PATH_INFO: `/v3/projects/8fcb5cc621b74a15a274797859cdc07c/users/ad44c61281224c5e9c1b666b52577bc3/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:26.014665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95960281-dfe3-431a-b3d1-47e3c2a0dd65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fcb5cc621b74a15a274797859cdc07c, user_id=ad44c61281224c5e9c1b666b52577bc3, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:26.017400 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95960281-dfe3-431a-b3d1-47e3c2a0dd65 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:26.101385 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1341/2658] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:23:25 2022] PUT /identity/v3/projects/8fcb5cc621b74a15a274797859cdc07c/users/ad44c61281224c5e9c1b666b52577bc3/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:23:26.105740 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3298a4d-0483-4b87-b0b9-4911c9425806 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:26.116237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3298a4d-0483-4b87-b0b9-4911c9425806 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:26.149604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:23:26.173052 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f6b72-becf-46a3-960c-c00e8eb30dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:26.173742 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f6b72-becf-46a3-960c-c00e8eb30dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:26.174030 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f6b72-becf-46a3-960c-c00e8eb30dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:26.174318 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f6b72-becf-46a3-960c-c00e8eb30dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:26.175054 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f6b72-becf-46a3-960c-c00e8eb30dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:26.176708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f6b72-becf-46a3-960c-c00e8eb30dc6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:26.191738 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1318/2659] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:23:26.192484 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95960281-dfe3-431a-b3d1-47e3c2a0dd65 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:26.203612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95960281-dfe3-431a-b3d1-47e3c2a0dd65 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:26.208402 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e4c30-083c-427f-a06a-65c13df75d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:26.209333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e4c30-083c-427f-a06a-65c13df75d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:26.209625 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e4c30-083c-427f-a06a-65c13df75d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:26.209915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e4c30-083c-427f-a06a-65c13df75d29 admin admin] PATH_INFO: `/v3/projects/8fcb5cc621b74a15a274797859cdc07c/users/ad44c61281224c5e9c1b666b52577bc3/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:26.211951 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e4c30-083c-427f-a06a-65c13df75d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fcb5cc621b74a15a274797859cdc07c, user_id=ad44c61281224c5e9c1b666b52577bc3, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:26.214714 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e4c30-083c-427f-a06a-65c13df75d29 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:26.225432 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1342/2660] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:23:26 2022] PUT /identity/v3/projects/8fcb5cc621b74a15a274797859cdc07c/users/ad44c61281224c5e9c1b666b52577bc3/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:23:31.774149 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c0583-1727-4d50-9223-1a2c5282d5ac None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:31.774660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c0583-1727-4d50-9223-1a2c5282d5ac None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:31.774660 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c0583-1727-4d50-9223-1a2c5282d5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:31.802488 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0b9c0583-1727-4d50-9223-1a2c5282d5ac None None] MFA Rules not processed for user `ad44c61281224c5e9c1b666b52577bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:23:31.803962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0b9c0583-1727-4d50-9223-1a2c5282d5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:31.881490 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1319/2661] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:23:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:23:31.899097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e4c30-083c-427f-a06a-65c13df75d29 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:23:31.901180 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b30e4c30-083c-427f-a06a-65c13df75d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:32.015386 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e4c30-083c-427f-a06a-65c13df75d29 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:23:32.021241 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4439335-ba20-4bfa-844f-f8d3a56612af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:23:32.024424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4439335-ba20-4bfa-844f-f8d3a56612af service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:32.024424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4439335-ba20-4bfa-844f-f8d3a56612af service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:32.024424 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4439335-ba20-4bfa-844f-f8d3a56612af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:32.071060 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:23:32.080826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4439335-ba20-4bfa-844f-f8d3a56612af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:23:32.082643 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4439335-ba20-4bfa-844f-f8d3a56612af service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:23:32.091493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1343/2662] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:23:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:23:34.482317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e045d-7651-4ffd-8354-f92b825d0095 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:23:34.482854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e045d-7651-4ffd-8354-f92b825d0095 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:23:34.482854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e045d-7651-4ffd-8354-f92b825d0095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:23:34.501367 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ca9e045d-7651-4ffd-8354-f92b825d0095 None None] MFA Rules not processed for user `1beeb2f4efbb462ebc8a00ac0693e797`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:23:34.502791 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ca9e045d-7651-4ffd-8354-f92b825d0095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:23:34.510549 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1320/2663] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:23:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:23:42.296566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=6 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:23:44.495286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=49 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:24:17.332705 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4439335-ba20-4bfa-844f-f8d3a56612af service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:24:17.346954 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4439335-ba20-4bfa-844f-f8d3a56612af service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:24:17.353512 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3ad00-3537-4b79-8ed8-1d1533f62cf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:24:17.354305 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3ad00-3537-4b79-8ed8-1d1533f62cf8 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:24:17.354593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3ad00-3537-4b79-8ed8-1d1533f62cf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:24:17.354869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3ad00-3537-4b79-8ed8-1d1533f62cf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:24:17.356610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d7b3ad00-3537-4b79-8ed8-1d1533f62cf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:24:17.432951 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3ad00-3537-4b79-8ed8-1d1533f62cf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:24:17.435155 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3ad00-3537-4b79-8ed8-1d1533f62cf8 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:24:17.444907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1344/2664] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:24:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:24:21.986798 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e045d-7651-4ffd-8354-f92b825d0095 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:24:22.007266 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e045d-7651-4ffd-8354-f92b825d0095 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:24:22.020727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2dc7e-41b6-469b-bcd5-d277b523fa7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:24:22.022230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2dc7e-41b6-469b-bcd5-d277b523fa7d service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:24:22.022515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2dc7e-41b6-469b-bcd5-d277b523fa7d service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:24:22.022795 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2dc7e-41b6-469b-bcd5-d277b523fa7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:24:22.024602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f0e2dc7e-41b6-469b-bcd5-d277b523fa7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:24:22.038226 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2dc7e-41b6-469b-bcd5-d277b523fa7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:24:22.039888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2dc7e-41b6-469b-bcd5-d277b523fa7d service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:24:22.050737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1321/2665] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:24:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:24:24.934425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3ad00-3537-4b79-8ed8-1d1533f62cf8 service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:24:24.934425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d7b3ad00-3537-4b79-8ed8-1d1533f62cf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:24:24.989578 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3ad00-3537-4b79-8ed8-1d1533f62cf8 service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:24:24.993648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a6ec6-e244-4609-b247-1bf628455580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:24:24.994325 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a6ec6-e244-4609-b247-1bf628455580 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:24:24.994613 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a6ec6-e244-4609-b247-1bf628455580 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:24:24.994899 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a6ec6-e244-4609-b247-1bf628455580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:24:25.003841 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a6ec6-e244-4609-b247-1bf628455580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:24:25.005350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a6ec6-e244-4609-b247-1bf628455580 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:24:25.019855 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1345/2666] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:24:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:24:32.046170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=6 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:24:35.013830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=59 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:24:43.830027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dc055-6870-43df-aca9-4e6ebd16f500 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:24:43.830588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dc055-6870-43df-aca9-4e6ebd16f500 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:24:43.830588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dc055-6870-43df-aca9-4e6ebd16f500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:24:43.849118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ea8dc055-6870-43df-aca9-4e6ebd16f500 None None] MFA Rules not processed for user `eb6555ff5f3f4823aee38990265d3a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:24:43.851230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ea8dc055-6870-43df-aca9-4e6ebd16f500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:24:43.913611 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1322/2667] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:24:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:24:46.781149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a6ec6-e244-4609-b247-1bf628455580 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:24:46.790236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a6ec6-e244-4609-b247-1bf628455580 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:24:46.793929 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a26762-f572-48b5-b982-73646aea3d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:24:46.794571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a26762-f572-48b5-b982-73646aea3d26 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:24:46.794855 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a26762-f572-48b5-b982-73646aea3d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:24:46.795133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a26762-f572-48b5-b982-73646aea3d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:24:46.796910 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-77a26762-f572-48b5-b982-73646aea3d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:24:46.812174 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a26762-f572-48b5-b982-73646aea3d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:24:46.813641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a26762-f572-48b5-b982-73646aea3d26 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:24:46.825668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1346/2668] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:24:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:24:49.797295 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dc055-6870-43df-aca9-4e6ebd16f500 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:24:49.798732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ea8dc055-6870-43df-aca9-4e6ebd16f500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:24:49.907940 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dc055-6870-43df-aca9-4e6ebd16f500 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:24:49.915095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4d841-6ec9-49c3-8c81-08286a58226c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:24:49.915827 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4d841-6ec9-49c3-8c81-08286a58226c service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:24:49.916160 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4d841-6ec9-49c3-8c81-08286a58226c service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:24:49.916550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4d841-6ec9-49c3-8c81-08286a58226c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:24:49.918587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4dc4d841-6ec9-49c3-8c81-08286a58226c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:24:49.939638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4d841-6ec9-49c3-8c81-08286a58226c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:24:49.941299 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4d841-6ec9-49c3-8c81-08286a58226c service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:24:49.952826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1323/2669] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:24:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:24:56.820516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=6 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:24:59.948109 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=62 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:04.192522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a26762-f572-48b5-b982-73646aea3d26 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:04.194071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-77a26762-f572-48b5-b982-73646aea3d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:04.205648 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a26762-f572-48b5-b982-73646aea3d26 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:04.209358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a67a3-9928-4ac4-b4c7-ed9b12010d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:04.210008 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a67a3-9928-4ac4-b4c7-ed9b12010d25 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:04.210389 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a67a3-9928-4ac4-b4c7-ed9b12010d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:04.210562 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a67a3-9928-4ac4-b4c7-ed9b12010d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:04.212478 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a06a67a3-9928-4ac4-b4c7-ed9b12010d25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:04.278088 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a67a3-9928-4ac4-b4c7-ed9b12010d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:04.279707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a67a3-9928-4ac4-b4c7-ed9b12010d25 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:04.289969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1347/2670] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:25:08.345014 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4d841-6ec9-49c3-8c81-08286a58226c service placement] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:08.346531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4dc4d841-6ec9-49c3-8c81-08286a58226c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:08.362174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4d841-6ec9-49c3-8c81-08286a58226c service placement] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:08.366893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b07293-658d-4b3f-8054-cc2177339ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:08.367769 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b07293-658d-4b3f-8054-cc2177339ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:08.368054 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b07293-658d-4b3f-8054-cc2177339ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:08.368334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b07293-658d-4b3f-8054-cc2177339ead admin admin] PATH_INFO: `/v3/users/7e29d3b37ec342fe91765a8b13354bf3` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:08.369628 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b07293-658d-4b3f-8054-cc2177339ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e29d3b37ec342fe91765a8b13354bf3)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:08.371588 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b07293-658d-4b3f-8054-cc2177339ead admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:08.593069 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-10b07293-658d-4b3f-8054-cc2177339ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e29d3b37ec342fe91765a8b13354bf3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:08.681035 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-10b07293-658d-4b3f-8054-cc2177339ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e29d3b37ec342fe91765a8b13354bf3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:08.689072 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-10b07293-658d-4b3f-8054-cc2177339ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e29d3b37ec342fe91765a8b13354bf3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:08.689714 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-10b07293-658d-4b3f-8054-cc2177339ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e29d3b37ec342fe91765a8b13354bf3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:08.702426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-10b07293-658d-4b3f-8054-cc2177339ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e29d3b37ec342fe91765a8b13354bf3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:08.708531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1324/2671] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:25:08 2022] DELETE /identity/v3/users/7e29d3b37ec342fe91765a8b13354bf3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:25:08.956800 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a67a3-9928-4ac4-b4c7-ed9b12010d25 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:08.966993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a67a3-9928-4ac4-b4c7-ed9b12010d25 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:09.026934 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1688fc6-8149-4ec7-8e41-e5d96e8b2875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:09.027803 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1688fc6-8149-4ec7-8e41-e5d96e8b2875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:09.028092 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1688fc6-8149-4ec7-8e41-e5d96e8b2875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:09.028374 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1688fc6-8149-4ec7-8e41-e5d96e8b2875 admin admin] PATH_INFO: `/v3/projects/3206503b47eb4a098fb233aa8bd39332` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:09.029630 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1688fc6-8149-4ec7-8e41-e5d96e8b2875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3206503b47eb4a098fb233aa8bd39332)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:09.031560 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1688fc6-8149-4ec7-8e41-e5d96e8b2875 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:09.166658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c1688fc6-8149-4ec7-8e41-e5d96e8b2875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3206503b47eb4a098fb233aa8bd39332', 'request_id': 'req-c1688fc6-8149-4ec7-8e41-e5d96e8b2875'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:09.172873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c1688fc6-8149-4ec7-8e41-e5d96e8b2875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3206503b47eb4a098fb233aa8bd39332', 'request_id': 'req-c1688fc6-8149-4ec7-8e41-e5d96e8b2875'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:09.315259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c1688fc6-8149-4ec7-8e41-e5d96e8b2875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3206503b47eb4a098fb233aa8bd39332', 'request_id': 'req-c1688fc6-8149-4ec7-8e41-e5d96e8b2875'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:09.327086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c1688fc6-8149-4ec7-8e41-e5d96e8b2875 admin admin] The token cache is being invalidate because project 3206503b47eb4a098fb233aa8bd39332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:25:09.327375 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c1688fc6-8149-4ec7-8e41-e5d96e8b2875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:09.328011 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c1688fc6-8149-4ec7-8e41-e5d96e8b2875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:09.329611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1348/2672] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:25:08 2022] DELETE /identity/v3/projects/3206503b47eb4a098fb233aa8bd39332 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:25:09.334595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa5e98-671c-4b91-ae99-a78062c9d1bc None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:09.334889 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa5e98-671c-4b91-ae99-a78062c9d1bc None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:09.335195 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa5e98-671c-4b91-ae99-a78062c9d1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:09.354291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-f7aa5e98-671c-4b91-ae99-a78062c9d1bc None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:25:09.358663 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f7aa5e98-671c-4b91-ae99-a78062c9d1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:09.414038 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1325/2673] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:25:09.422374 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10e1a2-811e-477f-bc72-e33bb415be51 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:09.422551 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10e1a2-811e-477f-bc72-e33bb415be51 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:09.422829 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10e1a2-811e-477f-bc72-e33bb415be51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:09.442728 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-8a10e1a2-811e-477f-bc72-e33bb415be51 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:25:09.444105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8a10e1a2-811e-477f-bc72-e33bb415be51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:09.452746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1349/2674] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:25:09.457176 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa5e98-671c-4b91-ae99-a78062c9d1bc None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:09.471216 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa5e98-671c-4b91-ae99-a78062c9d1bc None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:09.477619 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62137667-d466-40b8-9016-dfb903393f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:09.478323 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62137667-d466-40b8-9016-dfb903393f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:09.479168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62137667-d466-40b8-9016-dfb903393f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:09.479850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62137667-d466-40b8-9016-dfb903393f1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:09.480198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62137667-d466-40b8-9016-dfb903393f1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:25:09.480513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62137667-d466-40b8-9016-dfb903393f1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:09.482230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62137667-d466-40b8-9016-dfb903393f1b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:09.495833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1326/2675] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:25:09.499991 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10e1a2-811e-477f-bc72-e33bb415be51 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:09.510024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10e1a2-811e-477f-bc72-e33bb415be51 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:09.515255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e66949-489c-4f6a-84e3-23bee12c6bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:09.515927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e66949-489c-4f6a-84e3-23bee12c6bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:09.516215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e66949-489c-4f6a-84e3-23bee12c6bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:09.516493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e66949-489c-4f6a-84e3-23bee12c6bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:09.517236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e66949-489c-4f6a-84e3-23bee12c6bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:09.519132 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e66949-489c-4f6a-84e3-23bee12c6bd2 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:09.533877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:09.659969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1350/2676] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:25:09 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:25:09.663946 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62137667-d466-40b8-9016-dfb903393f1b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:09.675032 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62137667-d466-40b8-9016-dfb903393f1b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:09.730736 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23f75a-0a8f-4f9f-b4f3-d9f281535944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:09.731424 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23f75a-0a8f-4f9f-b4f3-d9f281535944 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:09.731709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23f75a-0a8f-4f9f-b4f3-d9f281535944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:09.731986 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23f75a-0a8f-4f9f-b4f3-d9f281535944 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:09.732678 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23f75a-0a8f-4f9f-b4f3-d9f281535944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:09.734614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23f75a-0a8f-4f9f-b4f3-d9f281535944 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:09.741148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:09.858670 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1327/2677] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:25:09 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:25:09.862744 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e66949-489c-4f6a-84e3-23bee12c6bd2 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:09.873222 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e66949-489c-4f6a-84e3-23bee12c6bd2 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:09.877886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79ec0f-85df-4bec-a85d-358c656c8a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:09.878551 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79ec0f-85df-4bec-a85d-358c656c8a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:09.878836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79ec0f-85df-4bec-a85d-358c656c8a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:09.879140 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79ec0f-85df-4bec-a85d-358c656c8a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:09.879869 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79ec0f-85df-4bec-a85d-358c656c8a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:09.881497 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79ec0f-85df-4bec-a85d-358c656c8a3e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:09.892202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1351/2678] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:25:09.896291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23f75a-0a8f-4f9f-b4f3-d9f281535944 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:09.907153 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23f75a-0a8f-4f9f-b4f3-d9f281535944 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:09.931396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cc0d6-035e-421a-816c-3d9a4cca7d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:09.931396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cc0d6-035e-421a-816c-3d9a4cca7d19 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:09.931396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cc0d6-035e-421a-816c-3d9a4cca7d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:09.931396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cc0d6-035e-421a-816c-3d9a4cca7d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:09.932516 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cc0d6-035e-421a-816c-3d9a4cca7d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:09.932516 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cc0d6-035e-421a-816c-3d9a4cca7d19 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:09.932516 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1328/2679] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:25:09.934772 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79ec0f-85df-4bec-a85d-358c656c8a3e admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:09.945398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79ec0f-85df-4bec-a85d-358c656c8a3e admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:09.950695 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0c2da-e3c1-40d9-b328-18d1b47ff5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:09.951598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0c2da-e3c1-40d9-b328-18d1b47ff5c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:09.951881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0c2da-e3c1-40d9-b328-18d1b47ff5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:09.952154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0c2da-e3c1-40d9-b328-18d1b47ff5c5 admin admin] PATH_INFO: `/v3/projects/c630c4d2528d48f099e51a20d8df7025/users/7cdfa4e037f145c28f92de06739568f9/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:09.967526 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0c2da-e3c1-40d9-b328-18d1b47ff5c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c630c4d2528d48f099e51a20d8df7025, user_id=7cdfa4e037f145c28f92de06739568f9, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:09.970216 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0c2da-e3c1-40d9-b328-18d1b47ff5c5 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:10.132620 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1352/2680] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:25:09 2022] PUT /identity/v3/projects/c630c4d2528d48f099e51a20d8df7025/users/7cdfa4e037f145c28f92de06739568f9/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:25:10.144064 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775d2e9-d3ba-4b77-902d-1e4e71014907 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:10.144357 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775d2e9-d3ba-4b77-902d-1e4e71014907 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:10.144642 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775d2e9-d3ba-4b77-902d-1e4e71014907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:10.171805 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-3775d2e9-d3ba-4b77-902d-1e4e71014907 None None] MFA Rules not processed for user `7cdfa4e037f145c28f92de06739568f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:25:10.174661 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-3775d2e9-d3ba-4b77-902d-1e4e71014907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:10.238601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1329/2681] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:25:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:25:10.250430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0c2da-e3c1-40d9-b328-18d1b47ff5c5 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:10.252165 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-62c0c2da-e3c1-40d9-b328-18d1b47ff5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:10.325163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0c2da-e3c1-40d9-b328-18d1b47ff5c5 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:10.330747 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04870e38-e2c3-420c-ad3c-1404246a36f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:10.331392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04870e38-e2c3-420c-ad3c-1404246a36f0 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:10.331679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04870e38-e2c3-420c-ad3c-1404246a36f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:10.331961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04870e38-e2c3-420c-ad3c-1404246a36f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:10.340340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04870e38-e2c3-420c-ad3c-1404246a36f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:10.341951 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04870e38-e2c3-420c-ad3c-1404246a36f0 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:10.350702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1353/2682] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:25:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:25:20.235392 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:20.346736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=51,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:21.975258 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775d2e9-d3ba-4b77-902d-1e4e71014907 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:22.036667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775d2e9-d3ba-4b77-902d-1e4e71014907 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:22.041223 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3962a-ac8a-49b1-a2c2-6bc54130dbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:22.042092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3962a-ac8a-49b1-a2c2-6bc54130dbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:22.042378 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3962a-ac8a-49b1-a2c2-6bc54130dbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:22.042652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3962a-ac8a-49b1-a2c2-6bc54130dbd8 admin admin] PATH_INFO: `/v3/users/7cdfa4e037f145c28f92de06739568f9` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:22.043819 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3962a-ac8a-49b1-a2c2-6bc54130dbd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cdfa4e037f145c28f92de06739568f9)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:22.045797 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3962a-ac8a-49b1-a2c2-6bc54130dbd8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:22.238553 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-11d3962a-ac8a-49b1-a2c2-6bc54130dbd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cdfa4e037f145c28f92de06739568f9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:22.332489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-11d3962a-ac8a-49b1-a2c2-6bc54130dbd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cdfa4e037f145c28f92de06739568f9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:22.340197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-11d3962a-ac8a-49b1-a2c2-6bc54130dbd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cdfa4e037f145c28f92de06739568f9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:22.341811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-11d3962a-ac8a-49b1-a2c2-6bc54130dbd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cdfa4e037f145c28f92de06739568f9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:22.353338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-11d3962a-ac8a-49b1-a2c2-6bc54130dbd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cdfa4e037f145c28f92de06739568f9'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:22.359257 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1330/2683] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:25:21 2022] DELETE /identity/v3/users/7cdfa4e037f145c28f92de06739568f9 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:25:22.364247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fbee1-6264-48a0-9c6a-be24389da5ab None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:22.364772 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fbee1-6264-48a0-9c6a-be24389da5ab None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:22.364922 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fbee1-6264-48a0-9c6a-be24389da5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:22.381557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-d84fbee1-6264-48a0-9c6a-be24389da5ab None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:25:22.382765 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d84fbee1-6264-48a0-9c6a-be24389da5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:22.441105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1354/2684] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:25:22.450878 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3962a-ac8a-49b1-a2c2-6bc54130dbd8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:22.452309 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-11d3962a-ac8a-49b1-a2c2-6bc54130dbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:22.513187 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3962a-ac8a-49b1-a2c2-6bc54130dbd8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:22.517529 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1635f-1953-4f8a-87fb-4933ecf97efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:22.518280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1635f-1953-4f8a-87fb-4933ecf97efa service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:22.518569 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1635f-1953-4f8a-87fb-4933ecf97efa service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:22.518849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1635f-1953-4f8a-87fb-4933ecf97efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:22.529249 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1635f-1953-4f8a-87fb-4933ecf97efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:22.530881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1635f-1953-4f8a-87fb-4933ecf97efa service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:22.540979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1331/2685] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:25:23.036488 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fbee1-6264-48a0-9c6a-be24389da5ab None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:23.042169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d84fbee1-6264-48a0-9c6a-be24389da5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:23.053771 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fbee1-6264-48a0-9c6a-be24389da5ab None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:23.060136 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3f523-0eb2-4946-a022-df9ad9d20119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:23.061668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3f523-0eb2-4946-a022-df9ad9d20119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:23.062170 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3f523-0eb2-4946-a022-df9ad9d20119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:23.062665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3f523-0eb2-4946-a022-df9ad9d20119 admin admin] PATH_INFO: `/v3/projects/c630c4d2528d48f099e51a20d8df7025` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:23.065413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3f523-0eb2-4946-a022-df9ad9d20119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c630c4d2528d48f099e51a20d8df7025)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:23.069231 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3f523-0eb2-4946-a022-df9ad9d20119 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:23.212536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f9e3f523-0eb2-4946-a022-df9ad9d20119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c630c4d2528d48f099e51a20d8df7025', 'request_id': 'req-f9e3f523-0eb2-4946-a022-df9ad9d20119'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:23.218709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f9e3f523-0eb2-4946-a022-df9ad9d20119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c630c4d2528d48f099e51a20d8df7025', 'request_id': 'req-f9e3f523-0eb2-4946-a022-df9ad9d20119'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:23.309227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f9e3f523-0eb2-4946-a022-df9ad9d20119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c630c4d2528d48f099e51a20d8df7025', 'request_id': 'req-f9e3f523-0eb2-4946-a022-df9ad9d20119'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:23.321139 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f9e3f523-0eb2-4946-a022-df9ad9d20119 admin admin] The token cache is being invalidate because project c630c4d2528d48f099e51a20d8df7025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:25:23.326697 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f9e3f523-0eb2-4946-a022-df9ad9d20119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:23.326697 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-f9e3f523-0eb2-4946-a022-df9ad9d20119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:23.326697 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1355/2686] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:25:23 2022] DELETE /identity/v3/projects/c630c4d2528d48f099e51a20d8df7025 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:25:23.330168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d88cd-213f-4262-87da-88677d578c31 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:23.330675 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d88cd-213f-4262-87da-88677d578c31 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:23.330897 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d88cd-213f-4262-87da-88677d578c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:23.348618 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-9c7d88cd-213f-4262-87da-88677d578c31 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:25:23.349962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9c7d88cd-213f-4262-87da-88677d578c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:23.368876 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:23.410751 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1332/2687] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:25:23.419380 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0e5a9-f3b7-4ed1-9b25-f756d8f47cda None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:23.419946 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0e5a9-f3b7-4ed1-9b25-f756d8f47cda None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:23.419946 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0e5a9-f3b7-4ed1-9b25-f756d8f47cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:23.439846 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-a7e0e5a9-f3b7-4ed1-9b25-f756d8f47cda None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:25:23.443370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a7e0e5a9-f3b7-4ed1-9b25-f756d8f47cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:23.448985 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1356/2688] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:25:23.453200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d88cd-213f-4262-87da-88677d578c31 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:23.463016 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d88cd-213f-4262-87da-88677d578c31 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:23.467960 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0cad1-487a-4f68-9f88-7f007847ab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:23.468893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0cad1-487a-4f68-9f88-7f007847ab86 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:23.469388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0cad1-487a-4f68-9f88-7f007847ab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:23.470092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0cad1-487a-4f68-9f88-7f007847ab86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:23.471008 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0cad1-487a-4f68-9f88-7f007847ab86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:25:23.471306 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0cad1-487a-4f68-9f88-7f007847ab86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:23.472921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0cad1-487a-4f68-9f88-7f007847ab86 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:23.485304 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1333/2689] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:25:23.490120 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0e5a9-f3b7-4ed1-9b25-f756d8f47cda None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:23.499446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0e5a9-f3b7-4ed1-9b25-f756d8f47cda None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:23.504786 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beb24d-0950-414b-a1ce-7b28047f8465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:23.505483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beb24d-0950-414b-a1ce-7b28047f8465 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:23.505768 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beb24d-0950-414b-a1ce-7b28047f8465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:23.506044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beb24d-0950-414b-a1ce-7b28047f8465 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:23.506741 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beb24d-0950-414b-a1ce-7b28047f8465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:23.508628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beb24d-0950-414b-a1ce-7b28047f8465 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:23.660086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1357/2690] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:25:23 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:25:23.664197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0cad1-487a-4f68-9f88-7f007847ab86 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:23.675094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0cad1-487a-4f68-9f88-7f007847ab86 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:23.731831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0607a94-3486-45f4-947b-2e2e03baae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:23.732498 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0607a94-3486-45f4-947b-2e2e03baae43 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:23.732778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0607a94-3486-45f4-947b-2e2e03baae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:23.733083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0607a94-3486-45f4-947b-2e2e03baae43 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:23.733770 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0607a94-3486-45f4-947b-2e2e03baae43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:23.736352 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0607a94-3486-45f4-947b-2e2e03baae43 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:23.840672 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1334/2691] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:25:23 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:25:23.845588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beb24d-0950-414b-a1ce-7b28047f8465 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:23.855818 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beb24d-0950-414b-a1ce-7b28047f8465 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:23.860484 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee665770-4805-4c9a-aba1-787fbd9eba5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:23.861756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee665770-4805-4c9a-aba1-787fbd9eba5a admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:23.862048 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee665770-4805-4c9a-aba1-787fbd9eba5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:23.862379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee665770-4805-4c9a-aba1-787fbd9eba5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:23.863111 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee665770-4805-4c9a-aba1-787fbd9eba5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:23.864711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee665770-4805-4c9a-aba1-787fbd9eba5a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:23.875035 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1358/2692] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:25:23.879045 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0607a94-3486-45f4-947b-2e2e03baae43 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:23.889054 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0607a94-3486-45f4-947b-2e2e03baae43 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:23.893885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20221d85-3e5c-4ac1-acde-86ca1a7bbcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:23.894538 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20221d85-3e5c-4ac1-acde-86ca1a7bbcfe admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:23.894831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20221d85-3e5c-4ac1-acde-86ca1a7bbcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:23.895110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20221d85-3e5c-4ac1-acde-86ca1a7bbcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:23.895837 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20221d85-3e5c-4ac1-acde-86ca1a7bbcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:23.897459 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20221d85-3e5c-4ac1-acde-86ca1a7bbcfe admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:23.907085 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1335/2693] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:25:23.911580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee665770-4805-4c9a-aba1-787fbd9eba5a admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:23.921429 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee665770-4805-4c9a-aba1-787fbd9eba5a admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:23.926915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d42f1-ec73-4aad-9ef1-73c94c57b3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:23.927799 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d42f1-ec73-4aad-9ef1-73c94c57b3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:23.928086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d42f1-ec73-4aad-9ef1-73c94c57b3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:23.928364 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d42f1-ec73-4aad-9ef1-73c94c57b3c4 admin admin] PATH_INFO: `/v3/projects/ad66e712870643efaf9058a6af533ab6/users/432ffde0b15c46b1bf8da44648a66b32/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:23.944594 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d42f1-ec73-4aad-9ef1-73c94c57b3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad66e712870643efaf9058a6af533ab6, user_id=432ffde0b15c46b1bf8da44648a66b32, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:23.947315 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d42f1-ec73-4aad-9ef1-73c94c57b3c4 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:24.024025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1359/2694] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:25:23 2022] PUT /identity/v3/projects/ad66e712870643efaf9058a6af533ab6/users/432ffde0b15c46b1bf8da44648a66b32/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:25:24.034888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e4e49-5df5-4cc1-b40d-85f8de9edac4 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:24.035180 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e4e49-5df5-4cc1-b40d-85f8de9edac4 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:24.035457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e4e49-5df5-4cc1-b40d-85f8de9edac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:24.062777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-266e4e49-5df5-4cc1-b40d-85f8de9edac4 None None] MFA Rules not processed for user `432ffde0b15c46b1bf8da44648a66b32`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:25:24.064518 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-266e4e49-5df5-4cc1-b40d-85f8de9edac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:24.128200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1336/2695] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:25:24.132737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d42f1-ec73-4aad-9ef1-73c94c57b3c4 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:24.153921 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:24.194861 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d42f1-ec73-4aad-9ef1-73c94c57b3c4 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:24.200212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b9697-a7e2-42dd-be45-7fa34bda7131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:24.200880 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b9697-a7e2-42dd-be45-7fa34bda7131 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:24.201200 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b9697-a7e2-42dd-be45-7fa34bda7131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:24.201483 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b9697-a7e2-42dd-be45-7fa34bda7131 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:24.202175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b9697-a7e2-42dd-be45-7fa34bda7131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:24.204132 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b9697-a7e2-42dd-be45-7fa34bda7131 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:24.287950 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1360/2696] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:25:24 2022] POST /identity/v3/projects => generated 369 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:25:24.291990 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e4e49-5df5-4cc1-b40d-85f8de9edac4 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:24.302986 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e4e49-5df5-4cc1-b40d-85f8de9edac4 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:24.315662 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:24.358891 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f63fc6-3b6a-4f4b-b4ad-c664ed58c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:24.359555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f63fc6-3b6a-4f4b-b4ad-c664ed58c083 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:24.359847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f63fc6-3b6a-4f4b-b4ad-c664ed58c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:24.360127 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f63fc6-3b6a-4f4b-b4ad-c664ed58c083 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:24.360860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f63fc6-3b6a-4f4b-b4ad-c664ed58c083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:24.362893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f63fc6-3b6a-4f4b-b4ad-c664ed58c083 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:24.510269 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1337/2697] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:25:24 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:25:24.519368 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b9697-a7e2-42dd-be45-7fa34bda7131 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:24.525176 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b9697-a7e2-42dd-be45-7fa34bda7131 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:24.529774 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243294c1-6d4b-4b19-989d-b69ccadc759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:24.530438 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243294c1-6d4b-4b19-989d-b69ccadc759e admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:24.530723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243294c1-6d4b-4b19-989d-b69ccadc759e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:24.531001 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243294c1-6d4b-4b19-989d-b69ccadc759e admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:24.531850 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243294c1-6d4b-4b19-989d-b69ccadc759e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:24.533732 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243294c1-6d4b-4b19-989d-b69ccadc759e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:24.544457 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1361/2698] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:25:24.548436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f63fc6-3b6a-4f4b-b4ad-c664ed58c083 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:24.558774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f63fc6-3b6a-4f4b-b4ad-c664ed58c083 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:24.563376 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ca751-1346-4453-8f55-85fbe5805317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:24.564900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ca751-1346-4453-8f55-85fbe5805317 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:24.565217 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ca751-1346-4453-8f55-85fbe5805317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:24.565499 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ca751-1346-4453-8f55-85fbe5805317 admin admin] PATH_INFO: `/v3/projects/7d7dbc94dc6e4c3bbba1c2f7c9076348/users/2b12665e313f4020a2e462735f72da14/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:24.581072 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ca751-1346-4453-8f55-85fbe5805317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7dbc94dc6e4c3bbba1c2f7c9076348, user_id=2b12665e313f4020a2e462735f72da14, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:24.583727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ca751-1346-4453-8f55-85fbe5805317 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:24.705294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1338/2699] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:25:24 2022] PUT /identity/v3/projects/7d7dbc94dc6e4c3bbba1c2f7c9076348/users/2b12665e313f4020a2e462735f72da14/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:25:24.709485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243294c1-6d4b-4b19-989d-b69ccadc759e admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:24.719332 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243294c1-6d4b-4b19-989d-b69ccadc759e admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:24.774809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8046cd-76ac-41fc-843e-1ccb9213809c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:24.775518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8046cd-76ac-41fc-843e-1ccb9213809c admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:24.775803 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8046cd-76ac-41fc-843e-1ccb9213809c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:24.776078 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8046cd-76ac-41fc-843e-1ccb9213809c admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:24.776785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8046cd-76ac-41fc-843e-1ccb9213809c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:24.778394 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8046cd-76ac-41fc-843e-1ccb9213809c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:24.787997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1362/2700] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:25:24.792029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ca751-1346-4453-8f55-85fbe5805317 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:24.802425 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ca751-1346-4453-8f55-85fbe5805317 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:24.807867 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c1e4c-aa0f-48c4-b859-54400653dc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:24.808776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c1e4c-aa0f-48c4-b859-54400653dc9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:24.809079 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c1e4c-aa0f-48c4-b859-54400653dc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:24.809484 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c1e4c-aa0f-48c4-b859-54400653dc9e admin admin] PATH_INFO: `/v3/projects/7d7dbc94dc6e4c3bbba1c2f7c9076348/users/2b12665e313f4020a2e462735f72da14/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:24.811619 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c1e4c-aa0f-48c4-b859-54400653dc9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7dbc94dc6e4c3bbba1c2f7c9076348, user_id=2b12665e313f4020a2e462735f72da14, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:24.814954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c1e4c-aa0f-48c4-b859-54400653dc9e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:24.825927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1339/2701] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:25:24 2022] PUT /identity/v3/projects/7d7dbc94dc6e4c3bbba1c2f7c9076348/users/2b12665e313f4020a2e462735f72da14/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:25:24.838013 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850b12f-bf27-4fe6-8a7e-5251ed747bc4 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:24.838311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850b12f-bf27-4fe6-8a7e-5251ed747bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:24.838627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850b12f-bf27-4fe6-8a7e-5251ed747bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:24.864931 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-d850b12f-bf27-4fe6-8a7e-5251ed747bc4 None None] MFA Rules not processed for user `2b12665e313f4020a2e462735f72da14`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:25:24.866172 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d850b12f-bf27-4fe6-8a7e-5251ed747bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:24.933947 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1363/2702] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:25:24.945231 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c1e4c-aa0f-48c4-b859-54400653dc9e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:24.946924 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-be6c1e4c-aa0f-48c4-b859-54400653dc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:25.005583 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c1e4c-aa0f-48c4-b859-54400653dc9e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:25.009374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7b80b-0042-4723-8e72-173d71a5471d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:25.010022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7b80b-0042-4723-8e72-173d71a5471d service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:25.010311 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7b80b-0042-4723-8e72-173d71a5471d service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:25.010592 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7b80b-0042-4723-8e72-173d71a5471d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:25.019860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7b80b-0042-4723-8e72-173d71a5471d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:25.021331 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7b80b-0042-4723-8e72-173d71a5471d service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:25.030631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1340/2703] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:25:24 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:25:28.109870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850b12f-bf27-4fe6-8a7e-5251ed747bc4 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:28.128758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:28.175276 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850b12f-bf27-4fe6-8a7e-5251ed747bc4 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:28.181885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c8a34-d44b-4c9d-b40d-2bfbb22ce6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:28.182754 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c8a34-d44b-4c9d-b40d-2bfbb22ce6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:28.183038 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c8a34-d44b-4c9d-b40d-2bfbb22ce6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:28.183317 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c8a34-d44b-4c9d-b40d-2bfbb22ce6ba admin admin] PATH_INFO: `/v3/users/432ffde0b15c46b1bf8da44648a66b32` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:28.184498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c8a34-d44b-4c9d-b40d-2bfbb22ce6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=432ffde0b15c46b1bf8da44648a66b32)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:28.186573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c8a34-d44b-4c9d-b40d-2bfbb22ce6ba admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:28.368867 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8b4c8a34-d44b-4c9d-b40d-2bfbb22ce6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '432ffde0b15c46b1bf8da44648a66b32'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:28.440871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8b4c8a34-d44b-4c9d-b40d-2bfbb22ce6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '432ffde0b15c46b1bf8da44648a66b32'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:28.448440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8b4c8a34-d44b-4c9d-b40d-2bfbb22ce6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '432ffde0b15c46b1bf8da44648a66b32'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:28.453153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8b4c8a34-d44b-4c9d-b40d-2bfbb22ce6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '432ffde0b15c46b1bf8da44648a66b32'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:28.461876 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8b4c8a34-d44b-4c9d-b40d-2bfbb22ce6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '432ffde0b15c46b1bf8da44648a66b32'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:28.468255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1364/2704] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:25:28 2022] DELETE /identity/v3/users/432ffde0b15c46b1bf8da44648a66b32 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:25:28.473323 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e40de4-d51f-41a7-95f7-189af54e88af None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:28.474473 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e40de4-d51f-41a7-95f7-189af54e88af None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:28.474650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e40de4-d51f-41a7-95f7-189af54e88af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:28.492854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-86e40de4-d51f-41a7-95f7-189af54e88af None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:25:28.494087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-86e40de4-d51f-41a7-95f7-189af54e88af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:28.555902 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1341/2705] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:25:28.565841 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c8a34-d44b-4c9d-b40d-2bfbb22ce6ba admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:28.567295 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8b4c8a34-d44b-4c9d-b40d-2bfbb22ce6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:28.625499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c8a34-d44b-4c9d-b40d-2bfbb22ce6ba admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:28.629173 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00042b6-3b4b-40de-8db2-c05c7f68c3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:28.629819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00042b6-3b4b-40de-8db2-c05c7f68c3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:28.630258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00042b6-3b4b-40de-8db2-c05c7f68c3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:28.630579 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00042b6-3b4b-40de-8db2-c05c7f68c3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:28.639479 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00042b6-3b4b-40de-8db2-c05c7f68c3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:28.640900 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00042b6-3b4b-40de-8db2-c05c7f68c3e8 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:28.650757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1365/2706] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:25:29.079158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e40de4-d51f-41a7-95f7-189af54e88af None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:29.080578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-86e40de4-d51f-41a7-95f7-189af54e88af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:29.094196 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e40de4-d51f-41a7-95f7-189af54e88af None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:29.099386 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535150ec-4006-4753-9688-6aec115d30af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:29.100409 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535150ec-4006-4753-9688-6aec115d30af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:29.100612 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535150ec-4006-4753-9688-6aec115d30af admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:29.100805 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535150ec-4006-4753-9688-6aec115d30af admin admin] PATH_INFO: `/v3/projects/ad66e712870643efaf9058a6af533ab6` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:29.102036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535150ec-4006-4753-9688-6aec115d30af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad66e712870643efaf9058a6af533ab6)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:29.103965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535150ec-4006-4753-9688-6aec115d30af admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:29.112665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:29.253014 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-535150ec-4006-4753-9688-6aec115d30af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad66e712870643efaf9058a6af533ab6', 'request_id': 'req-535150ec-4006-4753-9688-6aec115d30af'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:29.260648 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-535150ec-4006-4753-9688-6aec115d30af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad66e712870643efaf9058a6af533ab6', 'request_id': 'req-535150ec-4006-4753-9688-6aec115d30af'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:29.463844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-535150ec-4006-4753-9688-6aec115d30af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad66e712870643efaf9058a6af533ab6', 'request_id': 'req-535150ec-4006-4753-9688-6aec115d30af'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:29.475359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-535150ec-4006-4753-9688-6aec115d30af admin admin] The token cache is being invalidate because project ad66e712870643efaf9058a6af533ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:25:29.476003 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-535150ec-4006-4753-9688-6aec115d30af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:29.476420 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-535150ec-4006-4753-9688-6aec115d30af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:29.478071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1342/2707] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:25:29 2022] DELETE /identity/v3/projects/ad66e712870643efaf9058a6af533ab6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:25:29.482019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00042b6-3b4b-40de-8db2-c05c7f68c3e8 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:29.493264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00042b6-3b4b-40de-8db2-c05c7f68c3e8 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:29.526999 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:29.549679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbff78-a38b-4ea7-bdff-9529391f83ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:29.550555 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbff78-a38b-4ea7-bdff-9529391f83ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:29.550957 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbff78-a38b-4ea7-bdff-9529391f83ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:29.551292 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbff78-a38b-4ea7-bdff-9529391f83ef admin admin] PATH_INFO: `/v3/users/2b12665e313f4020a2e462735f72da14` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:29.553533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbff78-a38b-4ea7-bdff-9529391f83ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b12665e313f4020a2e462735f72da14)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:29.555763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbff78-a38b-4ea7-bdff-9529391f83ef admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:29.815894 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-cfdbff78-a38b-4ea7-bdff-9529391f83ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b12665e313f4020a2e462735f72da14'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:29.915050 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-cfdbff78-a38b-4ea7-bdff-9529391f83ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b12665e313f4020a2e462735f72da14'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:29.922489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-cfdbff78-a38b-4ea7-bdff-9529391f83ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b12665e313f4020a2e462735f72da14'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:29.923134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-cfdbff78-a38b-4ea7-bdff-9529391f83ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b12665e313f4020a2e462735f72da14'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:29.936410 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-cfdbff78-a38b-4ea7-bdff-9529391f83ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b12665e313f4020a2e462735f72da14'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:29.942322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1366/2708] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:25:29 2022] DELETE /identity/v3/users/2b12665e313f4020a2e462735f72da14 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:25:30.511739 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535150ec-4006-4753-9688-6aec115d30af admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:30.517427 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-535150ec-4006-4753-9688-6aec115d30af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:30.527609 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535150ec-4006-4753-9688-6aec115d30af admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:30.587641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62c9df-949a-4154-824d-34fde05e97a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:30.588507 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62c9df-949a-4154-824d-34fde05e97a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:30.588795 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62c9df-949a-4154-824d-34fde05e97a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:30.589108 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62c9df-949a-4154-824d-34fde05e97a2 admin admin] PATH_INFO: `/v3/projects/7d7dbc94dc6e4c3bbba1c2f7c9076348` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:30.590298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62c9df-949a-4154-824d-34fde05e97a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d7dbc94dc6e4c3bbba1c2f7c9076348)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:30.592244 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62c9df-949a-4154-824d-34fde05e97a2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:30.733203 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5c62c9df-949a-4154-824d-34fde05e97a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d7dbc94dc6e4c3bbba1c2f7c9076348', 'request_id': 'req-5c62c9df-949a-4154-824d-34fde05e97a2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:30.739870 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5c62c9df-949a-4154-824d-34fde05e97a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d7dbc94dc6e4c3bbba1c2f7c9076348', 'request_id': 'req-5c62c9df-949a-4154-824d-34fde05e97a2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:30.800599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5c62c9df-949a-4154-824d-34fde05e97a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d7dbc94dc6e4c3bbba1c2f7c9076348', 'request_id': 'req-5c62c9df-949a-4154-824d-34fde05e97a2'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:30.813839 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5c62c9df-949a-4154-824d-34fde05e97a2 admin admin] The token cache is being invalidate because project 7d7dbc94dc6e4c3bbba1c2f7c9076348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:25:30.822307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5c62c9df-949a-4154-824d-34fde05e97a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:30.822307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5c62c9df-949a-4154-824d-34fde05e97a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:25:30.822307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1343/2709] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:25:30 2022] DELETE /identity/v3/projects/7d7dbc94dc6e4c3bbba1c2f7c9076348 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:25:30.829617 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b077f9e-28f5-487a-ba5c-75b67c277164 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:30.830118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b077f9e-28f5-487a-ba5c-75b67c277164 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:30.830299 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b077f9e-28f5-487a-ba5c-75b67c277164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:30.848068 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-5b077f9e-28f5-487a-ba5c-75b67c277164 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:25:30.849779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-5b077f9e-28f5-487a-ba5c-75b67c277164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:30.909360 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1367/2710] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:25:30.917110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49a495-23ca-403b-9a79-636f7de4454f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:30.917416 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49a495-23ca-403b-9a79-636f7de4454f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:30.917699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49a495-23ca-403b-9a79-636f7de4454f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:30.936550 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-6d49a495-23ca-403b-9a79-636f7de4454f None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:25:30.937840 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-6d49a495-23ca-403b-9a79-636f7de4454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:30.946597 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1344/2711] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:25:30.950721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b077f9e-28f5-487a-ba5c-75b67c277164 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:30.960986 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b077f9e-28f5-487a-ba5c-75b67c277164 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:30.965593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de263f-58a0-4f7e-9e19-2d163c50415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:30.966243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de263f-58a0-4f7e-9e19-2d163c50415f admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:30.966527 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de263f-58a0-4f7e-9e19-2d163c50415f admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:30.966804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de263f-58a0-4f7e-9e19-2d163c50415f admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:30.967522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de263f-58a0-4f7e-9e19-2d163c50415f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:25:30.967825 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de263f-58a0-4f7e-9e19-2d163c50415f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:30.969489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de263f-58a0-4f7e-9e19-2d163c50415f admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:30.981748 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1368/2712] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:25:30.986102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49a495-23ca-403b-9a79-636f7de4454f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:30.995835 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49a495-23ca-403b-9a79-636f7de4454f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:31.000557 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fce41-6d29-4df0-b686-6c07973e7fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:31.001232 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fce41-6d29-4df0-b686-6c07973e7fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:31.001521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fce41-6d29-4df0-b686-6c07973e7fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:31.001798 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fce41-6d29-4df0-b686-6c07973e7fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:31.002480 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fce41-6d29-4df0-b686-6c07973e7fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:31.004377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fce41-6d29-4df0-b686-6c07973e7fa7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:31.115587 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:31.122870 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1345/2713] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:25:30 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:25:31.127221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de263f-58a0-4f7e-9e19-2d163c50415f admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:31.138177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de263f-58a0-4f7e-9e19-2d163c50415f admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:31.184227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:31.199775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51baa27-fac5-4e56-8d3d-3a25cefdb1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:31.200830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51baa27-fac5-4e56-8d3d-3a25cefdb1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:31.201329 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51baa27-fac5-4e56-8d3d-3a25cefdb1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:31.201786 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51baa27-fac5-4e56-8d3d-3a25cefdb1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:31.202973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51baa27-fac5-4e56-8d3d-3a25cefdb1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:31.205787 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51baa27-fac5-4e56-8d3d-3a25cefdb1c3 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:31.293202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1369/2714] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:25:31 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:25:31.297415 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fce41-6d29-4df0-b686-6c07973e7fa7 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:31.308859 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fce41-6d29-4df0-b686-6c07973e7fa7 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:31.313497 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43abfd-53d8-43ae-ab36-070ca75cf0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:31.314201 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43abfd-53d8-43ae-ab36-070ca75cf0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:31.314495 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43abfd-53d8-43ae-ab36-070ca75cf0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:31.314777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43abfd-53d8-43ae-ab36-070ca75cf0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:31.315531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b43abfd-53d8-43ae-ab36-070ca75cf0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:31.317148 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b43abfd-53d8-43ae-ab36-070ca75cf0f7 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:31.328135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1346/2715] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:25:31.332346 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51baa27-fac5-4e56-8d3d-3a25cefdb1c3 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:31.343298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51baa27-fac5-4e56-8d3d-3a25cefdb1c3 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:31.348062 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e774bd-3312-4f0f-ad48-334c7698800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:31.348732 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e774bd-3312-4f0f-ad48-334c7698800a admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:31.349075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e774bd-3312-4f0f-ad48-334c7698800a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:31.349447 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e774bd-3312-4f0f-ad48-334c7698800a admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:31.350186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e774bd-3312-4f0f-ad48-334c7698800a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:31.351788 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e774bd-3312-4f0f-ad48-334c7698800a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:31.362494 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1370/2716] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:25:31.367022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43abfd-53d8-43ae-ab36-070ca75cf0f7 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:31.376852 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43abfd-53d8-43ae-ab36-070ca75cf0f7 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:31.382785 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88ea75-c333-4b83-9a58-cad97e2c6491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:31.383881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88ea75-c333-4b83-9a58-cad97e2c6491 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:31.384408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88ea75-c333-4b83-9a58-cad97e2c6491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:31.385007 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88ea75-c333-4b83-9a58-cad97e2c6491 admin admin] PATH_INFO: `/v3/projects/0abfb3e418e544a7aa7046dbefb4ab26/users/60c2af7af32f44d09d0a003146e1766e/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:31.400394 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88ea75-c333-4b83-9a58-cad97e2c6491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abfb3e418e544a7aa7046dbefb4ab26, user_id=60c2af7af32f44d09d0a003146e1766e, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:31.403099 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88ea75-c333-4b83-9a58-cad97e2c6491 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:31.469839 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1347/2717] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:25:31 2022] PUT /identity/v3/projects/0abfb3e418e544a7aa7046dbefb4ab26/users/60c2af7af32f44d09d0a003146e1766e/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:25:31.532921 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be101822-3341-4c9f-8bb2-baf092a2e8e3 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:31.533239 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be101822-3341-4c9f-8bb2-baf092a2e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:31.533523 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be101822-3341-4c9f-8bb2-baf092a2e8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:31.560794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-be101822-3341-4c9f-8bb2-baf092a2e8e3 None None] MFA Rules not processed for user `60c2af7af32f44d09d0a003146e1766e`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:25:31.562034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-be101822-3341-4c9f-8bb2-baf092a2e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:31.625070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1371/2718] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:25:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:25:31.629719 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88ea75-c333-4b83-9a58-cad97e2c6491 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:31.691606 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88ea75-c333-4b83-9a58-cad97e2c6491 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:31.697157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db776c-c6f6-4d8a-9b9e-649a765e52a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:31.698195 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db776c-c6f6-4d8a-9b9e-649a765e52a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:31.698489 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db776c-c6f6-4d8a-9b9e-649a765e52a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:31.698773 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db776c-c6f6-4d8a-9b9e-649a765e52a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:31.699473 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db776c-c6f6-4d8a-9b9e-649a765e52a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:31.701522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db776c-c6f6-4d8a-9b9e-649a765e52a0 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:31.830626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1348/2719] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:25:31 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:25:31.835009 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be101822-3341-4c9f-8bb2-baf092a2e8e3 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:31.845804 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be101822-3341-4c9f-8bb2-baf092a2e8e3 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:31.902994 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16212bdb-91dd-43ed-a140-bb7142012c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:31.903589 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16212bdb-91dd-43ed-a140-bb7142012c07 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:31.903871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16212bdb-91dd-43ed-a140-bb7142012c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:31.904146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16212bdb-91dd-43ed-a140-bb7142012c07 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:31.904819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16212bdb-91dd-43ed-a140-bb7142012c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:31.906760 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16212bdb-91dd-43ed-a140-bb7142012c07 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:31.984016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1372/2720] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:25:31 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:25:31.988122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db776c-c6f6-4d8a-9b9e-649a765e52a0 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:31.999371 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db776c-c6f6-4d8a-9b9e-649a765e52a0 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:32.003997 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182caea-d842-4901-8aee-1b35821dfc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:32.004658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182caea-d842-4901-8aee-1b35821dfc0d admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:32.005043 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182caea-d842-4901-8aee-1b35821dfc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:32.005325 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182caea-d842-4901-8aee-1b35821dfc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:32.006071 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182caea-d842-4901-8aee-1b35821dfc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:32.007657 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182caea-d842-4901-8aee-1b35821dfc0d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:32.018056 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1349/2721] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 18:25:32.022302 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16212bdb-91dd-43ed-a140-bb7142012c07 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:32.032266 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16212bdb-91dd-43ed-a140-bb7142012c07 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:32.037690 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d0f86-f950-4669-8361-32c4b82897cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:32.038570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d0f86-f950-4669-8361-32c4b82897cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:32.038859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d0f86-f950-4669-8361-32c4b82897cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:32.039142 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d0f86-f950-4669-8361-32c4b82897cd admin admin] PATH_INFO: `/v3/projects/dba5a2e552b04dab9fae23b2b193ca44/users/3c3de15dcc51471d8447f92364cc2bdc/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:32.054461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d0f86-f950-4669-8361-32c4b82897cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba5a2e552b04dab9fae23b2b193ca44, user_id=3c3de15dcc51471d8447f92364cc2bdc, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:32.057432 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d0f86-f950-4669-8361-32c4b82897cd admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:32.132269 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1373/2722] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:25:32 2022] PUT /identity/v3/projects/dba5a2e552b04dab9fae23b2b193ca44/users/3c3de15dcc51471d8447f92364cc2bdc/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:25:32.136236 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182caea-d842-4901-8aee-1b35821dfc0d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:32.147432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182caea-d842-4901-8aee-1b35821dfc0d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:32.206909 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9b39f-58aa-4861-87e7-847220f2e3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:32.207502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9b39f-58aa-4861-87e7-847220f2e3ca admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:32.207790 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9b39f-58aa-4861-87e7-847220f2e3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:32.208103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9b39f-58aa-4861-87e7-847220f2e3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:32.208930 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9b39f-58aa-4861-87e7-847220f2e3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:32.210557 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9b39f-58aa-4861-87e7-847220f2e3ca admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:32.221596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1350/2723] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:25:32.226500 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d0f86-f950-4669-8361-32c4b82897cd admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:32.236553 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d0f86-f950-4669-8361-32c4b82897cd admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:32.242330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b6ee1-c77b-4a35-95c1-6d5cf9ac9949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:32.243206 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b6ee1-c77b-4a35-95c1-6d5cf9ac9949 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:32.243487 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b6ee1-c77b-4a35-95c1-6d5cf9ac9949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:32.243762 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b6ee1-c77b-4a35-95c1-6d5cf9ac9949 admin admin] PATH_INFO: `/v3/projects/dba5a2e552b04dab9fae23b2b193ca44/users/3c3de15dcc51471d8447f92364cc2bdc/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:32.245955 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b6ee1-c77b-4a35-95c1-6d5cf9ac9949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba5a2e552b04dab9fae23b2b193ca44, user_id=3c3de15dcc51471d8447f92364cc2bdc, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:32.248662 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b6ee1-c77b-4a35-95c1-6d5cf9ac9949 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:32.259588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1374/2724] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:25:32 2022] PUT /identity/v3/projects/dba5a2e552b04dab9fae23b2b193ca44/users/3c3de15dcc51471d8447f92364cc2bdc/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:25:32.269877 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7fbfa-d300-45bd-9d8c-9761b6eac254 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:32.270170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7fbfa-d300-45bd-9d8c-9761b6eac254 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:32.270986 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7fbfa-d300-45bd-9d8c-9761b6eac254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:32.297833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-86d7fbfa-d300-45bd-9d8c-9761b6eac254 None None] MFA Rules not processed for user `3c3de15dcc51471d8447f92364cc2bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:25:32.299036 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-86d7fbfa-d300-45bd-9d8c-9761b6eac254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:32.319275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:32.368829 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1351/2725] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:25:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:25:32.380224 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b6ee1-c77b-4a35-95c1-6d5cf9ac9949 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:32.382103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6c2b6ee1-c77b-4a35-95c1-6d5cf9ac9949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:25:32.388818 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:32.441997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b6ee1-c77b-4a35-95c1-6d5cf9ac9949 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:32.446116 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20537cea-0d66-474e-8697-498fb28cf757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:32.446779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20537cea-0d66-474e-8697-498fb28cf757 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:32.447202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20537cea-0d66-474e-8697-498fb28cf757 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:32.447870 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20537cea-0d66-474e-8697-498fb28cf757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:32.505927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20537cea-0d66-474e-8697-498fb28cf757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:32.507396 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20537cea-0d66-474e-8697-498fb28cf757 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:32.516575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1375/2726] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:25:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:25:39.936822 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7fbfa-d300-45bd-9d8c-9761b6eac254 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:25:39.947422 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7fbfa-d300-45bd-9d8c-9761b6eac254 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:25:39.951447 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ccd2d-e519-4719-8d25-39a843cf1f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:25:39.952120 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ccd2d-e519-4719-8d25-39a843cf1f03 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:25:39.952503 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ccd2d-e519-4719-8d25-39a843cf1f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:25:39.952723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ccd2d-e519-4719-8d25-39a843cf1f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:25:39.966617 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ccd2d-e519-4719-8d25-39a843cf1f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:25:39.969350 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ccd2d-e519-4719-8d25-39a843cf1f03 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:25:39.981697 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1352/2727] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:25:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:25:42.538653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=46 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:25:49.976435 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=25 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:15.452219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20537cea-0d66-474e-8697-498fb28cf757 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:15.516196 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20537cea-0d66-474e-8697-498fb28cf757 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:15.520662 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59c175-ee59-429f-9f56-87b8eb1922bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:15.521554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59c175-ee59-429f-9f56-87b8eb1922bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:15.521854 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59c175-ee59-429f-9f56-87b8eb1922bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:15.522112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59c175-ee59-429f-9f56-87b8eb1922bc admin admin] PATH_INFO: `/v3/users/60c2af7af32f44d09d0a003146e1766e` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:15.523278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59c175-ee59-429f-9f56-87b8eb1922bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c2af7af32f44d09d0a003146e1766e)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:15.525210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59c175-ee59-429f-9f56-87b8eb1922bc admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:15.705815 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8e59c175-ee59-429f-9f56-87b8eb1922bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c2af7af32f44d09d0a003146e1766e'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:15.778688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8e59c175-ee59-429f-9f56-87b8eb1922bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c2af7af32f44d09d0a003146e1766e'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:15.785858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8e59c175-ee59-429f-9f56-87b8eb1922bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c2af7af32f44d09d0a003146e1766e'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:15.786513 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8e59c175-ee59-429f-9f56-87b8eb1922bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c2af7af32f44d09d0a003146e1766e'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:15.798781 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-8e59c175-ee59-429f-9f56-87b8eb1922bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c2af7af32f44d09d0a003146e1766e'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:15.804669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1376/2728] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:26:15 2022] DELETE /identity/v3/users/60c2af7af32f44d09d0a003146e1766e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:15.809652 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff86e-9655-436f-a4c0-021748e79d51 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:15.810142 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff86e-9655-436f-a4c0-021748e79d51 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:15.810233 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff86e-9655-436f-a4c0-021748e79d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:15.835996 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b6cff86e-9655-436f-a4c0-021748e79d51 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:26:15.837219 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b6cff86e-9655-436f-a4c0-021748e79d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:15.896895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1353/2729] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:26:15.907544 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59c175-ee59-429f-9f56-87b8eb1922bc admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:15.909147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8e59c175-ee59-429f-9f56-87b8eb1922bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:15.966603 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59c175-ee59-429f-9f56-87b8eb1922bc admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:15.970359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae37c-666d-458e-a39e-f2c0dcbb09dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:15.971008 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae37c-666d-458e-a39e-f2c0dcbb09dd service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:15.971295 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae37c-666d-458e-a39e-f2c0dcbb09dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:15.971574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae37c-666d-458e-a39e-f2c0dcbb09dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:15.980604 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ae37c-666d-458e-a39e-f2c0dcbb09dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:15.982517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ae37c-666d-458e-a39e-f2c0dcbb09dd service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:15.991772 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1377/2730] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:26:16.385387 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cff86e-9655-436f-a4c0-021748e79d51 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:16.390316 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b6cff86e-9655-436f-a4c0-021748e79d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:16.398754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cff86e-9655-436f-a4c0-021748e79d51 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:16.403750 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72279ac-217d-4ae5-8012-ec2f6a84825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:16.405628 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72279ac-217d-4ae5-8012-ec2f6a84825e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:16.405953 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72279ac-217d-4ae5-8012-ec2f6a84825e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:16.406258 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72279ac-217d-4ae5-8012-ec2f6a84825e admin admin] PATH_INFO: `/v3/projects/0abfb3e418e544a7aa7046dbefb4ab26` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:16.407546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72279ac-217d-4ae5-8012-ec2f6a84825e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0abfb3e418e544a7aa7046dbefb4ab26)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:16.410315 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72279ac-217d-4ae5-8012-ec2f6a84825e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:16.545760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c72279ac-217d-4ae5-8012-ec2f6a84825e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0abfb3e418e544a7aa7046dbefb4ab26', 'request_id': 'req-c72279ac-217d-4ae5-8012-ec2f6a84825e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:16.552026 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c72279ac-217d-4ae5-8012-ec2f6a84825e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0abfb3e418e544a7aa7046dbefb4ab26', 'request_id': 'req-c72279ac-217d-4ae5-8012-ec2f6a84825e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:16.629723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c72279ac-217d-4ae5-8012-ec2f6a84825e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0abfb3e418e544a7aa7046dbefb4ab26', 'request_id': 'req-c72279ac-217d-4ae5-8012-ec2f6a84825e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:16.640953 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c72279ac-217d-4ae5-8012-ec2f6a84825e admin admin] The token cache is being invalidate because project 0abfb3e418e544a7aa7046dbefb4ab26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:26:16.648128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c72279ac-217d-4ae5-8012-ec2f6a84825e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:16.648128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c72279ac-217d-4ae5-8012-ec2f6a84825e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:16.648128 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1354/2731] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:26:16 2022] DELETE /identity/v3/projects/0abfb3e418e544a7aa7046dbefb4ab26 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:16.648402 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae37c-666d-458e-a39e-f2c0dcbb09dd service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:16.657573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae37c-666d-458e-a39e-f2c0dcbb09dd service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:16.677073 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:16.715459 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf0512-0002-42c7-895d-1e5d13c7638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:16.716369 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf0512-0002-42c7-895d-1e5d13c7638d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:16.716654 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf0512-0002-42c7-895d-1e5d13c7638d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:16.716945 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf0512-0002-42c7-895d-1e5d13c7638d admin admin] PATH_INFO: `/v3/users/3c3de15dcc51471d8447f92364cc2bdc` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:16.718144 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf0512-0002-42c7-895d-1e5d13c7638d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c3de15dcc51471d8447f92364cc2bdc)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:16.720070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf0512-0002-42c7-895d-1e5d13c7638d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:16.919103 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-becf0512-0002-42c7-895d-1e5d13c7638d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c3de15dcc51471d8447f92364cc2bdc'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:16.966939 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-becf0512-0002-42c7-895d-1e5d13c7638d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c3de15dcc51471d8447f92364cc2bdc'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:16.974098 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-becf0512-0002-42c7-895d-1e5d13c7638d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c3de15dcc51471d8447f92364cc2bdc'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:16.974716 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-becf0512-0002-42c7-895d-1e5d13c7638d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c3de15dcc51471d8447f92364cc2bdc'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:16.987500 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-becf0512-0002-42c7-895d-1e5d13c7638d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c3de15dcc51471d8447f92364cc2bdc'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:16.993404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1378/2732] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:26:16 2022] DELETE /identity/v3/users/3c3de15dcc51471d8447f92364cc2bdc => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:17.373935 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72279ac-217d-4ae5-8012-ec2f6a84825e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:17.375589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c72279ac-217d-4ae5-8012-ec2f6a84825e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:17.389684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72279ac-217d-4ae5-8012-ec2f6a84825e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:17.446790 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286ed03-c43c-4ea1-9527-ded1593c680b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:17.447595 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286ed03-c43c-4ea1-9527-ded1593c680b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:17.447887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286ed03-c43c-4ea1-9527-ded1593c680b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:17.448168 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286ed03-c43c-4ea1-9527-ded1593c680b admin admin] PATH_INFO: `/v3/projects/dba5a2e552b04dab9fae23b2b193ca44` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:17.449965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286ed03-c43c-4ea1-9527-ded1593c680b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba5a2e552b04dab9fae23b2b193ca44)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:17.451917 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286ed03-c43c-4ea1-9527-ded1593c680b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:17.477561 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:17.549396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2286ed03-c43c-4ea1-9527-ded1593c680b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba5a2e552b04dab9fae23b2b193ca44', 'request_id': 'req-2286ed03-c43c-4ea1-9527-ded1593c680b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:17.556116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2286ed03-c43c-4ea1-9527-ded1593c680b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba5a2e552b04dab9fae23b2b193ca44', 'request_id': 'req-2286ed03-c43c-4ea1-9527-ded1593c680b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:17.612441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2286ed03-c43c-4ea1-9527-ded1593c680b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba5a2e552b04dab9fae23b2b193ca44', 'request_id': 'req-2286ed03-c43c-4ea1-9527-ded1593c680b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:17.623698 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2286ed03-c43c-4ea1-9527-ded1593c680b admin admin] The token cache is being invalidate because project dba5a2e552b04dab9fae23b2b193ca44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:26:17.623986 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2286ed03-c43c-4ea1-9527-ded1593c680b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:17.624620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-2286ed03-c43c-4ea1-9527-ded1593c680b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:17.626209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1355/2733] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:26:17 2022] DELETE /identity/v3/projects/dba5a2e552b04dab9fae23b2b193ca44 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:17.631134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6a079-d0bc-4942-8f9c-b4335922f98e None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:17.632575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6a079-d0bc-4942-8f9c-b4335922f98e None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:17.632575 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6a079-d0bc-4942-8f9c-b4335922f98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:17.678112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-12f6a079-d0bc-4942-8f9c-b4335922f98e None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:26:17.679330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-12f6a079-d0bc-4942-8f9c-b4335922f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:17.737525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1379/2734] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:26:17.745921 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0ab29-6f74-433c-ad49-e75fbe951a86 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:17.746211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0ab29-6f74-433c-ad49-e75fbe951a86 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:17.746998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0ab29-6f74-433c-ad49-e75fbe951a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:17.765687 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1dc0ab29-6f74-433c-ad49-e75fbe951a86 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:26:17.766871 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1dc0ab29-6f74-433c-ad49-e75fbe951a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:17.774645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1356/2735] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:26:17.779147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6a079-d0bc-4942-8f9c-b4335922f98e None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:17.788533 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6a079-d0bc-4942-8f9c-b4335922f98e None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:17.793016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6ea51-8792-4a64-a38a-ae4051528fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:17.793867 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6ea51-8792-4a64-a38a-ae4051528fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:17.794203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6ea51-8792-4a64-a38a-ae4051528fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:17.794480 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6ea51-8792-4a64-a38a-ae4051528fa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:17.795195 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6ea51-8792-4a64-a38a-ae4051528fa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:26:17.795501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6ea51-8792-4a64-a38a-ae4051528fa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:17.797121 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6ea51-8792-4a64-a38a-ae4051528fa6 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:17.808679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1380/2736] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:26:17.813439 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0ab29-6f74-433c-ad49-e75fbe951a86 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:17.822592 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0ab29-6f74-433c-ad49-e75fbe951a86 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:17.827996 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510e1e1-f831-43b4-85cc-c8bec360e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:17.828715 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510e1e1-f831-43b4-85cc-c8bec360e33a admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:17.828958 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510e1e1-f831-43b4-85cc-c8bec360e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:17.829246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510e1e1-f831-43b4-85cc-c8bec360e33a admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:17.829946 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510e1e1-f831-43b4-85cc-c8bec360e33a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:17.831861 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510e1e1-f831-43b4-85cc-c8bec360e33a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:17.940183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1357/2737] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:26:17 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:26:17.944347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6ea51-8792-4a64-a38a-ae4051528fa6 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:17.951009 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:17.955081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6ea51-8792-4a64-a38a-ae4051528fa6 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:18.010525 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eec11a-90a5-4707-87e1-0a22931682d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:18.011192 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eec11a-90a5-4707-87e1-0a22931682d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:18.011724 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eec11a-90a5-4707-87e1-0a22931682d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:18.012053 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eec11a-90a5-4707-87e1-0a22931682d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:18.013006 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eec11a-90a5-4707-87e1-0a22931682d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:18.015431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eec11a-90a5-4707-87e1-0a22931682d5 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:18.120907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1381/2738] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:26:17 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:26:18.126010 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510e1e1-f831-43b4-85cc-c8bec360e33a admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:18.136768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510e1e1-f831-43b4-85cc-c8bec360e33a admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:18.141850 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba14f4-e7b9-4650-9716-47f0c2989dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:18.142521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba14f4-e7b9-4650-9716-47f0c2989dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:18.142808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba14f4-e7b9-4650-9716-47f0c2989dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:18.143092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba14f4-e7b9-4650-9716-47f0c2989dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:18.143826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba14f4-e7b9-4650-9716-47f0c2989dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:18.145477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba14f4-e7b9-4650-9716-47f0c2989dd6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:18.155728 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1358/2739] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:26:18.159594 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eec11a-90a5-4707-87e1-0a22931682d5 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:18.170345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eec11a-90a5-4707-87e1-0a22931682d5 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:18.174934 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a00a7a-d4ca-428d-8ed8-d787d2495e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:18.175586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a00a7a-d4ca-428d-8ed8-d787d2495e48 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:18.175871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a00a7a-d4ca-428d-8ed8-d787d2495e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:18.176149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a00a7a-d4ca-428d-8ed8-d787d2495e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:18.176871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a00a7a-d4ca-428d-8ed8-d787d2495e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:18.178487 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a00a7a-d4ca-428d-8ed8-d787d2495e48 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:18.189133 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1382/2740] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:26:18.193029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba14f4-e7b9-4650-9716-47f0c2989dd6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:18.202882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba14f4-e7b9-4650-9716-47f0c2989dd6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:18.207620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54794ee4-4dbd-4fc6-8813-6c2a4dacf4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:18.208548 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54794ee4-4dbd-4fc6-8813-6c2a4dacf4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:18.208837 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54794ee4-4dbd-4fc6-8813-6c2a4dacf4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:18.209145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54794ee4-4dbd-4fc6-8813-6c2a4dacf4e9 admin admin] PATH_INFO: `/v3/projects/1fe8dbb11d64419a9771159cdaaeb292/users/f1c451c220954bb3b4285307053e83bd/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:18.224456 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54794ee4-4dbd-4fc6-8813-6c2a4dacf4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe8dbb11d64419a9771159cdaaeb292, user_id=f1c451c220954bb3b4285307053e83bd, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:18.227166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54794ee4-4dbd-4fc6-8813-6c2a4dacf4e9 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:18.321324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1359/2741] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:26:18 2022] PUT /identity/v3/projects/1fe8dbb11d64419a9771159cdaaeb292/users/f1c451c220954bb3b4285307053e83bd/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:26:18.331330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd97ee7-56d6-4340-8b1e-65c333c0cc75 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:18.331624 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd97ee7-56d6-4340-8b1e-65c333c0cc75 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:18.331908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd97ee7-56d6-4340-8b1e-65c333c0cc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:18.359517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-7dd97ee7-56d6-4340-8b1e-65c333c0cc75 None None] MFA Rules not processed for user `f1c451c220954bb3b4285307053e83bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:26:18.360754 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7dd97ee7-56d6-4340-8b1e-65c333c0cc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:18.425227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1383/2742] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:26:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:26:18.429629 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54794ee4-4dbd-4fc6-8813-6c2a4dacf4e9 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:18.492436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54794ee4-4dbd-4fc6-8813-6c2a4dacf4e9 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:18.497075 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8733db3-2c9c-4e5f-8ed1-367fc4b180b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:18.497923 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8733db3-2c9c-4e5f-8ed1-367fc4b180b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:18.498210 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8733db3-2c9c-4e5f-8ed1-367fc4b180b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:18.498486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8733db3-2c9c-4e5f-8ed1-367fc4b180b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:18.499176 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8733db3-2c9c-4e5f-8ed1-367fc4b180b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:18.501098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8733db3-2c9c-4e5f-8ed1-367fc4b180b1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:18.602783 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1360/2743] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:26:18 2022] POST /identity/v3/projects => generated 389 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:26:18.607578 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd97ee7-56d6-4340-8b1e-65c333c0cc75 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:18.618630 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd97ee7-56d6-4340-8b1e-65c333c0cc75 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:18.675528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7235d-3d22-45f8-8e44-c0a0ae8485a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:18.676261 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7235d-3d22-45f8-8e44-c0a0ae8485a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:18.676540 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7235d-3d22-45f8-8e44-c0a0ae8485a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:18.676820 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7235d-3d22-45f8-8e44-c0a0ae8485a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:18.677539 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7235d-3d22-45f8-8e44-c0a0ae8485a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:18.681589 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7235d-3d22-45f8-8e44-c0a0ae8485a8 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:18.769719 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1384/2744] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:26:18 2022] POST /identity/v3/users => generated 301 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:26:18.773546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8733db3-2c9c-4e5f-8ed1-367fc4b180b1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:18.786065 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8733db3-2c9c-4e5f-8ed1-367fc4b180b1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:18.790924 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae6809-4f40-4516-a57e-d011acce8a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:18.791597 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae6809-4f40-4516-a57e-d011acce8a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:18.791887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae6809-4f40-4516-a57e-d011acce8a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:18.792166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae6809-4f40-4516-a57e-d011acce8a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:18.792897 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae6809-4f40-4516-a57e-d011acce8a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:18.794907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae6809-4f40-4516-a57e-d011acce8a48 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:18.806346 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1361/2745] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:26:18.810749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7235d-3d22-45f8-8e44-c0a0ae8485a8 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:18.816063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:18.821339 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7235d-3d22-45f8-8e44-c0a0ae8485a8 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:18.826482 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d598ec3-ffcd-4bf3-a238-a56e511d48d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:18.827821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d598ec3-ffcd-4bf3-a238-a56e511d48d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:18.827821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d598ec3-ffcd-4bf3-a238-a56e511d48d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:18.828045 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d598ec3-ffcd-4bf3-a238-a56e511d48d3 admin admin] PATH_INFO: `/v3/projects/306421aada5b4ea297e52cd36fd5e06c/users/bfe121fc2bf9478c9c393c4f53abb19e/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:18.843387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d598ec3-ffcd-4bf3-a238-a56e511d48d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306421aada5b4ea297e52cd36fd5e06c, user_id=bfe121fc2bf9478c9c393c4f53abb19e, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:18.846150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d598ec3-ffcd-4bf3-a238-a56e511d48d3 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:18.967793 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1385/2746] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:26:18 2022] PUT /identity/v3/projects/306421aada5b4ea297e52cd36fd5e06c/users/bfe121fc2bf9478c9c393c4f53abb19e/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:18.971956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae6809-4f40-4516-a57e-d011acce8a48 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:18.982211 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae6809-4f40-4516-a57e-d011acce8a48 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:18.987811 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:19.037832 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cff65-e181-4418-a2a3-062ff9f75d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:19.038496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cff65-e181-4418-a2a3-062ff9f75d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:19.038778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cff65-e181-4418-a2a3-062ff9f75d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:19.039055 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cff65-e181-4418-a2a3-062ff9f75d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:19.039805 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cff65-e181-4418-a2a3-062ff9f75d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:19.041455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cff65-e181-4418-a2a3-062ff9f75d31 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:19.050815 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1362/2747] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:26:19.055193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d598ec3-ffcd-4bf3-a238-a56e511d48d3 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:19.066689 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d598ec3-ffcd-4bf3-a238-a56e511d48d3 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:19.072352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d0525-fd16-48ca-87df-0b3edabb7311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:19.073277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d0525-fd16-48ca-87df-0b3edabb7311 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:19.073565 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d0525-fd16-48ca-87df-0b3edabb7311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:19.073892 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d0525-fd16-48ca-87df-0b3edabb7311 admin admin] PATH_INFO: `/v3/projects/306421aada5b4ea297e52cd36fd5e06c/users/bfe121fc2bf9478c9c393c4f53abb19e/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:19.076529 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d0525-fd16-48ca-87df-0b3edabb7311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306421aada5b4ea297e52cd36fd5e06c, user_id=bfe121fc2bf9478c9c393c4f53abb19e, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:19.079322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d0525-fd16-48ca-87df-0b3edabb7311 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:19.089660 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1386/2748] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:26:19 2022] PUT /identity/v3/projects/306421aada5b4ea297e52cd36fd5e06c/users/bfe121fc2bf9478c9c393c4f53abb19e/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:19.100200 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9131f-c292-4f08-8d3b-f71a76bd8f4d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:19.100469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9131f-c292-4f08-8d3b-f71a76bd8f4d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:19.100751 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9131f-c292-4f08-8d3b-f71a76bd8f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:19.127309 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0cd9131f-c292-4f08-8d3b-f71a76bd8f4d None None] MFA Rules not processed for user `bfe121fc2bf9478c9c393c4f53abb19e`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:26:19.128506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0cd9131f-c292-4f08-8d3b-f71a76bd8f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:19.197972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1363/2749] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:26:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:26:19.209047 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d0525-fd16-48ca-87df-0b3edabb7311 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:19.210852 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-5c6d0525-fd16-48ca-87df-0b3edabb7311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:19.268927 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d0525-fd16-48ca-87df-0b3edabb7311 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:19.272656 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f85f9-fdf7-46e4-a7ce-2d20a27111b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:19.273334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f85f9-fdf7-46e4-a7ce-2d20a27111b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:19.273621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f85f9-fdf7-46e4-a7ce-2d20a27111b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:19.273901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f85f9-fdf7-46e4-a7ce-2d20a27111b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:19.282928 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f85f9-fdf7-46e4-a7ce-2d20a27111b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:19.284367 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f85f9-fdf7-46e4-a7ce-2d20a27111b1 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:19.293759 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1387/2750] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:26:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:26:19.418742 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9131f-c292-4f08-8d3b-f71a76bd8f4d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:19.483309 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9131f-c292-4f08-8d3b-f71a76bd8f4d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:19.487740 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91daeae-7b46-4f55-b08d-6b0848060850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:19.488624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91daeae-7b46-4f55-b08d-6b0848060850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:19.488904 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91daeae-7b46-4f55-b08d-6b0848060850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:19.489207 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91daeae-7b46-4f55-b08d-6b0848060850 admin admin] PATH_INFO: `/v3/users/f1c451c220954bb3b4285307053e83bd` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:19.490377 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91daeae-7b46-4f55-b08d-6b0848060850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c451c220954bb3b4285307053e83bd)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:19.492318 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91daeae-7b46-4f55-b08d-6b0848060850 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:19.642621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:19.654293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d91daeae-7b46-4f55-b08d-6b0848060850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c451c220954bb3b4285307053e83bd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:19.715239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d91daeae-7b46-4f55-b08d-6b0848060850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c451c220954bb3b4285307053e83bd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:19.723826 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d91daeae-7b46-4f55-b08d-6b0848060850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c451c220954bb3b4285307053e83bd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:19.724468 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d91daeae-7b46-4f55-b08d-6b0848060850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c451c220954bb3b4285307053e83bd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:19.737033 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-d91daeae-7b46-4f55-b08d-6b0848060850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c451c220954bb3b4285307053e83bd'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:19.742832 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1364/2751] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:26:19 2022] DELETE /identity/v3/users/f1c451c220954bb3b4285307053e83bd => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:19.747517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dd343-dcf8-4164-bff2-c4dbad6b75b0 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:19.747517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dd343-dcf8-4164-bff2-c4dbad6b75b0 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:19.748403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dd343-dcf8-4164-bff2-c4dbad6b75b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:19.765953 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-129dd343-dcf8-4164-bff2-c4dbad6b75b0 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:26:19.767134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-129dd343-dcf8-4164-bff2-c4dbad6b75b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:19.825363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1388/2752] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:26:19.835053 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91daeae-7b46-4f55-b08d-6b0848060850 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:19.836515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d91daeae-7b46-4f55-b08d-6b0848060850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:19.907011 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91daeae-7b46-4f55-b08d-6b0848060850 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:19.910543 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a786ea-dde5-4642-a182-b8a592b74769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:19.911185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a786ea-dde5-4642-a182-b8a592b74769 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:19.911469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a786ea-dde5-4642-a182-b8a592b74769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:19.911746 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a786ea-dde5-4642-a182-b8a592b74769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:19.921713 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a786ea-dde5-4642-a182-b8a592b74769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:19.923136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a786ea-dde5-4642-a182-b8a592b74769 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:19.932650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1365/2753] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:26:20.316675 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dd343-dcf8-4164-bff2-c4dbad6b75b0 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:20.318150 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-129dd343-dcf8-4164-bff2-c4dbad6b75b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:20.331715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dd343-dcf8-4164-bff2-c4dbad6b75b0 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:20.336464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a539d0-1d77-4af1-b15c-460831a2b00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:20.337895 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a539d0-1d77-4af1-b15c-460831a2b00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:20.338366 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a539d0-1d77-4af1-b15c-460831a2b00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:20.338653 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a539d0-1d77-4af1-b15c-460831a2b00c admin admin] PATH_INFO: `/v3/projects/1fe8dbb11d64419a9771159cdaaeb292` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:20.339866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a539d0-1d77-4af1-b15c-460831a2b00c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe8dbb11d64419a9771159cdaaeb292)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:20.342442 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a539d0-1d77-4af1-b15c-460831a2b00c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:20.441724 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-28a539d0-1d77-4af1-b15c-460831a2b00c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe8dbb11d64419a9771159cdaaeb292', 'request_id': 'req-28a539d0-1d77-4af1-b15c-460831a2b00c'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:20.447814 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-28a539d0-1d77-4af1-b15c-460831a2b00c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe8dbb11d64419a9771159cdaaeb292', 'request_id': 'req-28a539d0-1d77-4af1-b15c-460831a2b00c'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:20.498631 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-28a539d0-1d77-4af1-b15c-460831a2b00c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe8dbb11d64419a9771159cdaaeb292', 'request_id': 'req-28a539d0-1d77-4af1-b15c-460831a2b00c'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:20.500965 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:20.510293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-28a539d0-1d77-4af1-b15c-460831a2b00c admin admin] The token cache is being invalidate because project 1fe8dbb11d64419a9771159cdaaeb292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:26:20.510586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-28a539d0-1d77-4af1-b15c-460831a2b00c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:20.511217 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-28a539d0-1d77-4af1-b15c-460831a2b00c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:20.512805 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1389/2754] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:26:20 2022] DELETE /identity/v3/projects/1fe8dbb11d64419a9771159cdaaeb292 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:20.517564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a786ea-dde5-4642-a182-b8a592b74769 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:20.527248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a786ea-dde5-4642-a182-b8a592b74769 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:20.584070 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cb05d-ed68-43f0-bd4a-05011522b9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:20.584962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cb05d-ed68-43f0-bd4a-05011522b9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:20.585266 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cb05d-ed68-43f0-bd4a-05011522b9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:20.585552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cb05d-ed68-43f0-bd4a-05011522b9e3 admin admin] PATH_INFO: `/v3/users/bfe121fc2bf9478c9c393c4f53abb19e` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:20.586734 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cb05d-ed68-43f0-bd4a-05011522b9e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe121fc2bf9478c9c393c4f53abb19e)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:20.588671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cb05d-ed68-43f0-bd4a-05011522b9e3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:20.781426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b36cb05d-ed68-43f0-bd4a-05011522b9e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe121fc2bf9478c9c393c4f53abb19e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:20.869855 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b36cb05d-ed68-43f0-bd4a-05011522b9e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe121fc2bf9478c9c393c4f53abb19e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:20.871342 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:20.877863 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b36cb05d-ed68-43f0-bd4a-05011522b9e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe121fc2bf9478c9c393c4f53abb19e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:20.878528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b36cb05d-ed68-43f0-bd4a-05011522b9e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe121fc2bf9478c9c393c4f53abb19e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:20.896271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b36cb05d-ed68-43f0-bd4a-05011522b9e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe121fc2bf9478c9c393c4f53abb19e'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:20.902370 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1366/2755] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:26:20 2022] DELETE /identity/v3/users/bfe121fc2bf9478c9c393c4f53abb19e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:21.339876 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a539d0-1d77-4af1-b15c-460831a2b00c admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:21.342109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-28a539d0-1d77-4af1-b15c-460831a2b00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:21.356474 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a539d0-1d77-4af1-b15c-460831a2b00c admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:21.417379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b019f-37d0-4a81-ac27-64002ad21ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:21.418235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b019f-37d0-4a81-ac27-64002ad21ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:21.418516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b019f-37d0-4a81-ac27-64002ad21ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:21.418791 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b019f-37d0-4a81-ac27-64002ad21ef7 admin admin] PATH_INFO: `/v3/projects/306421aada5b4ea297e52cd36fd5e06c` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:21.420201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b019f-37d0-4a81-ac27-64002ad21ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=306421aada5b4ea297e52cd36fd5e06c)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:21.422167 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b019f-37d0-4a81-ac27-64002ad21ef7 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:21.528316 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-103b019f-37d0-4a81-ac27-64002ad21ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306421aada5b4ea297e52cd36fd5e06c', 'request_id': 'req-103b019f-37d0-4a81-ac27-64002ad21ef7'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:21.534630 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-103b019f-37d0-4a81-ac27-64002ad21ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306421aada5b4ea297e52cd36fd5e06c', 'request_id': 'req-103b019f-37d0-4a81-ac27-64002ad21ef7'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:21.618551 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-103b019f-37d0-4a81-ac27-64002ad21ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306421aada5b4ea297e52cd36fd5e06c', 'request_id': 'req-103b019f-37d0-4a81-ac27-64002ad21ef7'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:21.630614 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-103b019f-37d0-4a81-ac27-64002ad21ef7 admin admin] The token cache is being invalidate because project 306421aada5b4ea297e52cd36fd5e06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:26:21.630905 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-103b019f-37d0-4a81-ac27-64002ad21ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:21.631535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-103b019f-37d0-4a81-ac27-64002ad21ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:21.633114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1390/2756] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:26:21 2022] DELETE /identity/v3/projects/306421aada5b4ea297e52cd36fd5e06c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:21.638063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92772c82-ae28-41fd-a952-e0c58d9026fa None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:21.638602 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92772c82-ae28-41fd-a952-e0c58d9026fa None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:21.638778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92772c82-ae28-41fd-a952-e0c58d9026fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:21.656735 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-92772c82-ae28-41fd-a952-e0c58d9026fa None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:26:21.657967 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-92772c82-ae28-41fd-a952-e0c58d9026fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:21.717447 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1367/2757] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:26:21.726247 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934d45-fb76-4e77-9084-d87683cd31ff None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:21.726542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934d45-fb76-4e77-9084-d87683cd31ff None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:21.726823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934d45-fb76-4e77-9084-d87683cd31ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:21.745598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-a1934d45-fb76-4e77-9084-d87683cd31ff None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:26:21.746838 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-a1934d45-fb76-4e77-9084-d87683cd31ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:21.755737 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1391/2758] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:26:21.759847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92772c82-ae28-41fd-a952-e0c58d9026fa None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:21.770037 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92772c82-ae28-41fd-a952-e0c58d9026fa None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:21.774664 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40e2f8-80c4-494a-ac75-858d72df02dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:21.775321 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40e2f8-80c4-494a-ac75-858d72df02dc admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:21.775608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40e2f8-80c4-494a-ac75-858d72df02dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:21.775893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40e2f8-80c4-494a-ac75-858d72df02dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:21.776628 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40e2f8-80c4-494a-ac75-858d72df02dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:26:21.776970 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40e2f8-80c4-494a-ac75-858d72df02dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:21.778638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40e2f8-80c4-494a-ac75-858d72df02dc admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:21.790120 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1368/2759] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 01 18:26:21.794664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1934d45-fb76-4e77-9084-d87683cd31ff None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:21.803750 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1934d45-fb76-4e77-9084-d87683cd31ff None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:21.808628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44011b56-8150-478b-974e-f3faee8afd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:21.809321 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44011b56-8150-478b-974e-f3faee8afd03 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:21.809605 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44011b56-8150-478b-974e-f3faee8afd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:21.810535 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44011b56-8150-478b-974e-f3faee8afd03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:21.811272 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44011b56-8150-478b-974e-f3faee8afd03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:21.813202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44011b56-8150-478b-974e-f3faee8afd03 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:21.929866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1392/2760] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:26:21 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:26:21.934227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40e2f8-80c4-494a-ac75-858d72df02dc admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:21.945208 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40e2f8-80c4-494a-ac75-858d72df02dc admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:22.000730 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26891912-b21d-4849-84ff-a86cfdeb4c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:22.001430 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26891912-b21d-4849-84ff-a86cfdeb4c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:22.001722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26891912-b21d-4849-84ff-a86cfdeb4c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:22.002028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26891912-b21d-4849-84ff-a86cfdeb4c7b admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:22.002720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26891912-b21d-4849-84ff-a86cfdeb4c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:22.004667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26891912-b21d-4849-84ff-a86cfdeb4c7b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:22.081247 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1369/2761] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:26:21 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:26:22.085324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44011b56-8150-478b-974e-f3faee8afd03 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:22.096842 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44011b56-8150-478b-974e-f3faee8afd03 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:22.101403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b150f9-c861-405d-94a2-b36b28f8c5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:22.102095 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b150f9-c861-405d-94a2-b36b28f8c5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:22.102423 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b150f9-c861-405d-94a2-b36b28f8c5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:22.102702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b150f9-c861-405d-94a2-b36b28f8c5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:22.103442 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b150f9-c861-405d-94a2-b36b28f8c5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:22.105061 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b150f9-c861-405d-94a2-b36b28f8c5d2 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:22.116076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1393/2762] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:26:22.122140 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26891912-b21d-4849-84ff-a86cfdeb4c7b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:22.132104 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26891912-b21d-4849-84ff-a86cfdeb4c7b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:22.136633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0a8d7-2043-4019-9c81-cb3dae0fc118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:22.137333 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0a8d7-2043-4019-9c81-cb3dae0fc118 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:22.137614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0a8d7-2043-4019-9c81-cb3dae0fc118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:22.137910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0a8d7-2043-4019-9c81-cb3dae0fc118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:22.138712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0a8d7-2043-4019-9c81-cb3dae0fc118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:22.140293 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0a8d7-2043-4019-9c81-cb3dae0fc118 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:22.150201 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1370/2763] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 18:26:22.154658 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b150f9-c861-405d-94a2-b36b28f8c5d2 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:22.164440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b150f9-c861-405d-94a2-b36b28f8c5d2 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:22.169779 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ab6b4-bf92-4493-a9f2-c205053c55b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:22.170627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ab6b4-bf92-4493-a9f2-c205053c55b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:22.170936 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ab6b4-bf92-4493-a9f2-c205053c55b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:22.171212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ab6b4-bf92-4493-a9f2-c205053c55b2 admin admin] PATH_INFO: `/v3/projects/9aa5fe5723274872b1819582c78ccdec/users/5244881a78a54cfcaca669496dae39e9/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:22.186249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ab6b4-bf92-4493-a9f2-c205053c55b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa5fe5723274872b1819582c78ccdec, user_id=5244881a78a54cfcaca669496dae39e9, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:22.188789 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ab6b4-bf92-4493-a9f2-c205053c55b2 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:22.264993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1394/2764] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:26:22 2022] PUT /identity/v3/projects/9aa5fe5723274872b1819582c78ccdec/users/5244881a78a54cfcaca669496dae39e9/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:22.275275 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04eb34-e25f-4cab-928e-35ed6d80e474 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:22.275571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04eb34-e25f-4cab-928e-35ed6d80e474 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:22.275857 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04eb34-e25f-4cab-928e-35ed6d80e474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:22.302957 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-ae04eb34-e25f-4cab-928e-35ed6d80e474 None None] MFA Rules not processed for user `5244881a78a54cfcaca669496dae39e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:26:22.304175 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ae04eb34-e25f-4cab-928e-35ed6d80e474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:22.330063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:22.367288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1371/2765] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:26:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:26:22.371739 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ab6b4-bf92-4493-a9f2-c205053c55b2 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:22.392285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:22.434260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ab6b4-bf92-4493-a9f2-c205053c55b2 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:22.439386 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a995f-e8d7-4fc6-a323-05cc0c454c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:22.439990 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a995f-e8d7-4fc6-a323-05cc0c454c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:22.440277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a995f-e8d7-4fc6-a323-05cc0c454c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:22.440556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a995f-e8d7-4fc6-a323-05cc0c454c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:22.441285 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a995f-e8d7-4fc6-a323-05cc0c454c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:22.443187 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a995f-e8d7-4fc6-a323-05cc0c454c4d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:22.519205 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1395/2766] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:26:22 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:26:22.523296 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04eb34-e25f-4cab-928e-35ed6d80e474 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:22.535414 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04eb34-e25f-4cab-928e-35ed6d80e474 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:22.594886 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79fc0a-1fd2-4bf6-b7fd-29036a18545c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:22.595565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79fc0a-1fd2-4bf6-b7fd-29036a18545c admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:22.595854 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79fc0a-1fd2-4bf6-b7fd-29036a18545c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:22.596137 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79fc0a-1fd2-4bf6-b7fd-29036a18545c admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:22.596825 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79fc0a-1fd2-4bf6-b7fd-29036a18545c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:22.598783 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79fc0a-1fd2-4bf6-b7fd-29036a18545c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:22.687050 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1372/2767] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:26:22 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:26:22.691084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a995f-e8d7-4fc6-a323-05cc0c454c4d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:22.701807 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a995f-e8d7-4fc6-a323-05cc0c454c4d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:22.706462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766723bb-81e3-46ec-9aa7-0a6d69b134e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:22.710837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766723bb-81e3-46ec-9aa7-0a6d69b134e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:22.710837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766723bb-81e3-46ec-9aa7-0a6d69b134e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:22.710837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766723bb-81e3-46ec-9aa7-0a6d69b134e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:22.710837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766723bb-81e3-46ec-9aa7-0a6d69b134e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:22.710837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766723bb-81e3-46ec-9aa7-0a6d69b134e8 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:22.721733 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1396/2768] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:26:22.726076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79fc0a-1fd2-4bf6-b7fd-29036a18545c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:22.736290 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79fc0a-1fd2-4bf6-b7fd-29036a18545c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:22.741009 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4273f2-a20b-4aba-a9a9-bf979bc9eb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:22.741897 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4273f2-a20b-4aba-a9a9-bf979bc9eb30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:22.742187 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4273f2-a20b-4aba-a9a9-bf979bc9eb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:22.742487 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4273f2-a20b-4aba-a9a9-bf979bc9eb30 admin admin] PATH_INFO: `/v3/projects/d2b2f473ec9848b69a4ca62902bf1bfd/users/b4f1b9493c6b4099ab0a341c4f2df3c6/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:22.757772 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4273f2-a20b-4aba-a9a9-bf979bc9eb30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b2f473ec9848b69a4ca62902bf1bfd, user_id=b4f1b9493c6b4099ab0a341c4f2df3c6, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:22.760452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4273f2-a20b-4aba-a9a9-bf979bc9eb30 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:22.877417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1373/2769] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:26:22 2022] PUT /identity/v3/projects/d2b2f473ec9848b69a4ca62902bf1bfd/users/b4f1b9493c6b4099ab0a341c4f2df3c6/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:26:22.881501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766723bb-81e3-46ec-9aa7-0a6d69b134e8 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:22.892308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766723bb-81e3-46ec-9aa7-0a6d69b134e8 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:22.947221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424bef3-5f28-47e4-9a78-4264f0d704fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:22.947826 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424bef3-5f28-47e4-9a78-4264f0d704fa admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:22.948113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424bef3-5f28-47e4-9a78-4264f0d704fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:22.948391 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424bef3-5f28-47e4-9a78-4264f0d704fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:22.949144 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424bef3-5f28-47e4-9a78-4264f0d704fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:22.951392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424bef3-5f28-47e4-9a78-4264f0d704fa admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:22.961259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1397/2770] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:26:22.965680 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4273f2-a20b-4aba-a9a9-bf979bc9eb30 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:22.979573 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4273f2-a20b-4aba-a9a9-bf979bc9eb30 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:22.984633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974c2d2-5e1a-4362-8d52-ac272d08a713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:22.985554 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974c2d2-5e1a-4362-8d52-ac272d08a713 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:22.985844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974c2d2-5e1a-4362-8d52-ac272d08a713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:22.986129 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974c2d2-5e1a-4362-8d52-ac272d08a713 admin admin] PATH_INFO: `/v3/projects/d2b2f473ec9848b69a4ca62902bf1bfd/users/b4f1b9493c6b4099ab0a341c4f2df3c6/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:22.988156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974c2d2-5e1a-4362-8d52-ac272d08a713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b2f473ec9848b69a4ca62902bf1bfd, user_id=b4f1b9493c6b4099ab0a341c4f2df3c6, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:22.990844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974c2d2-5e1a-4362-8d52-ac272d08a713 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:23.001788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1374/2771] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:26:22 2022] PUT /identity/v3/projects/d2b2f473ec9848b69a4ca62902bf1bfd/users/b4f1b9493c6b4099ab0a341c4f2df3c6/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:26:23.012824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e343d-1e64-460c-a735-1737a3f8ce82 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:23.013819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e343d-1e64-460c-a735-1737a3f8ce82 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:23.014114 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e343d-1e64-460c-a735-1737a3f8ce82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:23.039984 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-f63e343d-1e64-460c-a735-1737a3f8ce82 None None] MFA Rules not processed for user `b4f1b9493c6b4099ab0a341c4f2df3c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:26:23.041245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f63e343d-1e64-460c-a735-1737a3f8ce82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:23.110913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1398/2772] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:26:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:26:23.123063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974c2d2-5e1a-4362-8d52-ac272d08a713 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:23.124905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-8974c2d2-5e1a-4362-8d52-ac272d08a713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:23.187412 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974c2d2-5e1a-4362-8d52-ac272d08a713 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:23.191120 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b728b-d233-48cd-b1a9-9a1c2c6e720d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:23.191771 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b728b-d233-48cd-b1a9-9a1c2c6e720d service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:23.192061 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b728b-d233-48cd-b1a9-9a1c2c6e720d service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:23.192342 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b728b-d233-48cd-b1a9-9a1c2c6e720d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:23.201641 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b728b-d233-48cd-b1a9-9a1c2c6e720d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:23.203028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b728b-d233-48cd-b1a9-9a1c2c6e720d service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:23.212656 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1375/2773] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:26:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:26:24.372360 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e343d-1e64-460c-a735-1737a3f8ce82 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:24.386185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:24.437623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e343d-1e64-460c-a735-1737a3f8ce82 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:24.442211 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71dc88-f792-45ed-a0a5-aa1e2beb10cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:24.443151 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71dc88-f792-45ed-a0a5-aa1e2beb10cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:24.443438 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71dc88-f792-45ed-a0a5-aa1e2beb10cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:24.443720 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71dc88-f792-45ed-a0a5-aa1e2beb10cb admin admin] PATH_INFO: `/v3/users/5244881a78a54cfcaca669496dae39e9` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:24.445081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71dc88-f792-45ed-a0a5-aa1e2beb10cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5244881a78a54cfcaca669496dae39e9)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:24.447055 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71dc88-f792-45ed-a0a5-aa1e2beb10cb admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:24.643332 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7c71dc88-f792-45ed-a0a5-aa1e2beb10cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5244881a78a54cfcaca669496dae39e9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:24.738219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7c71dc88-f792-45ed-a0a5-aa1e2beb10cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5244881a78a54cfcaca669496dae39e9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:24.745536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7c71dc88-f792-45ed-a0a5-aa1e2beb10cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5244881a78a54cfcaca669496dae39e9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:24.746199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7c71dc88-f792-45ed-a0a5-aa1e2beb10cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5244881a78a54cfcaca669496dae39e9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:24.758708 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-7c71dc88-f792-45ed-a0a5-aa1e2beb10cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5244881a78a54cfcaca669496dae39e9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:24.764628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1399/2774] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:26:24 2022] DELETE /identity/v3/users/5244881a78a54cfcaca669496dae39e9 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:24.769856 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129482ca-37af-4355-87d3-7a722e609200 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:24.770328 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129482ca-37af-4355-87d3-7a722e609200 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:24.770426 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129482ca-37af-4355-87d3-7a722e609200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:24.788746 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-129482ca-37af-4355-87d3-7a722e609200 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:26:24.790130 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-129482ca-37af-4355-87d3-7a722e609200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:24.807058 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:24.850699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1376/2775] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:26:24.860572 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71dc88-f792-45ed-a0a5-aa1e2beb10cb admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:24.862033 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7c71dc88-f792-45ed-a0a5-aa1e2beb10cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:24.921571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71dc88-f792-45ed-a0a5-aa1e2beb10cb admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:24.925384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937c8d2-6b12-4240-818d-67dec8424693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:24.926836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937c8d2-6b12-4240-818d-67dec8424693 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:24.926836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937c8d2-6b12-4240-818d-67dec8424693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:24.926836 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937c8d2-6b12-4240-818d-67dec8424693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:24.935905 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937c8d2-6b12-4240-818d-67dec8424693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:24.937920 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937c8d2-6b12-4240-818d-67dec8424693 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:24.947574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1400/2776] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:26:25.368492 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129482ca-37af-4355-87d3-7a722e609200 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:25.370115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-129482ca-37af-4355-87d3-7a722e609200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:25.382896 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129482ca-37af-4355-87d3-7a722e609200 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:25.387613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f77539-d803-411d-bdd2-8548769595fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:25.388519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f77539-d803-411d-bdd2-8548769595fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:25.388798 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f77539-d803-411d-bdd2-8548769595fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:25.389107 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f77539-d803-411d-bdd2-8548769595fa admin admin] PATH_INFO: `/v3/projects/9aa5fe5723274872b1819582c78ccdec` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:25.390296 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f77539-d803-411d-bdd2-8548769595fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa5fe5723274872b1819582c78ccdec)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:25.392800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f77539-d803-411d-bdd2-8548769595fa admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:25.528662 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-04f77539-d803-411d-bdd2-8548769595fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa5fe5723274872b1819582c78ccdec', 'request_id': 'req-04f77539-d803-411d-bdd2-8548769595fa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:25.536183 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-04f77539-d803-411d-bdd2-8548769595fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa5fe5723274872b1819582c78ccdec', 'request_id': 'req-04f77539-d803-411d-bdd2-8548769595fa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:25.606927 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-04f77539-d803-411d-bdd2-8548769595fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa5fe5723274872b1819582c78ccdec', 'request_id': 'req-04f77539-d803-411d-bdd2-8548769595fa'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:25.618591 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-04f77539-d803-411d-bdd2-8548769595fa admin admin] The token cache is being invalidate because project 9aa5fe5723274872b1819582c78ccdec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:26:25.618884 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-04f77539-d803-411d-bdd2-8548769595fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:25.619513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-04f77539-d803-411d-bdd2-8548769595fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:25.621097 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1377/2777] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:26:25 2022] DELETE /identity/v3/projects/9aa5fe5723274872b1819582c78ccdec => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:25.625118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937c8d2-6b12-4240-818d-67dec8424693 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:25.634610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937c8d2-6b12-4240-818d-67dec8424693 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:25.668651 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:25.693288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444004f-1ceb-4c76-86c0-ab3b15fd9cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:25.694153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444004f-1ceb-4c76-86c0-ab3b15fd9cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:25.694430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444004f-1ceb-4c76-86c0-ab3b15fd9cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:25.694701 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444004f-1ceb-4c76-86c0-ab3b15fd9cf2 admin admin] PATH_INFO: `/v3/users/b4f1b9493c6b4099ab0a341c4f2df3c6` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:25.695891 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444004f-1ceb-4c76-86c0-ab3b15fd9cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f1b9493c6b4099ab0a341c4f2df3c6)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:25.697997 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444004f-1ceb-4c76-86c0-ab3b15fd9cf2 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:25.843718 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e444004f-1ceb-4c76-86c0-ab3b15fd9cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f1b9493c6b4099ab0a341c4f2df3c6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:25.897964 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e444004f-1ceb-4c76-86c0-ab3b15fd9cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f1b9493c6b4099ab0a341c4f2df3c6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:25.905202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e444004f-1ceb-4c76-86c0-ab3b15fd9cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f1b9493c6b4099ab0a341c4f2df3c6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:25.905825 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e444004f-1ceb-4c76-86c0-ab3b15fd9cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f1b9493c6b4099ab0a341c4f2df3c6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:25.918309 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e444004f-1ceb-4c76-86c0-ab3b15fd9cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f1b9493c6b4099ab0a341c4f2df3c6'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:25.924471 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1401/2778] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:26:25 2022] DELETE /identity/v3/users/b4f1b9493c6b4099ab0a341c4f2df3c6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:26.345491 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f77539-d803-411d-bdd2-8548769595fa admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:26.347018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-04f77539-d803-411d-bdd2-8548769595fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:26.361222 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f77539-d803-411d-bdd2-8548769595fa admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:26.419296 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dc33c-23b9-4d09-ba25-8faaedc16b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:26.420198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dc33c-23b9-4d09-ba25-8faaedc16b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:26.420501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dc33c-23b9-4d09-ba25-8faaedc16b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:26.420764 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dc33c-23b9-4d09-ba25-8faaedc16b9a admin admin] PATH_INFO: `/v3/projects/d2b2f473ec9848b69a4ca62902bf1bfd` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:26.421972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dc33c-23b9-4d09-ba25-8faaedc16b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b2f473ec9848b69a4ca62902bf1bfd)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:26.424516 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dc33c-23b9-4d09-ba25-8faaedc16b9a admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:26.538284 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:26.539633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f9dc33c-23b9-4d09-ba25-8faaedc16b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b2f473ec9848b69a4ca62902bf1bfd', 'request_id': 'req-4f9dc33c-23b9-4d09-ba25-8faaedc16b9a'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:26.545779 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f9dc33c-23b9-4d09-ba25-8faaedc16b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b2f473ec9848b69a4ca62902bf1bfd', 'request_id': 'req-4f9dc33c-23b9-4d09-ba25-8faaedc16b9a'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:26.635364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f9dc33c-23b9-4d09-ba25-8faaedc16b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b2f473ec9848b69a4ca62902bf1bfd', 'request_id': 'req-4f9dc33c-23b9-4d09-ba25-8faaedc16b9a'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:26.646709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f9dc33c-23b9-4d09-ba25-8faaedc16b9a admin admin] The token cache is being invalidate because project d2b2f473ec9848b69a4ca62902bf1bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:26:26.646996 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f9dc33c-23b9-4d09-ba25-8faaedc16b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:26.647616 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f9dc33c-23b9-4d09-ba25-8faaedc16b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:26:26.649212 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1378/2779] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:26:26 2022] DELETE /identity/v3/projects/d2b2f473ec9848b69a4ca62902bf1bfd => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:26.654204 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bc5f2-01c7-4c39-9944-6ed8a901b21c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:26.657168 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bc5f2-01c7-4c39-9944-6ed8a901b21c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:26.657168 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bc5f2-01c7-4c39-9944-6ed8a901b21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:26.673679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-304bc5f2-01c7-4c39-9944-6ed8a901b21c None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:26:26.674907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-304bc5f2-01c7-4c39-9944-6ed8a901b21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:26.732770 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1402/2780] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:26:26.741466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613e47d-c0bf-4773-acf8-09695d0c6163 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:26.741761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613e47d-c0bf-4773-acf8-09695d0c6163 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:26.742043 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613e47d-c0bf-4773-acf8-09695d0c6163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:26.760743 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e613e47d-c0bf-4773-acf8-09695d0c6163 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:26:26.761971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e613e47d-c0bf-4773-acf8-09695d0c6163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:26.770343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1379/2781] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:26:26.774430 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bc5f2-01c7-4c39-9944-6ed8a901b21c None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:26.784599 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bc5f2-01c7-4c39-9944-6ed8a901b21c None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:26.789193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d62e99-2388-427f-9dc1-eb93c3f8855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:26.789849 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d62e99-2388-427f-9dc1-eb93c3f8855d admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:26.790134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d62e99-2388-427f-9dc1-eb93c3f8855d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:26.790410 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d62e99-2388-427f-9dc1-eb93c3f8855d admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:26.791128 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d62e99-2388-427f-9dc1-eb93c3f8855d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:26:26.791436 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d62e99-2388-427f-9dc1-eb93c3f8855d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:26.793085 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d62e99-2388-427f-9dc1-eb93c3f8855d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:26.804654 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1403/2782] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:26:26.809072 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613e47d-c0bf-4773-acf8-09695d0c6163 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:26.818631 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613e47d-c0bf-4773-acf8-09695d0c6163 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:26.823340 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a5d5a-b94d-430e-bd5b-a2ae1b98868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:26.823999 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a5d5a-b94d-430e-bd5b-a2ae1b98868e admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:26.824282 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a5d5a-b94d-430e-bd5b-a2ae1b98868e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:26.824562 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a5d5a-b94d-430e-bd5b-a2ae1b98868e admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:26.825296 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a5d5a-b94d-430e-bd5b-a2ae1b98868e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:26.827333 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a5d5a-b94d-430e-bd5b-a2ae1b98868e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:26.962962 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1380/2783] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:26:26 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:26:26.966932 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d62e99-2388-427f-9dc1-eb93c3f8855d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:26.977769 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d62e99-2388-427f-9dc1-eb93c3f8855d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:27.017852 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:27.034307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f0b68-5425-4a20-9450-3af7dc4de875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:27.034982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f0b68-5425-4a20-9450-3af7dc4de875 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:27.035269 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f0b68-5425-4a20-9450-3af7dc4de875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:27.035554 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f0b68-5425-4a20-9450-3af7dc4de875 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:27.036249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f0b68-5425-4a20-9450-3af7dc4de875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:27.038199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f0b68-5425-4a20-9450-3af7dc4de875 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:27.132488 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1404/2784] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:26:26 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:26:27.136724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a5d5a-b94d-430e-bd5b-a2ae1b98868e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:27.147842 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a5d5a-b94d-430e-bd5b-a2ae1b98868e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:27.152449 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828c018-e229-42fe-bd3a-c0847f371137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:27.153354 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828c018-e229-42fe-bd3a-c0847f371137 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:27.153733 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828c018-e229-42fe-bd3a-c0847f371137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:27.154025 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828c018-e229-42fe-bd3a-c0847f371137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:27.154959 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828c018-e229-42fe-bd3a-c0847f371137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:27.157367 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828c018-e229-42fe-bd3a-c0847f371137 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:27.167774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1381/2785] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:26:27.171710 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f0b68-5425-4a20-9450-3af7dc4de875 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:27.182364 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f0b68-5425-4a20-9450-3af7dc4de875 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:27.186955 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d8296-0a79-4fc1-a280-8e7e929c5894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:27.187615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d8296-0a79-4fc1-a280-8e7e929c5894 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:27.188773 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d8296-0a79-4fc1-a280-8e7e929c5894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:27.188881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d8296-0a79-4fc1-a280-8e7e929c5894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:27.189578 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d8296-0a79-4fc1-a280-8e7e929c5894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:27.191168 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d8296-0a79-4fc1-a280-8e7e929c5894 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:27.200924 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1405/2786] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:26:27.206029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828c018-e229-42fe-bd3a-c0847f371137 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:27.216136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828c018-e229-42fe-bd3a-c0847f371137 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:27.221138 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4031f-73c4-4453-8621-ef3fea6f2fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:27.222051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4031f-73c4-4453-8621-ef3fea6f2fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:27.222359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4031f-73c4-4453-8621-ef3fea6f2fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:27.222645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4031f-73c4-4453-8621-ef3fea6f2fe8 admin admin] PATH_INFO: `/v3/projects/a5d319ac2006402ea8a63bfa04bbda53/users/67d3b1df098d43af825f665f667b0844/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:27.237206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4031f-73c4-4453-8621-ef3fea6f2fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5d319ac2006402ea8a63bfa04bbda53, user_id=67d3b1df098d43af825f665f667b0844, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:27.239875 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4031f-73c4-4453-8621-ef3fea6f2fe8 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:27.361464 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1382/2787] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:26:27 2022] PUT /identity/v3/projects/a5d319ac2006402ea8a63bfa04bbda53/users/67d3b1df098d43af825f665f667b0844/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:26:27.371787 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f9eb-04f9-4f4e-8233-dd67935db72c None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:27.372079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f9eb-04f9-4f4e-8233-dd67935db72c None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:27.372361 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f9eb-04f9-4f4e-8233-dd67935db72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:27.399288 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-cef4f9eb-04f9-4f4e-8233-dd67935db72c None None] MFA Rules not processed for user `67d3b1df098d43af825f665f667b0844`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:26:27.400485 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-cef4f9eb-04f9-4f4e-8233-dd67935db72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:27.463593 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1406/2788] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:26:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:26:27.474981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4031f-73c4-4453-8621-ef3fea6f2fe8 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:27.476691 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4cc4031f-73c4-4453-8621-ef3fea6f2fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:27.533584 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4031f-73c4-4453-8621-ef3fea6f2fe8 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:27.537255 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5819a-7560-4231-add5-6da06f21ed2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:27.537899 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5819a-7560-4231-add5-6da06f21ed2f service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:27.538189 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5819a-7560-4231-add5-6da06f21ed2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:27.538472 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5819a-7560-4231-add5-6da06f21ed2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:27.546979 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5819a-7560-4231-add5-6da06f21ed2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:27.549249 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5819a-7560-4231-add5-6da06f21ed2f service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:27.558199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1383/2789] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:26:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:26:37.460585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=47,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:37.554027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=60,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:26:55.014699 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f9eb-04f9-4f4e-8233-dd67935db72c None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:26:55.016382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-cef4f9eb-04f9-4f4e-8233-dd67935db72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:55.079390 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f9eb-04f9-4f4e-8233-dd67935db72c None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:26:55.083146 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a681ea-d8ca-453a-9bed-3dc32d68ac9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:26:55.083801 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a681ea-d8ca-453a-9bed-3dc32d68ac9c service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:26:55.084091 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a681ea-d8ca-453a-9bed-3dc32d68ac9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:26:55.084373 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a681ea-d8ca-453a-9bed-3dc32d68ac9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:26:55.086154 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-02a681ea-d8ca-453a-9bed-3dc32d68ac9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:26:55.095787 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a681ea-d8ca-453a-9bed-3dc32d68ac9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:26:55.097311 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a681ea-d8ca-453a-9bed-3dc32d68ac9c service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:26:55.105510 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1407/2790] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:26:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:27:00.200245 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5819a-7560-4231-add5-6da06f21ed2f service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:00.209784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5819a-7560-4231-add5-6da06f21ed2f service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:00.213451 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc960f0-37e4-438a-9a46-5fb24423d6a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:00.214100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc960f0-37e4-438a-9a46-5fb24423d6a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:00.214384 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc960f0-37e4-438a-9a46-5fb24423d6a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:00.214671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc960f0-37e4-438a-9a46-5fb24423d6a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:00.216433 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-efc960f0-37e4-438a-9a46-5fb24423d6a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:00.226138 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc960f0-37e4-438a-9a46-5fb24423d6a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:00.227581 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc960f0-37e4-438a-9a46-5fb24423d6a0 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:00.237409 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1384/2791] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:27:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:27:00.653996 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a681ea-d8ca-453a-9bed-3dc32d68ac9c service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:00.655359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-02a681ea-d8ca-453a-9bed-3dc32d68ac9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:00.667491 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a681ea-d8ca-453a-9bed-3dc32d68ac9c service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:00.674670 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec989ab-a058-4936-a731-503c1add69e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:00.675560 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec989ab-a058-4936-a731-503c1add69e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:00.675907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec989ab-a058-4936-a731-503c1add69e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:00.676255 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec989ab-a058-4936-a731-503c1add69e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:00.678217 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-1ec989ab-a058-4936-a731-503c1add69e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:00.689794 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec989ab-a058-4936-a731-503c1add69e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:00.691330 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec989ab-a058-4936-a731-503c1add69e1 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:00.700838 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1408/2792] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:27:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:27:00.785756 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc960f0-37e4-438a-9a46-5fb24423d6a0 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:00.795144 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc960f0-37e4-438a-9a46-5fb24423d6a0 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:00.798894 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a856b9a-4379-4a11-acb0-5316dbf9ce80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:00.799517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a856b9a-4379-4a11-acb0-5316dbf9ce80 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:00.799804 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a856b9a-4379-4a11-acb0-5316dbf9ce80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:00.800083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a856b9a-4379-4a11-acb0-5316dbf9ce80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:00.801893 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4a856b9a-4379-4a11-acb0-5316dbf9ce80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:00.876845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a856b9a-4379-4a11-acb0-5316dbf9ce80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:00.878313 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a856b9a-4379-4a11-acb0-5316dbf9ce80 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:00.890027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1385/2793] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:27:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:27:00.951298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec989ab-a058-4936-a731-503c1add69e1 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:00.952973 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-1ec989ab-a058-4936-a731-503c1add69e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:01.023213 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec989ab-a058-4936-a731-503c1add69e1 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:01.029049 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb9c64-5725-445d-b4d3-3da3960eed08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:01.029702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb9c64-5725-445d-b4d3-3da3960eed08 service placement] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:01.029991 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb9c64-5725-445d-b4d3-3da3960eed08 service placement] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:01.030292 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb9c64-5725-445d-b4d3-3da3960eed08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:01.032051 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d0eb9c64-5725-445d-b4d3-3da3960eed08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:01.043665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb9c64-5725-445d-b4d3-3da3960eed08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:01.045270 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb9c64-5725-445d-b4d3-3da3960eed08 service placement] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:01.055076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1409/2794] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:27:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:27:08.250460 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a856b9a-4379-4a11-acb0-5316dbf9ce80 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:08.252028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4a856b9a-4379-4a11-acb0-5316dbf9ce80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:08.266574 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a856b9a-4379-4a11-acb0-5316dbf9ce80 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:08.272102 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3eddad-296f-4de6-b53f-f612b4d8e839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:08.272754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eddad-296f-4de6-b53f-f612b4d8e839 service nova] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:08.273082 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eddad-296f-4de6-b53f-f612b4d8e839 service nova] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:08.273364 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eddad-296f-4de6-b53f-f612b4d8e839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:08.275107 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-4d3eddad-296f-4de6-b53f-f612b4d8e839 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:08.353165 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3eddad-296f-4de6-b53f-f612b4d8e839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:08.354757 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3eddad-296f-4de6-b53f-f612b4d8e839 service nova] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:08.363812 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1386/2795] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:27:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:27:11.050785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=64 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:27:18.359626 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=73 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:27:19.473010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb9c64-5725-445d-b4d3-3da3960eed08 service placement] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:19.533898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb9c64-5725-445d-b4d3-3da3960eed08 service placement] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:19.538392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73710b54-4b6d-437e-a8fd-f34617b551d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:19.539260 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73710b54-4b6d-437e-a8fd-f34617b551d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:19.539542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73710b54-4b6d-437e-a8fd-f34617b551d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:19.539817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73710b54-4b6d-437e-a8fd-f34617b551d2 admin admin] PATH_INFO: `/v3/users/67d3b1df098d43af825f665f667b0844` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:19.541046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73710b54-4b6d-437e-a8fd-f34617b551d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d3b1df098d43af825f665f667b0844)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:19.542960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73710b54-4b6d-437e-a8fd-f34617b551d2 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:19.751768 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-73710b54-4b6d-437e-a8fd-f34617b551d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d3b1df098d43af825f665f667b0844'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:19.807175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-73710b54-4b6d-437e-a8fd-f34617b551d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d3b1df098d43af825f665f667b0844'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:19.814517 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-73710b54-4b6d-437e-a8fd-f34617b551d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d3b1df098d43af825f665f667b0844'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:19.821115 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-73710b54-4b6d-437e-a8fd-f34617b551d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d3b1df098d43af825f665f667b0844'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:19.827056 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-73710b54-4b6d-437e-a8fd-f34617b551d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d3b1df098d43af825f665f667b0844'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:19.832919 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1410/2796] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:27:19 2022] DELETE /identity/v3/users/67d3b1df098d43af825f665f667b0844 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:27:19.837544 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5170fbc-19de-4c90-8862-e27a733552af None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:19.837996 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5170fbc-19de-4c90-8862-e27a733552af None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:19.838398 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5170fbc-19de-4c90-8862-e27a733552af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:19.855438 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e5170fbc-19de-4c90-8862-e27a733552af None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:27:19.856627 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e5170fbc-19de-4c90-8862-e27a733552af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:19.914597 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1387/2797] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:27:19.924918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73710b54-4b6d-437e-a8fd-f34617b551d2 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:19.926372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-73710b54-4b6d-437e-a8fd-f34617b551d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:19.984245 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73710b54-4b6d-437e-a8fd-f34617b551d2 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:19.987966 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bf1a5-ca5f-4e37-9411-bd0a9c47088a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:19.988640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bf1a5-ca5f-4e37-9411-bd0a9c47088a service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:19.988926 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bf1a5-ca5f-4e37-9411-bd0a9c47088a service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:19.989307 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bf1a5-ca5f-4e37-9411-bd0a9c47088a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:19.998384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bf1a5-ca5f-4e37-9411-bd0a9c47088a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:19.999834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bf1a5-ca5f-4e37-9411-bd0a9c47088a service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:20.013263 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1411/2798] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:27:20.495223 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5170fbc-19de-4c90-8862-e27a733552af None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:20.496718 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e5170fbc-19de-4c90-8862-e27a733552af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:20.510739 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5170fbc-19de-4c90-8862-e27a733552af None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:20.519327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a7bfe-31aa-4ebd-b2f4-59f5bf6e348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:20.519327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a7bfe-31aa-4ebd-b2f4-59f5bf6e348d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:20.519327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a7bfe-31aa-4ebd-b2f4-59f5bf6e348d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:20.519327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a7bfe-31aa-4ebd-b2f4-59f5bf6e348d admin admin] PATH_INFO: `/v3/projects/a5d319ac2006402ea8a63bfa04bbda53` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:20.519746 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a7bfe-31aa-4ebd-b2f4-59f5bf6e348d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5d319ac2006402ea8a63bfa04bbda53)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:20.520903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a7bfe-31aa-4ebd-b2f4-59f5bf6e348d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:20.653822 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4c8a7bfe-31aa-4ebd-b2f4-59f5bf6e348d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5d319ac2006402ea8a63bfa04bbda53', 'request_id': 'req-4c8a7bfe-31aa-4ebd-b2f4-59f5bf6e348d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:20.660483 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4c8a7bfe-31aa-4ebd-b2f4-59f5bf6e348d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5d319ac2006402ea8a63bfa04bbda53', 'request_id': 'req-4c8a7bfe-31aa-4ebd-b2f4-59f5bf6e348d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:20.767349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4c8a7bfe-31aa-4ebd-b2f4-59f5bf6e348d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5d319ac2006402ea8a63bfa04bbda53', 'request_id': 'req-4c8a7bfe-31aa-4ebd-b2f4-59f5bf6e348d'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:20.784014 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4c8a7bfe-31aa-4ebd-b2f4-59f5bf6e348d admin admin] The token cache is being invalidate because project a5d319ac2006402ea8a63bfa04bbda53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:27:20.788762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4c8a7bfe-31aa-4ebd-b2f4-59f5bf6e348d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:20.788762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4c8a7bfe-31aa-4ebd-b2f4-59f5bf6e348d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:20.788762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1388/2799] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:27:20 2022] DELETE /identity/v3/projects/a5d319ac2006402ea8a63bfa04bbda53 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:27:20.792552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aed20-f56a-4e22-ad8b-13960cf5fec0 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:20.793076 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aed20-f56a-4e22-ad8b-13960cf5fec0 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:20.793279 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aed20-f56a-4e22-ad8b-13960cf5fec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:20.812290 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-f95aed20-f56a-4e22-ad8b-13960cf5fec0 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:27:20.813647 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f95aed20-f56a-4e22-ad8b-13960cf5fec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:20.831502 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:27:20.875342 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1412/2800] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:27:20.883109 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547f733-3ecc-4236-8d73-fd587180e568 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:20.883599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547f733-3ecc-4236-8d73-fd587180e568 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:20.883703 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547f733-3ecc-4236-8d73-fd587180e568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:20.902118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-b547f733-3ecc-4236-8d73-fd587180e568 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:27:20.903337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-b547f733-3ecc-4236-8d73-fd587180e568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:20.911584 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1389/2801] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:27:20.915882 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aed20-f56a-4e22-ad8b-13960cf5fec0 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:20.926772 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aed20-f56a-4e22-ad8b-13960cf5fec0 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:20.931879 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d236ed-2a10-4ec6-927c-29923cb1b689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:20.932543 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d236ed-2a10-4ec6-927c-29923cb1b689 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:20.932876 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d236ed-2a10-4ec6-927c-29923cb1b689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:20.933186 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d236ed-2a10-4ec6-927c-29923cb1b689 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:20.933913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d236ed-2a10-4ec6-927c-29923cb1b689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:27:20.934228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d236ed-2a10-4ec6-927c-29923cb1b689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:20.936711 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d236ed-2a10-4ec6-927c-29923cb1b689 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:20.948215 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1413/2802] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:27:20.952647 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547f733-3ecc-4236-8d73-fd587180e568 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:20.962098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547f733-3ecc-4236-8d73-fd587180e568 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:20.967194 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8719ac-6913-4f5e-a73e-8822fe3d00b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:20.968186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8719ac-6913-4f5e-a73e-8822fe3d00b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:20.968530 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8719ac-6913-4f5e-a73e-8822fe3d00b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:20.977215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8719ac-6913-4f5e-a73e-8822fe3d00b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:20.977215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8719ac-6913-4f5e-a73e-8822fe3d00b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:20.977215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8719ac-6913-4f5e-a73e-8822fe3d00b2 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:21.117968 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1390/2803] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:27:20 2022] POST /identity/v3/projects => generated 389 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:27:21.122308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d236ed-2a10-4ec6-927c-29923cb1b689 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:21.133362 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d236ed-2a10-4ec6-927c-29923cb1b689 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:21.191998 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc092d8-8387-4ad8-99b0-f115881e4f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:21.192675 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc092d8-8387-4ad8-99b0-f115881e4f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:21.192996 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc092d8-8387-4ad8-99b0-f115881e4f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:21.193280 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc092d8-8387-4ad8-99b0-f115881e4f0b admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:21.194084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc092d8-8387-4ad8-99b0-f115881e4f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:21.196063 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc092d8-8387-4ad8-99b0-f115881e4f0b admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:21.304212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1414/2804] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:27:21 2022] POST /identity/v3/users => generated 295 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:27:21.308457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8719ac-6913-4f5e-a73e-8822fe3d00b2 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:21.318987 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8719ac-6913-4f5e-a73e-8822fe3d00b2 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:21.323647 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be1a68-0002-4325-85f2-5404a8088da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:21.324307 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be1a68-0002-4325-85f2-5404a8088da6 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:21.324596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be1a68-0002-4325-85f2-5404a8088da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:21.324881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be1a68-0002-4325-85f2-5404a8088da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:21.325673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be1a68-0002-4325-85f2-5404a8088da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:21.327280 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be1a68-0002-4325-85f2-5404a8088da6 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:21.337537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1391/2805] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:27:21.341201 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc092d8-8387-4ad8-99b0-f115881e4f0b admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:21.351871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc092d8-8387-4ad8-99b0-f115881e4f0b admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:21.356501 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10dbae-b066-44b0-b724-d206c3285123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:21.357198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10dbae-b066-44b0-b724-d206c3285123 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:21.357528 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10dbae-b066-44b0-b724-d206c3285123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:21.358522 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10dbae-b066-44b0-b724-d206c3285123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:21.359252 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10dbae-b066-44b0-b724-d206c3285123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:21.360838 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10dbae-b066-44b0-b724-d206c3285123 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:21.370595 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1415/2806] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:27:21.375110 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be1a68-0002-4325-85f2-5404a8088da6 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:21.387051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be1a68-0002-4325-85f2-5404a8088da6 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:21.392107 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63312a54-ec5d-4a76-89b7-8e38111705d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:21.393174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63312a54-ec5d-4a76-89b7-8e38111705d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:21.393702 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63312a54-ec5d-4a76-89b7-8e38111705d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:21.394208 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63312a54-ec5d-4a76-89b7-8e38111705d1 admin admin] PATH_INFO: `/v3/projects/00c6dd723a3f489d8094e067d4e4ca06/users/564b34a32e6c411f8562f0c79de35dce/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:21.410545 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63312a54-ec5d-4a76-89b7-8e38111705d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c6dd723a3f489d8094e067d4e4ca06, user_id=564b34a32e6c411f8562f0c79de35dce, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:21.413416 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63312a54-ec5d-4a76-89b7-8e38111705d1 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:21.481622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1392/2807] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:27:21 2022] PUT /identity/v3/projects/00c6dd723a3f489d8094e067d4e4ca06/users/564b34a32e6c411f8562f0c79de35dce/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:27:21.492534 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b249158-e3f3-4369-a96c-1e526ce0b4d1 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:21.492830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b249158-e3f3-4369-a96c-1e526ce0b4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:21.493218 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b249158-e3f3-4369-a96c-1e526ce0b4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:21.520008 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-7b249158-e3f3-4369-a96c-1e526ce0b4d1 None None] MFA Rules not processed for user `564b34a32e6c411f8562f0c79de35dce`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:27:21.521273 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7b249158-e3f3-4369-a96c-1e526ce0b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:21.586873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1416/2808] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:27:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:27:21.598781 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63312a54-ec5d-4a76-89b7-8e38111705d1 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:21.600493 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-63312a54-ec5d-4a76-89b7-8e38111705d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:21.622107 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:27:21.658103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63312a54-ec5d-4a76-89b7-8e38111705d1 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:21.661917 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2709f-3774-458c-8251-afae33d92452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:21.662598 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2709f-3774-458c-8251-afae33d92452 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:21.662982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2709f-3774-458c-8251-afae33d92452 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:21.663271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2709f-3774-458c-8251-afae33d92452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:21.672812 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2709f-3774-458c-8251-afae33d92452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:21.674566 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2709f-3774-458c-8251-afae33d92452 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:21.684604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1393/2809] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:27:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:27:30.570855 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b249158-e3f3-4369-a96c-1e526ce0b4d1 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:30.572429 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7b249158-e3f3-4369-a96c-1e526ce0b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:30.594761 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:27:30.652628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b249158-e3f3-4369-a96c-1e526ce0b4d1 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:30.660084 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d938c-1e88-4e44-94a5-5be431066c83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:30.661284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d938c-1e88-4e44-94a5-5be431066c83 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:30.661284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d938c-1e88-4e44-94a5-5be431066c83 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:30.661470 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d938c-1e88-4e44-94a5-5be431066c83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:30.663147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-cd0d938c-1e88-4e44-94a5-5be431066c83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:30.682584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d938c-1e88-4e44-94a5-5be431066c83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:30.689094 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d938c-1e88-4e44-94a5-5be431066c83 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:30.700054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1417/2810] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:27:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:27:31.784049 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=17 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:27:40.762385 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=26 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:27:45.268317 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2709f-3774-458c-8251-afae33d92452 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:45.269895 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-63a2709f-3774-458c-8251-afae33d92452 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:45.327170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2709f-3774-458c-8251-afae33d92452 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:45.331027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7181e4-9339-4ee1-8c6f-95e802fe8bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:45.331704 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7181e4-9339-4ee1-8c6f-95e802fe8bcf service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:45.332006 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7181e4-9339-4ee1-8c6f-95e802fe8bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:45.332271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7181e4-9339-4ee1-8c6f-95e802fe8bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:45.334081 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-eb7181e4-9339-4ee1-8c6f-95e802fe8bcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:45.404525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7181e4-9339-4ee1-8c6f-95e802fe8bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:45.406113 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7181e4-9339-4ee1-8c6f-95e802fe8bcf service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:45.416434 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1394/2811] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:27:47.725977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d938c-1e88-4e44-94a5-5be431066c83 service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:47.736880 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d938c-1e88-4e44-94a5-5be431066c83 service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:47.741841 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd3956-d668-46c1-bd18-71b1dd5e4d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:47.742809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd3956-d668-46c1-bd18-71b1dd5e4d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:47.743099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd3956-d668-46c1-bd18-71b1dd5e4d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:47.743368 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd3956-d668-46c1-bd18-71b1dd5e4d4b admin admin] PATH_INFO: `/v3/users/564b34a32e6c411f8562f0c79de35dce` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:47.744585 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd3956-d668-46c1-bd18-71b1dd5e4d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=564b34a32e6c411f8562f0c79de35dce)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:47.746753 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd3956-d668-46c1-bd18-71b1dd5e4d4b admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:47.883364 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-77bd3956-d668-46c1-bd18-71b1dd5e4d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564b34a32e6c411f8562f0c79de35dce'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:47.938983 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-77bd3956-d668-46c1-bd18-71b1dd5e4d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564b34a32e6c411f8562f0c79de35dce'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:47.945536 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-77bd3956-d668-46c1-bd18-71b1dd5e4d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564b34a32e6c411f8562f0c79de35dce'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:47.947347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-77bd3956-d668-46c1-bd18-71b1dd5e4d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564b34a32e6c411f8562f0c79de35dce'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:47.967817 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-77bd3956-d668-46c1-bd18-71b1dd5e4d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564b34a32e6c411f8562f0c79de35dce'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:47.977105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1418/2812] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:27:47 2022] DELETE /identity/v3/users/564b34a32e6c411f8562f0c79de35dce => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:27:47.981883 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091bd00-3d26-4b6b-9f08-ac4f9811b8b2 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:47.982337 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091bd00-3d26-4b6b-9f08-ac4f9811b8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:47.982447 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091bd00-3d26-4b6b-9f08-ac4f9811b8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:48.000844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-1091bd00-3d26-4b6b-9f08-ac4f9811b8b2 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:27:48.002286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1091bd00-3d26-4b6b-9f08-ac4f9811b8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:48.070483 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1395/2813] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:27:48.080961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd3956-d668-46c1-bd18-71b1dd5e4d4b admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:48.082521 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-77bd3956-d668-46c1-bd18-71b1dd5e4d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:48.149990 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd3956-d668-46c1-bd18-71b1dd5e4d4b admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:48.153426 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470da4e-12cb-4cdc-8244-0354f1734ba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:48.154099 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470da4e-12cb-4cdc-8244-0354f1734ba9 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:48.154387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470da4e-12cb-4cdc-8244-0354f1734ba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:48.154669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470da4e-12cb-4cdc-8244-0354f1734ba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:48.166726 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470da4e-12cb-4cdc-8244-0354f1734ba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:48.168929 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470da4e-12cb-4cdc-8244-0354f1734ba9 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:48.181780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1419/2814] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:27:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:27:48.678466 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091bd00-3d26-4b6b-9f08-ac4f9811b8b2 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:48.680142 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-1091bd00-3d26-4b6b-9f08-ac4f9811b8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:48.694411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091bd00-3d26-4b6b-9f08-ac4f9811b8b2 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:48.700963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47041a4b-018e-4485-b049-3709be81499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:48.702135 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47041a4b-018e-4485-b049-3709be81499c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:48.702481 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47041a4b-018e-4485-b049-3709be81499c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:48.702862 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47041a4b-018e-4485-b049-3709be81499c admin admin] PATH_INFO: `/v3/projects/00c6dd723a3f489d8094e067d4e4ca06` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:48.704347 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47041a4b-018e-4485-b049-3709be81499c admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c6dd723a3f489d8094e067d4e4ca06)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:48.706604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47041a4b-018e-4485-b049-3709be81499c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:48.800100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:27:48.803807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-47041a4b-018e-4485-b049-3709be81499c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c6dd723a3f489d8094e067d4e4ca06', 'request_id': 'req-47041a4b-018e-4485-b049-3709be81499c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:48.811077 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-47041a4b-018e-4485-b049-3709be81499c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c6dd723a3f489d8094e067d4e4ca06', 'request_id': 'req-47041a4b-018e-4485-b049-3709be81499c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:48.847384 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-47041a4b-018e-4485-b049-3709be81499c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c6dd723a3f489d8094e067d4e4ca06', 'request_id': 'req-47041a4b-018e-4485-b049-3709be81499c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:48.863502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-47041a4b-018e-4485-b049-3709be81499c admin admin] The token cache is being invalidate because project 00c6dd723a3f489d8094e067d4e4ca06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:27:48.863812 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-47041a4b-018e-4485-b049-3709be81499c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:48.864470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-47041a4b-018e-4485-b049-3709be81499c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:48.868989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1396/2815] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:27:48 2022] DELETE /identity/v3/projects/00c6dd723a3f489d8094e067d4e4ca06 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:27:49.009626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470da4e-12cb-4cdc-8244-0354f1734ba9 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:49.013214 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-1470da4e-12cb-4cdc-8244-0354f1734ba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:49.135166 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470da4e-12cb-4cdc-8244-0354f1734ba9 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:49.151036 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:27:49.153035 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47041a4b-018e-4485-b049-3709be81499c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:49.155215 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-47041a4b-018e-4485-b049-3709be81499c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:49.208096 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9ae13-fbec-4882-820a-db95295f3d6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:49.208759 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ae13-fbec-4882-820a-db95295f3d6c service placement] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:49.209075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ae13-fbec-4882-820a-db95295f3d6c service placement] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:49.209354 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ae13-fbec-4882-820a-db95295f3d6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:49.211206 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-eea9ae13-fbec-4882-820a-db95295f3d6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:49.225077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9ae13-fbec-4882-820a-db95295f3d6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:49.228251 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9ae13-fbec-4882-820a-db95295f3d6c service placement] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:49.238237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1420/2816] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:27:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:27:49.239298 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47041a4b-018e-4485-b049-3709be81499c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:49.244151 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65112d2a-3cca-4df9-aacd-4ea5c59db51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:49.245066 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65112d2a-3cca-4df9-aacd-4ea5c59db51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:49.245674 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65112d2a-3cca-4df9-aacd-4ea5c59db51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:49.245961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65112d2a-3cca-4df9-aacd-4ea5c59db51d admin admin] PATH_INFO: `/v3/users/eb6555ff5f3f4823aee38990265d3a29` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:49.247340 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65112d2a-3cca-4df9-aacd-4ea5c59db51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb6555ff5f3f4823aee38990265d3a29)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:49.249860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65112d2a-3cca-4df9-aacd-4ea5c59db51d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:49.443974 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-65112d2a-3cca-4df9-aacd-4ea5c59db51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb6555ff5f3f4823aee38990265d3a29'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:49.504059 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-65112d2a-3cca-4df9-aacd-4ea5c59db51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb6555ff5f3f4823aee38990265d3a29'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:49.516465 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-65112d2a-3cca-4df9-aacd-4ea5c59db51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb6555ff5f3f4823aee38990265d3a29'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:49.516465 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-65112d2a-3cca-4df9-aacd-4ea5c59db51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb6555ff5f3f4823aee38990265d3a29'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:49.528480 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-65112d2a-3cca-4df9-aacd-4ea5c59db51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb6555ff5f3f4823aee38990265d3a29'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:49.535502 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1397/2817] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:27:49 2022] DELETE /identity/v3/users/eb6555ff5f3f4823aee38990265d3a29 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:27:49.802416 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9ae13-fbec-4882-820a-db95295f3d6c service placement] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:49.814275 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9ae13-fbec-4882-820a-db95295f3d6c service placement] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:49.875387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c336300-5dee-4933-9e88-9ed76192f35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:49.876254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c336300-5dee-4933-9e88-9ed76192f35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:49.877205 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c336300-5dee-4933-9e88-9ed76192f35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:49.877484 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c336300-5dee-4933-9e88-9ed76192f35c admin admin] PATH_INFO: `/v3/projects/3e4006221f1b4ddda2e54fb2db4f88c9` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:49.878681 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c336300-5dee-4933-9e88-9ed76192f35c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4006221f1b4ddda2e54fb2db4f88c9)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:49.880645 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c336300-5dee-4933-9e88-9ed76192f35c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:49.978352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9c336300-5dee-4933-9e88-9ed76192f35c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4006221f1b4ddda2e54fb2db4f88c9', 'request_id': 'req-9c336300-5dee-4933-9e88-9ed76192f35c'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:49.985025 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9c336300-5dee-4933-9e88-9ed76192f35c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4006221f1b4ddda2e54fb2db4f88c9', 'request_id': 'req-9c336300-5dee-4933-9e88-9ed76192f35c'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:50.058130 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9c336300-5dee-4933-9e88-9ed76192f35c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4006221f1b4ddda2e54fb2db4f88c9', 'request_id': 'req-9c336300-5dee-4933-9e88-9ed76192f35c'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:50.069200 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9c336300-5dee-4933-9e88-9ed76192f35c admin admin] The token cache is being invalidate because project 3e4006221f1b4ddda2e54fb2db4f88c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:27:50.069490 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9c336300-5dee-4933-9e88-9ed76192f35c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:50.070113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-9c336300-5dee-4933-9e88-9ed76192f35c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:27:50.071665 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1421/2818] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:27:49 2022] DELETE /identity/v3/projects/3e4006221f1b4ddda2e54fb2db4f88c9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:27:50.077324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26dc8d-a9a0-4e40-afe8-f31c20f5c64d None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:50.077614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26dc8d-a9a0-4e40-afe8-f31c20f5c64d None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:50.077911 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26dc8d-a9a0-4e40-afe8-f31c20f5c64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:50.097291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-cd26dc8d-a9a0-4e40-afe8-f31c20f5c64d None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:27:50.098613 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-cd26dc8d-a9a0-4e40-afe8-f31c20f5c64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:50.147505 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:27:50.161248 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1398/2819] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:27:50.170268 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96140f91-be79-4666-9c53-1641f2c8898a None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:50.170586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96140f91-be79-4666-9c53-1641f2c8898a None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:50.170871 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96140f91-be79-4666-9c53-1641f2c8898a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:50.190472 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-96140f91-be79-4666-9c53-1641f2c8898a None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:27:50.191688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-96140f91-be79-4666-9c53-1641f2c8898a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:50.200185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1422/2820] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:27:50.205216 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26dc8d-a9a0-4e40-afe8-f31c20f5c64d None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:50.215329 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26dc8d-a9a0-4e40-afe8-f31c20f5c64d None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:50.220783 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490da2f-3845-4137-aaf6-88a5d292bd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:50.221525 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490da2f-3845-4137-aaf6-88a5d292bd68 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:50.221818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490da2f-3845-4137-aaf6-88a5d292bd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:50.222100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490da2f-3845-4137-aaf6-88a5d292bd68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:50.222887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490da2f-3845-4137-aaf6-88a5d292bd68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:27:50.223195 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490da2f-3845-4137-aaf6-88a5d292bd68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:50.224806 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490da2f-3845-4137-aaf6-88a5d292bd68 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:50.236252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1399/2821] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:27:50.240874 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96140f91-be79-4666-9c53-1641f2c8898a None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:50.250091 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96140f91-be79-4666-9c53-1641f2c8898a None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:50.254858 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf938d91-1cd5-4233-9cbf-3f2b064dc78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:50.255507 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf938d91-1cd5-4233-9cbf-3f2b064dc78a admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:50.255796 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf938d91-1cd5-4233-9cbf-3f2b064dc78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:50.256075 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf938d91-1cd5-4233-9cbf-3f2b064dc78a admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:50.256763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf938d91-1cd5-4233-9cbf-3f2b064dc78a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:50.258750 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf938d91-1cd5-4233-9cbf-3f2b064dc78a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:50.311069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1423/2822] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:27:50 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:27:50.315150 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490da2f-3845-4137-aaf6-88a5d292bd68 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:50.324864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490da2f-3845-4137-aaf6-88a5d292bd68 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:50.380777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58ba26-8bb9-48c4-bc39-0ca63f6f8e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:50.381464 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58ba26-8bb9-48c4-bc39-0ca63f6f8e31 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:50.381749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58ba26-8bb9-48c4-bc39-0ca63f6f8e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:50.382027 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58ba26-8bb9-48c4-bc39-0ca63f6f8e31 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:50.382721 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58ba26-8bb9-48c4-bc39-0ca63f6f8e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:50.384623 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58ba26-8bb9-48c4-bc39-0ca63f6f8e31 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:50.447390 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1400/2823] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:27:50 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:27:50.451615 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf938d91-1cd5-4233-9cbf-3f2b064dc78a admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:50.462873 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf938d91-1cd5-4233-9cbf-3f2b064dc78a admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:50.467626 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c9b08-d836-47e9-9994-8f026edc6aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:50.468300 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c9b08-d836-47e9-9994-8f026edc6aef admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:50.468633 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c9b08-d836-47e9-9994-8f026edc6aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:50.468911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c9b08-d836-47e9-9994-8f026edc6aef admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:50.469666 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c9b08-d836-47e9-9994-8f026edc6aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:50.471345 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c9b08-d836-47e9-9994-8f026edc6aef admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:50.473549 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:27:50.484408 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1424/2824] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:27:50.488541 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58ba26-8bb9-48c4-bc39-0ca63f6f8e31 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:50.498785 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58ba26-8bb9-48c4-bc39-0ca63f6f8e31 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:50.503887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bdd5c-957d-4b3d-97a1-e29c29f811b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:50.504547 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bdd5c-957d-4b3d-97a1-e29c29f811b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:50.504829 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bdd5c-957d-4b3d-97a1-e29c29f811b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:50.505136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bdd5c-957d-4b3d-97a1-e29c29f811b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:50.505882 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bdd5c-957d-4b3d-97a1-e29c29f811b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:50.507440 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bdd5c-957d-4b3d-97a1-e29c29f811b3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:50.517959 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1401/2825] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:27:50.522046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c9b08-d836-47e9-9994-8f026edc6aef admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:50.531872 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c9b08-d836-47e9-9994-8f026edc6aef admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:50.537139 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af8a97-811d-4738-84cb-286170ac3530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:50.538021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af8a97-811d-4738-84cb-286170ac3530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:50.538305 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af8a97-811d-4738-84cb-286170ac3530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:50.538584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af8a97-811d-4738-84cb-286170ac3530 admin admin] PATH_INFO: `/v3/projects/8b6ae56d369b4e6db64fde297ce66863/users/0fd9232578aa478b98f9a9ae3643e2f4/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:50.553444 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af8a97-811d-4738-84cb-286170ac3530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b6ae56d369b4e6db64fde297ce66863, user_id=0fd9232578aa478b98f9a9ae3643e2f4, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:50.556434 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af8a97-811d-4738-84cb-286170ac3530 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:50.624740 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1425/2826] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:27:50 2022] PUT /identity/v3/projects/8b6ae56d369b4e6db64fde297ce66863/users/0fd9232578aa478b98f9a9ae3643e2f4/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:27:50.635355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0678a-a146-4b04-9e32-1e1e3bbd2acc None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:50.635650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0678a-a146-4b04-9e32-1e1e3bbd2acc None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:50.635956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0678a-a146-4b04-9e32-1e1e3bbd2acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:50.663294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-fcf0678a-a146-4b04-9e32-1e1e3bbd2acc None None] MFA Rules not processed for user `0fd9232578aa478b98f9a9ae3643e2f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:27:50.664500 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fcf0678a-a146-4b04-9e32-1e1e3bbd2acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:50.728731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1402/2827] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:27:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:27:50.733317 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af8a97-811d-4738-84cb-286170ac3530 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:50.793914 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af8a97-811d-4738-84cb-286170ac3530 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:50.799083 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9ff96-1453-4c25-8028-ff5305f44b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:50.799735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9ff96-1453-4c25-8028-ff5305f44b1b admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:50.800017 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9ff96-1453-4c25-8028-ff5305f44b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:50.800289 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9ff96-1453-4c25-8028-ff5305f44b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:50.801009 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9ff96-1453-4c25-8028-ff5305f44b1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:50.802900 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9ff96-1453-4c25-8028-ff5305f44b1b admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:50.883578 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1426/2828] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:27:50 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:27:50.890699 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0678a-a146-4b04-9e32-1e1e3bbd2acc None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:50.902035 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0678a-a146-4b04-9e32-1e1e3bbd2acc None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:50.947721 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:27:50.959397 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc05d2c-959f-43c1-a7eb-9f9d88984214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:50.960075 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc05d2c-959f-43c1-a7eb-9f9d88984214 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:50.960356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc05d2c-959f-43c1-a7eb-9f9d88984214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:50.960634 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc05d2c-959f-43c1-a7eb-9f9d88984214 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:50.961346 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc05d2c-959f-43c1-a7eb-9f9d88984214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:50.963253 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc05d2c-959f-43c1-a7eb-9f9d88984214 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:51.041327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1403/2829] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:27:50 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:27:51.045249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9ff96-1453-4c25-8028-ff5305f44b1b admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:51.056401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9ff96-1453-4c25-8028-ff5305f44b1b admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:51.061236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7518ef-bc47-4815-8d43-0be2d34e6156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:51.061903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7518ef-bc47-4815-8d43-0be2d34e6156 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:51.062190 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7518ef-bc47-4815-8d43-0be2d34e6156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:51.062471 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7518ef-bc47-4815-8d43-0be2d34e6156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:51.063257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7518ef-bc47-4815-8d43-0be2d34e6156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:51.065515 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7518ef-bc47-4815-8d43-0be2d34e6156 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:51.076010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1427/2830] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:27:51.080087 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc05d2c-959f-43c1-a7eb-9f9d88984214 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:51.090100 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc05d2c-959f-43c1-a7eb-9f9d88984214 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:51.094904 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6da4f-781a-45d8-b81b-03ab2892b24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:51.095844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6da4f-781a-45d8-b81b-03ab2892b24d admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:51.096142 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6da4f-781a-45d8-b81b-03ab2892b24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:51.096423 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6da4f-781a-45d8-b81b-03ab2892b24d admin admin] PATH_INFO: `/v3/projects/df7be86c315e4afaaf4efa3eb20c8228/users/142aa3d83d624af09e3039ba052cb543/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:51.111596 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6da4f-781a-45d8-b81b-03ab2892b24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7be86c315e4afaaf4efa3eb20c8228, user_id=142aa3d83d624af09e3039ba052cb543, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:51.114304 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6da4f-781a-45d8-b81b-03ab2892b24d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:51.167076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1404/2831] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:27:51 2022] PUT /identity/v3/projects/df7be86c315e4afaaf4efa3eb20c8228/users/142aa3d83d624af09e3039ba052cb543/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:27:51.170940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7518ef-bc47-4815-8d43-0be2d34e6156 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:51.182134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7518ef-bc47-4815-8d43-0be2d34e6156 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:51.246923 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7a403-ffec-4e3a-a8ef-ab9ad3de7f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:51.247823 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7a403-ffec-4e3a-a8ef-ab9ad3de7f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:51.248202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7a403-ffec-4e3a-a8ef-ab9ad3de7f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:51.248571 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7a403-ffec-4e3a-a8ef-ab9ad3de7f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:51.249462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7a403-ffec-4e3a-a8ef-ab9ad3de7f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:51.251178 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7a403-ffec-4e3a-a8ef-ab9ad3de7f68 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:51.264497 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1428/2832] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 01 18:27:51.269126 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6da4f-781a-45d8-b81b-03ab2892b24d admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:51.279338 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6da4f-781a-45d8-b81b-03ab2892b24d admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:51.284601 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a37b2-c860-4f9c-840b-1343a5aff445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:51.285531 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a37b2-c860-4f9c-840b-1343a5aff445 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:51.285810 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a37b2-c860-4f9c-840b-1343a5aff445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:51.286083 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a37b2-c860-4f9c-840b-1343a5aff445 admin admin] PATH_INFO: `/v3/projects/df7be86c315e4afaaf4efa3eb20c8228/users/142aa3d83d624af09e3039ba052cb543/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:51.288022 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a37b2-c860-4f9c-840b-1343a5aff445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7be86c315e4afaaf4efa3eb20c8228, user_id=142aa3d83d624af09e3039ba052cb543, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:51.290684 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a37b2-c860-4f9c-840b-1343a5aff445 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:51.301312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1405/2833] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:27:51 2022] PUT /identity/v3/projects/df7be86c315e4afaaf4efa3eb20c8228/users/142aa3d83d624af09e3039ba052cb543/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:27:51.312583 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fa25c-57e4-412f-ac48-03a7d488fb9d None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:51.312877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fa25c-57e4-412f-ac48-03a7d488fb9d None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:51.313193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fa25c-57e4-412f-ac48-03a7d488fb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:51.339261 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b38fa25c-57e4-412f-ac48-03a7d488fb9d None None] MFA Rules not processed for user `142aa3d83d624af09e3039ba052cb543`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:27:51.340466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b38fa25c-57e4-412f-ac48-03a7d488fb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:51.373203 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:27:51.409503 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1429/2834] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:27:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:27:51.420620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a37b2-c860-4f9c-840b-1343a5aff445 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:51.422323 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-9b2a37b2-c860-4f9c-840b-1343a5aff445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:27:51.491969 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a37b2-c860-4f9c-840b-1343a5aff445 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:51.495658 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb00b23-5b55-4fce-9c21-ac5dde6bccd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:51.496312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb00b23-5b55-4fce-9c21-ac5dde6bccd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:51.496603 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb00b23-5b55-4fce-9c21-ac5dde6bccd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:51.496887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb00b23-5b55-4fce-9c21-ac5dde6bccd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:51.506114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb00b23-5b55-4fce-9c21-ac5dde6bccd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:51.507529 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb00b23-5b55-4fce-9c21-ac5dde6bccd9 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:51.517624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1406/2835] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:27:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:27:51.729187 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fa25c-57e4-412f-ac48-03a7d488fb9d None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:27:51.739332 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fa25c-57e4-412f-ac48-03a7d488fb9d None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:27:51.742974 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fb3f5-c311-4aab-991c-8204c836259d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:27:51.748401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fb3f5-c311-4aab-991c-8204c836259d service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:27:51.748401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fb3f5-c311-4aab-991c-8204c836259d service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:27:51.748401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fb3f5-c311-4aab-991c-8204c836259d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:27:51.799635 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fb3f5-c311-4aab-991c-8204c836259d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:27:51.801149 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fb3f5-c311-4aab-991c-8204c836259d service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:27:51.810327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1430/2836] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:27:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:28:01.512753 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=53,keystone:INSERT=5 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:28:01.806410 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=42 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:28:45.881754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb00b23-5b55-4fce-9c21-ac5dde6bccd9 service cinder] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:45.944804 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb00b23-5b55-4fce-9c21-ac5dde6bccd9 service cinder] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:45.949535 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409469f-d781-43a9-88b2-e880ac71b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:45.950453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409469f-d781-43a9-88b2-e880ac71b6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:45.950783 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409469f-d781-43a9-88b2-e880ac71b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:45.951115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409469f-d781-43a9-88b2-e880ac71b6de admin admin] PATH_INFO: `/v3/users/0fd9232578aa478b98f9a9ae3643e2f4` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:45.953432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409469f-d781-43a9-88b2-e880ac71b6de admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fd9232578aa478b98f9a9ae3643e2f4)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:45.955368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409469f-d781-43a9-88b2-e880ac71b6de admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:46.135846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f409469f-d781-43a9-88b2-e880ac71b6de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fd9232578aa478b98f9a9ae3643e2f4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:46.206904 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f409469f-d781-43a9-88b2-e880ac71b6de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fd9232578aa478b98f9a9ae3643e2f4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:46.214294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f409469f-d781-43a9-88b2-e880ac71b6de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fd9232578aa478b98f9a9ae3643e2f4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:46.214980 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f409469f-d781-43a9-88b2-e880ac71b6de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fd9232578aa478b98f9a9ae3643e2f4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:46.227134 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-f409469f-d781-43a9-88b2-e880ac71b6de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fd9232578aa478b98f9a9ae3643e2f4'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:46.233199 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1407/2837] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:28:45 2022] DELETE /identity/v3/users/0fd9232578aa478b98f9a9ae3643e2f4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:28:46.237989 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce97149-c81a-4fc3-87d1-f86637abe075 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:46.238461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce97149-c81a-4fc3-87d1-f86637abe075 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:46.238557 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce97149-c81a-4fc3-87d1-f86637abe075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:46.255461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-cce97149-c81a-4fc3-87d1-f86637abe075 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:28:46.256645 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-cce97149-c81a-4fc3-87d1-f86637abe075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:46.322646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1431/2838] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:28:46.333624 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409469f-d781-43a9-88b2-e880ac71b6de admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:46.335043 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-f409469f-d781-43a9-88b2-e880ac71b6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:46.395308 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409469f-d781-43a9-88b2-e880ac71b6de admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:46.398864 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8dfe8-cbf9-4c67-85ec-66a7b8ed3d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:46.399506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8dfe8-cbf9-4c67-85ec-66a7b8ed3d16 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:46.399791 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8dfe8-cbf9-4c67-85ec-66a7b8ed3d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:46.400079 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8dfe8-cbf9-4c67-85ec-66a7b8ed3d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:46.409450 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8dfe8-cbf9-4c67-85ec-66a7b8ed3d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:46.410944 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8dfe8-cbf9-4c67-85ec-66a7b8ed3d16 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:46.420832 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1408/2839] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:28:46.893922 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce97149-c81a-4fc3-87d1-f86637abe075 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:46.895388 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-cce97149-c81a-4fc3-87d1-f86637abe075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:46.907825 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce97149-c81a-4fc3-87d1-f86637abe075 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:46.912587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d75fe7-1874-4ede-b551-5a86eae9d4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:46.913507 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d75fe7-1874-4ede-b551-5a86eae9d4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:46.913831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d75fe7-1874-4ede-b551-5a86eae9d4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:46.914109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d75fe7-1874-4ede-b551-5a86eae9d4a4 admin admin] PATH_INFO: `/v3/projects/8b6ae56d369b4e6db64fde297ce66863` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:46.915363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d75fe7-1874-4ede-b551-5a86eae9d4a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b6ae56d369b4e6db64fde297ce66863)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:46.917350 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d75fe7-1874-4ede-b551-5a86eae9d4a4 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:47.024835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-45d75fe7-1874-4ede-b551-5a86eae9d4a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b6ae56d369b4e6db64fde297ce66863', 'request_id': 'req-45d75fe7-1874-4ede-b551-5a86eae9d4a4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:47.032121 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-45d75fe7-1874-4ede-b551-5a86eae9d4a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b6ae56d369b4e6db64fde297ce66863', 'request_id': 'req-45d75fe7-1874-4ede-b551-5a86eae9d4a4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:47.109679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-45d75fe7-1874-4ede-b551-5a86eae9d4a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b6ae56d369b4e6db64fde297ce66863', 'request_id': 'req-45d75fe7-1874-4ede-b551-5a86eae9d4a4'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:47.120580 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-45d75fe7-1874-4ede-b551-5a86eae9d4a4 admin admin] The token cache is being invalidate because project 8b6ae56d369b4e6db64fde297ce66863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:28:47.160243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-45d75fe7-1874-4ede-b551-5a86eae9d4a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:47.160243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-45d75fe7-1874-4ede-b551-5a86eae9d4a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:47.160243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1432/2840] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:28:46 2022] DELETE /identity/v3/projects/8b6ae56d369b4e6db64fde297ce66863 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:28:47.160563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8dfe8-cbf9-4c67-85ec-66a7b8ed3d16 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:47.160563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8dfe8-cbf9-4c67-85ec-66a7b8ed3d16 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:47.160563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:28:47.198523 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e77e8f-8785-4f21-ac22-49948e0ee27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:47.199324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e77e8f-8785-4f21-ac22-49948e0ee27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:47.199608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e77e8f-8785-4f21-ac22-49948e0ee27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:47.199888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e77e8f-8785-4f21-ac22-49948e0ee27d admin admin] PATH_INFO: `/v3/users/142aa3d83d624af09e3039ba052cb543` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:47.201117 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e77e8f-8785-4f21-ac22-49948e0ee27d admin admin] RBAC: Authorizing `identity:delete_user(user_id=142aa3d83d624af09e3039ba052cb543)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:47.203754 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e77e8f-8785-4f21-ac22-49948e0ee27d admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:47.415159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b3e77e8f-8785-4f21-ac22-49948e0ee27d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142aa3d83d624af09e3039ba052cb543'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:47.498593 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b3e77e8f-8785-4f21-ac22-49948e0ee27d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142aa3d83d624af09e3039ba052cb543'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:47.515780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b3e77e8f-8785-4f21-ac22-49948e0ee27d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142aa3d83d624af09e3039ba052cb543'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:47.515780 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b3e77e8f-8785-4f21-ac22-49948e0ee27d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142aa3d83d624af09e3039ba052cb543'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:47.521711 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-b3e77e8f-8785-4f21-ac22-49948e0ee27d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142aa3d83d624af09e3039ba052cb543'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:47.527610 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1409/2841] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:28:47 2022] DELETE /identity/v3/users/142aa3d83d624af09e3039ba052cb543 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:28:47.986584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d75fe7-1874-4ede-b551-5a86eae9d4a4 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:47.988102 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-45d75fe7-1874-4ede-b551-5a86eae9d4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:48.011431 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d75fe7-1874-4ede-b551-5a86eae9d4a4 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:48.093346 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65c661-7f48-47e0-a323-dfe63208c7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:48.094280 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65c661-7f48-47e0-a323-dfe63208c7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:48.094566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65c661-7f48-47e0-a323-dfe63208c7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:48.094852 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65c661-7f48-47e0-a323-dfe63208c7a9 admin admin] PATH_INFO: `/v3/projects/df7be86c315e4afaaf4efa3eb20c8228` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:48.096093 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65c661-7f48-47e0-a323-dfe63208c7a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7be86c315e4afaaf4efa3eb20c8228)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:48.098147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65c661-7f48-47e0-a323-dfe63208c7a9 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:48.237198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:28:48.253000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dd65c661-7f48-47e0-a323-dfe63208c7a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7be86c315e4afaaf4efa3eb20c8228', 'request_id': 'req-dd65c661-7f48-47e0-a323-dfe63208c7a9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:48.259231 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dd65c661-7f48-47e0-a323-dfe63208c7a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7be86c315e4afaaf4efa3eb20c8228', 'request_id': 'req-dd65c661-7f48-47e0-a323-dfe63208c7a9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:48.344542 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dd65c661-7f48-47e0-a323-dfe63208c7a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7be86c315e4afaaf4efa3eb20c8228', 'request_id': 'req-dd65c661-7f48-47e0-a323-dfe63208c7a9'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:48.355545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dd65c661-7f48-47e0-a323-dfe63208c7a9 admin admin] The token cache is being invalidate because project df7be86c315e4afaaf4efa3eb20c8228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:28:48.360499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dd65c661-7f48-47e0-a323-dfe63208c7a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:48.360499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-dd65c661-7f48-47e0-a323-dfe63208c7a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:48.360499 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1433/2842] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:28:47 2022] DELETE /identity/v3/projects/df7be86c315e4afaaf4efa3eb20c8228 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:28:48.364680 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e3242-5485-43f4-9e1c-d754c376f47a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:48.365156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e3242-5485-43f4-9e1c-d754c376f47a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:48.365322 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e3242-5485-43f4-9e1c-d754c376f47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:48.383740 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-128e3242-5485-43f4-9e1c-d754c376f47a None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:28:48.384972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-128e3242-5485-43f4-9e1c-d754c376f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:48.448772 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1410/2843] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:28:48.456815 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf66657-501d-473a-81bd-cf0f27276cbb None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:48.457134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf66657-501d-473a-81bd-cf0f27276cbb None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:48.457410 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf66657-501d-473a-81bd-cf0f27276cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:48.477548 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-daf66657-501d-473a-81bd-cf0f27276cbb None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:28:48.478758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-daf66657-501d-473a-81bd-cf0f27276cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:48.487370 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1434/2844] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:28:48.491632 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e3242-5485-43f4-9e1c-d754c376f47a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:48.501285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e3242-5485-43f4-9e1c-d754c376f47a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:48.505778 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7004ce-dd1b-4246-9a50-0bd4c9b823ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:48.506429 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7004ce-dd1b-4246-9a50-0bd4c9b823ad admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:48.506711 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7004ce-dd1b-4246-9a50-0bd4c9b823ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:48.506989 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7004ce-dd1b-4246-9a50-0bd4c9b823ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:48.507710 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7004ce-dd1b-4246-9a50-0bd4c9b823ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:28:48.508015 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7004ce-dd1b-4246-9a50-0bd4c9b823ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:48.509650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7004ce-dd1b-4246-9a50-0bd4c9b823ad admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:48.521653 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1411/2845] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:28:48.525926 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf66657-501d-473a-81bd-cf0f27276cbb None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:48.535758 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf66657-501d-473a-81bd-cf0f27276cbb None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:48.540448 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8849e6-1fec-4e83-879b-c154760a35d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:48.541138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8849e6-1fec-4e83-879b-c154760a35d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:48.541448 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8849e6-1fec-4e83-879b-c154760a35d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:48.541739 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8849e6-1fec-4e83-879b-c154760a35d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:48.542433 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8849e6-1fec-4e83-879b-c154760a35d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:48.544335 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8849e6-1fec-4e83-879b-c154760a35d3 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:48.642809 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1435/2846] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:28:48 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:28:48.646982 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7004ce-dd1b-4246-9a50-0bd4c9b823ad admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:48.657842 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7004ce-dd1b-4246-9a50-0bd4c9b823ad admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:48.684291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:28:48.715396 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90dfdc-5e26-41f4-9894-d6706bbc3456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:48.716073 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90dfdc-5e26-41f4-9894-d6706bbc3456 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:48.716459 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90dfdc-5e26-41f4-9894-d6706bbc3456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:48.716724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90dfdc-5e26-41f4-9894-d6706bbc3456 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:48.717517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90dfdc-5e26-41f4-9894-d6706bbc3456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:48.722114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90dfdc-5e26-41f4-9894-d6706bbc3456 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:48.812436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1412/2847] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:28:48 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 01 18:28:48.816628 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8849e6-1fec-4e83-879b-c154760a35d3 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:48.827141 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8849e6-1fec-4e83-879b-c154760a35d3 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:48.832448 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd1175-7e2d-4beb-ae94-62f3da9d813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:48.833145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd1175-7e2d-4beb-ae94-62f3da9d813e admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:48.833425 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd1175-7e2d-4beb-ae94-62f3da9d813e admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:48.833707 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd1175-7e2d-4beb-ae94-62f3da9d813e admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:48.834433 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd1175-7e2d-4beb-ae94-62f3da9d813e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:48.836018 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd1175-7e2d-4beb-ae94-62f3da9d813e admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:48.847153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1436/2848] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:28:48.851118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90dfdc-5e26-41f4-9894-d6706bbc3456 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:48.860913 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90dfdc-5e26-41f4-9894-d6706bbc3456 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:48.865522 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dae22-4c24-49e1-9bd0-9e44d2b0fe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:48.866172 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dae22-4c24-49e1-9bd0-9e44d2b0fe48 admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:48.866454 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dae22-4c24-49e1-9bd0-9e44d2b0fe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:48.866726 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dae22-4c24-49e1-9bd0-9e44d2b0fe48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:48.867446 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dae22-4c24-49e1-9bd0-9e44d2b0fe48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:48.869048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dae22-4c24-49e1-9bd0-9e44d2b0fe48 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:48.878825 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1413/2849] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:28:48.882806 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd1175-7e2d-4beb-ae94-62f3da9d813e admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:48.893326 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd1175-7e2d-4beb-ae94-62f3da9d813e admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:48.897923 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0a875-c4ec-4ceb-bf13-ecbcbfb5689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:48.898800 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0a875-c4ec-4ceb-bf13-ecbcbfb5689a admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:48.899082 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0a875-c4ec-4ceb-bf13-ecbcbfb5689a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:48.899391 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0a875-c4ec-4ceb-bf13-ecbcbfb5689a admin admin] PATH_INFO: `/v3/projects/3401afb706d5407b8a0b1932779533ca/users/9c597033e2c04107b4851529acec8ccc/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:48.914210 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0a875-c4ec-4ceb-bf13-ecbcbfb5689a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3401afb706d5407b8a0b1932779533ca, user_id=9c597033e2c04107b4851529acec8ccc, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:48.916862 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0a875-c4ec-4ceb-bf13-ecbcbfb5689a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:49.007560 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1437/2850] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:28:48 2022] PUT /identity/v3/projects/3401afb706d5407b8a0b1932779533ca/users/9c597033e2c04107b4851529acec8ccc/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:28:49.071455 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485767b0-745f-439f-831d-fd4e803d0243 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:49.071671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485767b0-745f-439f-831d-fd4e803d0243 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:49.071957 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485767b0-745f-439f-831d-fd4e803d0243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:49.098452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-485767b0-745f-439f-831d-fd4e803d0243 None None] MFA Rules not processed for user `9c597033e2c04107b4851529acec8ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:28:49.099650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-485767b0-745f-439f-831d-fd4e803d0243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:49.163818 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1414/2851] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:28:49.168061 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0a875-c4ec-4ceb-bf13-ecbcbfb5689a admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:49.230493 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0a875-c4ec-4ceb-bf13-ecbcbfb5689a admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:49.235621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a1d1f-1e12-4417-a9b5-32532bca88f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:49.236293 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a1d1f-1e12-4417-a9b5-32532bca88f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:49.236586 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a1d1f-1e12-4417-a9b5-32532bca88f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:49.236866 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a1d1f-1e12-4417-a9b5-32532bca88f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:49.237603 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a1d1f-1e12-4417-a9b5-32532bca88f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:49.239623 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a1d1f-1e12-4417-a9b5-32532bca88f4 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:49.339413 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1438/2852] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:28:49 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:28:49.343477 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485767b0-745f-439f-831d-fd4e803d0243 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:49.354368 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485767b0-745f-439f-831d-fd4e803d0243 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:49.409887 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121c4cc-a8ff-461b-8c01-a595c5c0fff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:49.410546 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121c4cc-a8ff-461b-8c01-a595c5c0fff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:49.410833 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121c4cc-a8ff-461b-8c01-a595c5c0fff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:49.411113 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121c4cc-a8ff-461b-8c01-a595c5c0fff3 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:49.411804 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121c4cc-a8ff-461b-8c01-a595c5c0fff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:49.413761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121c4cc-a8ff-461b-8c01-a595c5c0fff3 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:49.509831 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1415/2853] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:28:49 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:28:49.513835 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a1d1f-1e12-4417-a9b5-32532bca88f4 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:49.524621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a1d1f-1e12-4417-a9b5-32532bca88f4 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:49.529461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28c0e7-ad62-4fb5-b873-182340800a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:49.530123 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28c0e7-ad62-4fb5-b873-182340800a59 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:49.530404 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28c0e7-ad62-4fb5-b873-182340800a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:49.530683 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28c0e7-ad62-4fb5-b873-182340800a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:49.531702 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28c0e7-ad62-4fb5-b873-182340800a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:49.533363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28c0e7-ad62-4fb5-b873-182340800a59 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:49.544257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1439/2854] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:28:49.548920 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121c4cc-a8ff-461b-8c01-a595c5c0fff3 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:49.559284 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121c4cc-a8ff-461b-8c01-a595c5c0fff3 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:49.565277 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bec17-c124-4208-ba38-73af803d4c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:49.566965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bec17-c124-4208-ba38-73af803d4c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:49.566965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bec17-c124-4208-ba38-73af803d4c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:49.566965 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bec17-c124-4208-ba38-73af803d4c99 admin admin] PATH_INFO: `/v3/projects/22b7a390daab4683938e994034391bd7/users/26eb96c43f3a4fa786583864bbe3cf94/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:49.584222 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bec17-c124-4208-ba38-73af803d4c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b7a390daab4683938e994034391bd7, user_id=26eb96c43f3a4fa786583864bbe3cf94, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:49.587608 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bec17-c124-4208-ba38-73af803d4c99 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:49.647114 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1416/2855] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:28:49 2022] PUT /identity/v3/projects/22b7a390daab4683938e994034391bd7/users/26eb96c43f3a4fa786583864bbe3cf94/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:28:49.651323 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28c0e7-ad62-4fb5-b873-182340800a59 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:49.661568 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28c0e7-ad62-4fb5-b873-182340800a59 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:49.682198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:28:49.719638 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a579839-b941-436f-a58d-c8c5fc57f6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:49.720331 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a579839-b941-436f-a58d-c8c5fc57f6ef admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:49.720612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a579839-b941-436f-a58d-c8c5fc57f6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:49.720886 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a579839-b941-436f-a58d-c8c5fc57f6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:49.721664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a579839-b941-436f-a58d-c8c5fc57f6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:49.723254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a579839-b941-436f-a58d-c8c5fc57f6ef admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:49.732996 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1440/2856] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:28:49.737892 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bec17-c124-4208-ba38-73af803d4c99 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:49.743345 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:28:49.748848 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bec17-c124-4208-ba38-73af803d4c99 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:49.753712 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ede70-6915-4a95-8f97-cbeb14e1c8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:49.754692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ede70-6915-4a95-8f97-cbeb14e1c8db admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:49.754984 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ede70-6915-4a95-8f97-cbeb14e1c8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:49.755266 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ede70-6915-4a95-8f97-cbeb14e1c8db admin admin] PATH_INFO: `/v3/projects/22b7a390daab4683938e994034391bd7/users/26eb96c43f3a4fa786583864bbe3cf94/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:49.757292 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ede70-6915-4a95-8f97-cbeb14e1c8db admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b7a390daab4683938e994034391bd7, user_id=26eb96c43f3a4fa786583864bbe3cf94, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:49.760105 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ede70-6915-4a95-8f97-cbeb14e1c8db admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:49.770722 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1417/2857] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:28:49 2022] PUT /identity/v3/projects/22b7a390daab4683938e994034391bd7/users/26eb96c43f3a4fa786583864bbe3cf94/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:28:49.780680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dd05b-2b36-48d9-a1fe-6bc9e9fd1b60 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:49.781555 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dd05b-2b36-48d9-a1fe-6bc9e9fd1b60 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:49.781831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dd05b-2b36-48d9-a1fe-6bc9e9fd1b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:49.808801 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-799dd05b-2b36-48d9-a1fe-6bc9e9fd1b60 None None] MFA Rules not processed for user `26eb96c43f3a4fa786583864bbe3cf94`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:28:49.810039 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-799dd05b-2b36-48d9-a1fe-6bc9e9fd1b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:49.877185 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1441/2858] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:28:49.888063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ede70-6915-4a95-8f97-cbeb14e1c8db admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:49.889786 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-157ede70-6915-4a95-8f97-cbeb14e1c8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:49.947508 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ede70-6915-4a95-8f97-cbeb14e1c8db admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:49.951113 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987ae02-742b-4c7e-81de-c7475171a6df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:49.951759 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987ae02-742b-4c7e-81de-c7475171a6df service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:49.952045 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987ae02-742b-4c7e-81de-c7475171a6df service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:49.952324 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987ae02-742b-4c7e-81de-c7475171a6df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:49.962170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987ae02-742b-4c7e-81de-c7475171a6df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:49.963600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987ae02-742b-4c7e-81de-c7475171a6df service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:49.973363 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1418/2859] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:28:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:28:50.462051 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799dd05b-2b36-48d9-a1fe-6bc9e9fd1b60 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:50.524052 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799dd05b-2b36-48d9-a1fe-6bc9e9fd1b60 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:50.528559 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518df08-e704-4ed4-9c95-6021b67b9f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:50.529461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518df08-e704-4ed4-9c95-6021b67b9f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:50.529745 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518df08-e704-4ed4-9c95-6021b67b9f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:50.530021 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518df08-e704-4ed4-9c95-6021b67b9f6c admin admin] PATH_INFO: `/v3/users/9c597033e2c04107b4851529acec8ccc` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:50.531780 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518df08-e704-4ed4-9c95-6021b67b9f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c597033e2c04107b4851529acec8ccc)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:50.533785 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518df08-e704-4ed4-9c95-6021b67b9f6c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:50.711427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c518df08-e704-4ed4-9c95-6021b67b9f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c597033e2c04107b4851529acec8ccc'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:50.713086 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:28:50.846324 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c518df08-e704-4ed4-9c95-6021b67b9f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c597033e2c04107b4851529acec8ccc'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:50.853409 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c518df08-e704-4ed4-9c95-6021b67b9f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c597033e2c04107b4851529acec8ccc'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:50.854043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c518df08-e704-4ed4-9c95-6021b67b9f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c597033e2c04107b4851529acec8ccc'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:50.866434 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-c518df08-e704-4ed4-9c95-6021b67b9f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c597033e2c04107b4851529acec8ccc'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:50.872276 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1442/2860] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:28:50 2022] DELETE /identity/v3/users/9c597033e2c04107b4851529acec8ccc => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:28:50.877227 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bc3a3-a519-45ed-8efd-6adb68e451bc None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:50.877700 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bc3a3-a519-45ed-8efd-6adb68e451bc None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:50.877825 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bc3a3-a519-45ed-8efd-6adb68e451bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:50.896245 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-998bc3a3-a519-45ed-8efd-6adb68e451bc None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:28:50.897482 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-998bc3a3-a519-45ed-8efd-6adb68e451bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:50.958076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1419/2861] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:28:50.967630 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518df08-e704-4ed4-9c95-6021b67b9f6c admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:50.970134 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-c518df08-e704-4ed4-9c95-6021b67b9f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:51.027243 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518df08-e704-4ed4-9c95-6021b67b9f6c admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:51.031685 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339ae79-0add-4117-9d0c-76ac24dcfdd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:51.032340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339ae79-0add-4117-9d0c-76ac24dcfdd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:51.032627 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339ae79-0add-4117-9d0c-76ac24dcfdd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:51.032907 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339ae79-0add-4117-9d0c-76ac24dcfdd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:51.041998 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339ae79-0add-4117-9d0c-76ac24dcfdd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:51.043439 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339ae79-0add-4117-9d0c-76ac24dcfdd6 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:51.053188 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1443/2862] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:28:51.461898 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bc3a3-a519-45ed-8efd-6adb68e451bc None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:51.463501 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-998bc3a3-a519-45ed-8efd-6adb68e451bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:51.480791 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bc3a3-a519-45ed-8efd-6adb68e451bc None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:51.486066 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae04f6-2f50-438c-bf00-1f7835a37095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:51.486946 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae04f6-2f50-438c-bf00-1f7835a37095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:51.487309 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae04f6-2f50-438c-bf00-1f7835a37095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:51.487500 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae04f6-2f50-438c-bf00-1f7835a37095 admin admin] PATH_INFO: `/v3/projects/3401afb706d5407b8a0b1932779533ca` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:51.488784 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae04f6-2f50-438c-bf00-1f7835a37095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3401afb706d5407b8a0b1932779533ca)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:51.490665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae04f6-2f50-438c-bf00-1f7835a37095 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:51.598720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-64ae04f6-2f50-438c-bf00-1f7835a37095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3401afb706d5407b8a0b1932779533ca', 'request_id': 'req-64ae04f6-2f50-438c-bf00-1f7835a37095'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:51.604845 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-64ae04f6-2f50-438c-bf00-1f7835a37095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3401afb706d5407b8a0b1932779533ca', 'request_id': 'req-64ae04f6-2f50-438c-bf00-1f7835a37095'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:51.663794 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-64ae04f6-2f50-438c-bf00-1f7835a37095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3401afb706d5407b8a0b1932779533ca', 'request_id': 'req-64ae04f6-2f50-438c-bf00-1f7835a37095'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:51.675388 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-64ae04f6-2f50-438c-bf00-1f7835a37095 admin admin] The token cache is being invalidate because project 3401afb706d5407b8a0b1932779533ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:28:51.675700 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-64ae04f6-2f50-438c-bf00-1f7835a37095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:51.681039 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-64ae04f6-2f50-438c-bf00-1f7835a37095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:51.681039 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1420/2863] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:28:51 2022] DELETE /identity/v3/projects/3401afb706d5407b8a0b1932779533ca => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:28:51.682297 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339ae79-0add-4117-9d0c-76ac24dcfdd6 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:51.692530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339ae79-0add-4117-9d0c-76ac24dcfdd6 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:51.747545 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9d1e1-419e-4787-854f-a2bbdf2d5042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:51.748379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9d1e1-419e-4787-854f-a2bbdf2d5042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:51.748673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9d1e1-419e-4787-854f-a2bbdf2d5042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:51.748977 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9d1e1-419e-4787-854f-a2bbdf2d5042 admin admin] PATH_INFO: `/v3/users/26eb96c43f3a4fa786583864bbe3cf94` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:51.750902 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9d1e1-419e-4787-854f-a2bbdf2d5042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26eb96c43f3a4fa786583864bbe3cf94)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:51.752843 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9d1e1-419e-4787-854f-a2bbdf2d5042 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:51.905587 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e6e9d1e1-419e-4787-854f-a2bbdf2d5042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26eb96c43f3a4fa786583864bbe3cf94'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:51.955262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e6e9d1e1-419e-4787-854f-a2bbdf2d5042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26eb96c43f3a4fa786583864bbe3cf94'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:51.962277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e6e9d1e1-419e-4787-854f-a2bbdf2d5042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26eb96c43f3a4fa786583864bbe3cf94'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:51.962925 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e6e9d1e1-419e-4787-854f-a2bbdf2d5042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26eb96c43f3a4fa786583864bbe3cf94'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:51.967992 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:28:51.975237 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e6e9d1e1-419e-4787-854f-a2bbdf2d5042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26eb96c43f3a4fa786583864bbe3cf94'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:51.981067 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1444/2864] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:28:51 2022] DELETE /identity/v3/users/26eb96c43f3a4fa786583864bbe3cf94 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:28:52.411941 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae04f6-2f50-438c-bf00-1f7835a37095 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:52.411941 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-64ae04f6-2f50-438c-bf00-1f7835a37095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:52.424739 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae04f6-2f50-438c-bf00-1f7835a37095 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:52.437326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:28:52.485762 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95e864-20fb-4336-9d4a-0d868e03b294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:52.486633 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e864-20fb-4336-9d4a-0d868e03b294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:52.487018 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e864-20fb-4336-9d4a-0d868e03b294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:52.487513 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e864-20fb-4336-9d4a-0d868e03b294 admin admin] PATH_INFO: `/v3/projects/22b7a390daab4683938e994034391bd7` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:52.489310 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95e864-20fb-4336-9d4a-0d868e03b294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b7a390daab4683938e994034391bd7)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:52.491349 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95e864-20fb-4336-9d4a-0d868e03b294 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:52.681483 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f95e864-20fb-4336-9d4a-0d868e03b294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b7a390daab4683938e994034391bd7', 'request_id': 'req-4f95e864-20fb-4336-9d4a-0d868e03b294'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:52.688030 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f95e864-20fb-4336-9d4a-0d868e03b294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b7a390daab4683938e994034391bd7', 'request_id': 'req-4f95e864-20fb-4336-9d4a-0d868e03b294'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:52.760986 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f95e864-20fb-4336-9d4a-0d868e03b294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b7a390daab4683938e994034391bd7', 'request_id': 'req-4f95e864-20fb-4336-9d4a-0d868e03b294'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:52.772692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f95e864-20fb-4336-9d4a-0d868e03b294 admin admin] The token cache is being invalidate because project 22b7a390daab4683938e994034391bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:28:52.773016 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f95e864-20fb-4336-9d4a-0d868e03b294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:52.773673 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-4f95e864-20fb-4336-9d4a-0d868e03b294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:52.775226 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1421/2865] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:28:52 2022] DELETE /identity/v3/projects/22b7a390daab4683938e994034391bd7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:28:52.780374 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e21b10-87a8-48e9-a498-a94e0b4f49ce None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:52.780848 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e21b10-87a8-48e9-a498-a94e0b4f49ce None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:52.781153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e21b10-87a8-48e9-a498-a94e0b4f49ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:52.798937 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-93e21b10-87a8-48e9-a498-a94e0b4f49ce None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:28:52.800218 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-93e21b10-87a8-48e9-a498-a94e0b4f49ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:53.001112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1445/2866] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:28:53.009844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b181b-9637-4264-a9bb-1278f9701265 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:53.010143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b181b-9637-4264-a9bb-1278f9701265 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:53.010511 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b181b-9637-4264-a9bb-1278f9701265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:53.029208 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-371b181b-9637-4264-a9bb-1278f9701265 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:28:53.030408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-371b181b-9637-4264-a9bb-1278f9701265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:53.038234 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1422/2867] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:28:53.042564 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e21b10-87a8-48e9-a498-a94e0b4f49ce None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:53.052077 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e21b10-87a8-48e9-a498-a94e0b4f49ce None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:53.056877 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff4f97-ebf8-4d47-81d7-1d23c421c228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:53.057556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff4f97-ebf8-4d47-81d7-1d23c421c228 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:53.057837 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff4f97-ebf8-4d47-81d7-1d23c421c228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:53.058113 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff4f97-ebf8-4d47-81d7-1d23c421c228 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:53.058830 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff4f97-ebf8-4d47-81d7-1d23c421c228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:28:53.059136 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff4f97-ebf8-4d47-81d7-1d23c421c228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:53.060727 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff4f97-ebf8-4d47-81d7-1d23c421c228 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:53.072584 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1446/2868] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:28:53.076791 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b181b-9637-4264-a9bb-1278f9701265 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:53.088075 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b181b-9637-4264-a9bb-1278f9701265 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:53.092748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5ec6a-5dd2-4a86-8542-f06862bc988b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:53.093888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5ec6a-5dd2-4a86-8542-f06862bc988b admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:53.094179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5ec6a-5dd2-4a86-8542-f06862bc988b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:53.094458 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5ec6a-5dd2-4a86-8542-f06862bc988b admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:53.095143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5ec6a-5dd2-4a86-8542-f06862bc988b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:53.097106 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5ec6a-5dd2-4a86-8542-f06862bc988b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:53.214552 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1423/2869] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:28:53 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:28:53.218863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff4f97-ebf8-4d47-81d7-1d23c421c228 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:53.228880 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff4f97-ebf8-4d47-81d7-1d23c421c228 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:53.287262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f347a4-1b2c-497b-935f-5cc92e55cbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:53.292486 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f347a4-1b2c-497b-935f-5cc92e55cbc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:53.292486 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f347a4-1b2c-497b-935f-5cc92e55cbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:53.292486 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f347a4-1b2c-497b-935f-5cc92e55cbc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:53.292486 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f347a4-1b2c-497b-935f-5cc92e55cbc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:53.292486 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f347a4-1b2c-497b-935f-5cc92e55cbc0 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:53.361700 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1447/2870] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:28:53 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:28:53.365846 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5ec6a-5dd2-4a86-8542-f06862bc988b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:53.376838 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5ec6a-5dd2-4a86-8542-f06862bc988b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:53.381505 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de5909-2b01-471b-abc3-4eab0b664bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:53.382166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de5909-2b01-471b-abc3-4eab0b664bcf admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:53.382458 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de5909-2b01-471b-abc3-4eab0b664bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:53.382735 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de5909-2b01-471b-abc3-4eab0b664bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:53.383467 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de5909-2b01-471b-abc3-4eab0b664bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:53.385136 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de5909-2b01-471b-abc3-4eab0b664bcf admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:53.395561 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1424/2871] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:28:53.399332 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f347a4-1b2c-497b-935f-5cc92e55cbc0 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:53.409105 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f347a4-1b2c-497b-935f-5cc92e55cbc0 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:53.413649 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2b9ff-0c37-4009-b36d-d1114ad473be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:53.414296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2b9ff-0c37-4009-b36d-d1114ad473be admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:53.414578 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2b9ff-0c37-4009-b36d-d1114ad473be admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:53.414853 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2b9ff-0c37-4009-b36d-d1114ad473be admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:53.415566 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2b9ff-0c37-4009-b36d-d1114ad473be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:53.417204 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2b9ff-0c37-4009-b36d-d1114ad473be admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:53.427606 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1448/2872] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:28:53.431914 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de5909-2b01-471b-abc3-4eab0b664bcf admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:53.442688 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de5909-2b01-471b-abc3-4eab0b664bcf admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:53.447246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbf1cc-5056-4c88-9ee6-11bc1a6dfb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:53.448117 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbf1cc-5056-4c88-9ee6-11bc1a6dfb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:53.448399 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbf1cc-5056-4c88-9ee6-11bc1a6dfb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:53.448671 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbf1cc-5056-4c88-9ee6-11bc1a6dfb1b admin admin] PATH_INFO: `/v3/projects/39ac0a6f91d44fe79d45a6deb73fb415/users/0dc1d2494b634bb6af2bc4ce9966dc4a/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:53.463659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbf1cc-5056-4c88-9ee6-11bc1a6dfb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ac0a6f91d44fe79d45a6deb73fb415, user_id=0dc1d2494b634bb6af2bc4ce9966dc4a, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:53.466463 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbf1cc-5056-4c88-9ee6-11bc1a6dfb1b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:53.555708 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1425/2873] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:28:53 2022] PUT /identity/v3/projects/39ac0a6f91d44fe79d45a6deb73fb415/users/0dc1d2494b634bb6af2bc4ce9966dc4a/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:28:53.567089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e20a78-0da4-4d94-8b29-9e55ef084aba None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:53.567518 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e20a78-0da4-4d94-8b29-9e55ef084aba None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:53.567903 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e20a78-0da4-4d94-8b29-9e55ef084aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:53.600308 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-f0e20a78-0da4-4d94-8b29-9e55ef084aba None None] MFA Rules not processed for user `0dc1d2494b634bb6af2bc4ce9966dc4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:28:53.601568 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-f0e20a78-0da4-4d94-8b29-9e55ef084aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:53.644224 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:28:53.666449 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1449/2874] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:28:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:28:53.677972 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbf1cc-5056-4c88-9ee6-11bc1a6dfb1b admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:53.686383 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-ffdbf1cc-5056-4c88-9ee6-11bc1a6dfb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:53.729430 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:28:53.741902 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbf1cc-5056-4c88-9ee6-11bc1a6dfb1b admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:53.745694 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e0b54-c7cc-42e5-ad75-cc70314f74b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:53.746432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e0b54-c7cc-42e5-ad75-cc70314f74b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:53.746724 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e0b54-c7cc-42e5-ad75-cc70314f74b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:53.747005 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e0b54-c7cc-42e5-ad75-cc70314f74b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:53.756515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e0b54-c7cc-42e5-ad75-cc70314f74b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:53.757981 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e0b54-c7cc-42e5-ad75-cc70314f74b9 service cinder] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:53.767806 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1426/2875] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:28:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:28:53.787612 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e20a78-0da4-4d94-8b29-9e55ef084aba None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:53.851574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e20a78-0da4-4d94-8b29-9e55ef084aba None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:53.856175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea42fd-c07e-4e8b-9364-b2306331a674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:53.857083 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea42fd-c07e-4e8b-9364-b2306331a674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:53.857387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea42fd-c07e-4e8b-9364-b2306331a674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:53.857887 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea42fd-c07e-4e8b-9364-b2306331a674 admin admin] PATH_INFO: `/v3/users/0dc1d2494b634bb6af2bc4ce9966dc4a` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:53.859359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea42fd-c07e-4e8b-9364-b2306331a674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc1d2494b634bb6af2bc4ce9966dc4a)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:53.862019 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea42fd-c07e-4e8b-9364-b2306331a674 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:54.105879 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e4ea42fd-c07e-4e8b-9364-b2306331a674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc1d2494b634bb6af2bc4ce9966dc4a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:54.184100 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e4ea42fd-c07e-4e8b-9364-b2306331a674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc1d2494b634bb6af2bc4ce9966dc4a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:54.192421 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e4ea42fd-c07e-4e8b-9364-b2306331a674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc1d2494b634bb6af2bc4ce9966dc4a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:54.193144 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e4ea42fd-c07e-4e8b-9364-b2306331a674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc1d2494b634bb6af2bc4ce9966dc4a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:54.205462 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e4ea42fd-c07e-4e8b-9364-b2306331a674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc1d2494b634bb6af2bc4ce9966dc4a'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:54.211756 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1450/2876] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:28:53 2022] DELETE /identity/v3/users/0dc1d2494b634bb6af2bc4ce9966dc4a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:28:54.216252 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d4590-8758-4281-81ee-e7e6cccd404a None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:54.216548 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d4590-8758-4281-81ee-e7e6cccd404a None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:54.216836 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d4590-8758-4281-81ee-e7e6cccd404a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:54.235078 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-2e4d4590-8758-4281-81ee-e7e6cccd404a None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:28:54.236285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2e4d4590-8758-4281-81ee-e7e6cccd404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:54.300685 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1427/2877] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:28:54.310511 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea42fd-c07e-4e8b-9364-b2306331a674 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:54.311898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e4ea42fd-c07e-4e8b-9364-b2306331a674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:54.370548 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea42fd-c07e-4e8b-9364-b2306331a674 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:54.374069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb596c1f-333b-432e-b5ad-5032a856b01e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:54.374722 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb596c1f-333b-432e-b5ad-5032a856b01e service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:54.375148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb596c1f-333b-432e-b5ad-5032a856b01e service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:54.375433 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb596c1f-333b-432e-b5ad-5032a856b01e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:54.384283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb596c1f-333b-432e-b5ad-5032a856b01e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:54.385749 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb596c1f-333b-432e-b5ad-5032a856b01e service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:54.395372 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1451/2878] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:28:54.779329 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d4590-8758-4281-81ee-e7e6cccd404a None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:54.781936 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-2e4d4590-8758-4281-81ee-e7e6cccd404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:54.793534 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d4590-8758-4281-81ee-e7e6cccd404a None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:54.798538 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f5058-0b02-4a11-b103-118d83ae0b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:54.799515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f5058-0b02-4a11-b103-118d83ae0b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:54.799807 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f5058-0b02-4a11-b103-118d83ae0b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:54.800118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f5058-0b02-4a11-b103-118d83ae0b0c admin admin] PATH_INFO: `/v3/projects/39ac0a6f91d44fe79d45a6deb73fb415` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:54.801356 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f5058-0b02-4a11-b103-118d83ae0b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ac0a6f91d44fe79d45a6deb73fb415)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:54.803416 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f5058-0b02-4a11-b103-118d83ae0b0c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:54.927432 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5a4f5058-0b02-4a11-b103-118d83ae0b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ac0a6f91d44fe79d45a6deb73fb415', 'request_id': 'req-5a4f5058-0b02-4a11-b103-118d83ae0b0c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:54.934074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5a4f5058-0b02-4a11-b103-118d83ae0b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ac0a6f91d44fe79d45a6deb73fb415', 'request_id': 'req-5a4f5058-0b02-4a11-b103-118d83ae0b0c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:55.006417 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5a4f5058-0b02-4a11-b103-118d83ae0b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ac0a6f91d44fe79d45a6deb73fb415', 'request_id': 'req-5a4f5058-0b02-4a11-b103-118d83ae0b0c'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:55.017647 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5a4f5058-0b02-4a11-b103-118d83ae0b0c admin admin] The token cache is being invalidate because project 39ac0a6f91d44fe79d45a6deb73fb415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:28:55.018186 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5a4f5058-0b02-4a11-b103-118d83ae0b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:55.018827 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-5a4f5058-0b02-4a11-b103-118d83ae0b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:28:55.020373 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1428/2879] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:28:54 2022] DELETE /identity/v3/projects/39ac0a6f91d44fe79d45a6deb73fb415 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:28:55.025391 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18070d-edde-4907-b683-b722a2710cec None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:55.025865 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18070d-edde-4907-b683-b722a2710cec None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:55.025951 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18070d-edde-4907-b683-b722a2710cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:55.033175 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:28:55.043908 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-3c18070d-edde-4907-b683-b722a2710cec None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:28:55.045147 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3c18070d-edde-4907-b683-b722a2710cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:55.105686 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1452/2880] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:28:55.113945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792402a4-6ca6-423b-8ac2-7551c827928b None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:55.114240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792402a4-6ca6-423b-8ac2-7551c827928b None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:55.114521 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792402a4-6ca6-423b-8ac2-7551c827928b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:55.133800 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-792402a4-6ca6-423b-8ac2-7551c827928b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:28:55.135046 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-792402a4-6ca6-423b-8ac2-7551c827928b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:55.143910 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1429/2881] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:28:55.148145 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18070d-edde-4907-b683-b722a2710cec None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:55.157980 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18070d-edde-4907-b683-b722a2710cec None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:55.162759 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df524b-85f7-4211-9d05-4c3c783cfcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:55.163414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df524b-85f7-4211-9d05-4c3c783cfcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:55.163698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df524b-85f7-4211-9d05-4c3c783cfcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:55.163982 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df524b-85f7-4211-9d05-4c3c783cfcc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:55.164703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df524b-85f7-4211-9d05-4c3c783cfcc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:28:55.165046 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df524b-85f7-4211-9d05-4c3c783cfcc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:55.166684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df524b-85f7-4211-9d05-4c3c783cfcc7 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:55.178673 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1453/2882] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:28:55.183015 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792402a4-6ca6-423b-8ac2-7551c827928b None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:55.192953 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792402a4-6ca6-423b-8ac2-7551c827928b None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:55.197653 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb738bdd-351f-4ef8-a803-652796f25923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:55.198302 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb738bdd-351f-4ef8-a803-652796f25923 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:55.198590 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb738bdd-351f-4ef8-a803-652796f25923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:55.198872 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb738bdd-351f-4ef8-a803-652796f25923 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:55.199571 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb738bdd-351f-4ef8-a803-652796f25923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:55.201515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb738bdd-351f-4ef8-a803-652796f25923 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:55.323343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1430/2883] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:28:55 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:28:55.327509 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df524b-85f7-4211-9d05-4c3c783cfcc7 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:55.338224 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df524b-85f7-4211-9d05-4c3c783cfcc7 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:55.394508 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999acf-1710-401d-a414-0f741ab5162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:55.395177 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999acf-1710-401d-a414-0f741ab5162c admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:55.395464 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999acf-1710-401d-a414-0f741ab5162c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:55.395746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999acf-1710-401d-a414-0f741ab5162c admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:55.396440 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab999acf-1710-401d-a414-0f741ab5162c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:55.398452 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab999acf-1710-401d-a414-0f741ab5162c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:55.498379 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1454/2884] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:28:55 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:28:55.503246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb738bdd-351f-4ef8-a803-652796f25923 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:55.513620 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb738bdd-351f-4ef8-a803-652796f25923 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:55.519048 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7c679-aad0-4770-8977-bf8d505a6dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:55.519803 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7c679-aad0-4770-8977-bf8d505a6dda admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:55.520096 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7c679-aad0-4770-8977-bf8d505a6dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:55.520379 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7c679-aad0-4770-8977-bf8d505a6dda admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:55.521154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7c679-aad0-4770-8977-bf8d505a6dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:55.522760 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7c679-aad0-4770-8977-bf8d505a6dda admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:55.534888 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1431/2885] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:28:55.538341 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999acf-1710-401d-a414-0f741ab5162c admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:55.548530 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999acf-1710-401d-a414-0f741ab5162c admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:55.553112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36ab76-e602-49f9-bbac-08d7a4d4ee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:55.553773 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36ab76-e602-49f9-bbac-08d7a4d4ee5c admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:55.554054 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36ab76-e602-49f9-bbac-08d7a4d4ee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:55.554327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36ab76-e602-49f9-bbac-08d7a4d4ee5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:55.555051 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36ab76-e602-49f9-bbac-08d7a4d4ee5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:55.556913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36ab76-e602-49f9-bbac-08d7a4d4ee5c admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:55.568340 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1455/2886] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:28:55.572407 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7c679-aad0-4770-8977-bf8d505a6dda admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:55.583192 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7c679-aad0-4770-8977-bf8d505a6dda admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:55.587923 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174d7d4-c62b-4524-bc6e-a6a42a8bdecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:55.588806 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174d7d4-c62b-4524-bc6e-a6a42a8bdecf admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:55.589123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174d7d4-c62b-4524-bc6e-a6a42a8bdecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:55.589408 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174d7d4-c62b-4524-bc6e-a6a42a8bdecf admin admin] PATH_INFO: `/v3/projects/281e30ad34284b39a62299a0e4848635/users/53a5f5a90a1c4cacb7e62ee2ac411f17/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:55.605777 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174d7d4-c62b-4524-bc6e-a6a42a8bdecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=281e30ad34284b39a62299a0e4848635, user_id=53a5f5a90a1c4cacb7e62ee2ac411f17, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:55.608453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174d7d4-c62b-4524-bc6e-a6a42a8bdecf admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:55.692327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1432/2887] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:28:55 2022] PUT /identity/v3/projects/281e30ad34284b39a62299a0e4848635/users/53a5f5a90a1c4cacb7e62ee2ac411f17/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:28:55.704132 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d1bb1-7d07-4b68-a770-10e08c08b51b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:55.704419 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d1bb1-7d07-4b68-a770-10e08c08b51b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:55.704701 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d1bb1-7d07-4b68-a770-10e08c08b51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:55.731516 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-022d1bb1-7d07-4b68-a770-10e08c08b51b None None] MFA Rules not processed for user `53a5f5a90a1c4cacb7e62ee2ac411f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:28:55.732669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-022d1bb1-7d07-4b68-a770-10e08c08b51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:55.793433 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:28:55.797059 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1456/2888] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:28:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:28:55.817189 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174d7d4-c62b-4524-bc6e-a6a42a8bdecf admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:55.821749 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-d174d7d4-c62b-4524-bc6e-a6a42a8bdecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:55.827820 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:28:55.916697 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174d7d4-c62b-4524-bc6e-a6a42a8bdecf admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:55.920431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa720090-5fe3-4644-882a-8337d75a874e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b34d05889f3c4d469f4661061457cb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:55.921160 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720090-5fe3-4644-882a-8337d75a874e service glance] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:55.922198 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720090-5fe3-4644-882a-8337d75a874e service glance] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:55.922366 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720090-5fe3-4644-882a-8337d75a874e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:55.931535 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa720090-5fe3-4644-882a-8337d75a874e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:55.933019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa720090-5fe3-4644-882a-8337d75a874e service glance] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:55.942555 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1433/2889] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:28:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 01 18:28:57.528768 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d1bb1-7d07-4b68-a770-10e08c08b51b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:28:57.530475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-022d1bb1-7d07-4b68-a770-10e08c08b51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:57.589218 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d1bb1-7d07-4b68-a770-10e08c08b51b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:28:57.592735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80cc83-3e25-4a18-b3b5-6fdb86de4f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:28:57.594069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80cc83-3e25-4a18-b3b5-6fdb86de4f91 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:28:57.594352 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80cc83-3e25-4a18-b3b5-6fdb86de4f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:28:57.594620 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80cc83-3e25-4a18-b3b5-6fdb86de4f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:28:57.596378 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0d80cc83-3e25-4a18-b3b5-6fdb86de4f91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:28:57.657840 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80cc83-3e25-4a18-b3b5-6fdb86de4f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:28:57.659283 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80cc83-3e25-4a18-b3b5-6fdb86de4f91 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:28:57.668296 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1457/2890] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:28:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:29:04.168143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa720090-5fe3-4644-882a-8337d75a874e service glance] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:04.177553 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa720090-5fe3-4644-882a-8337d75a874e service glance] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:04.181788 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8b87d-7225-49c3-a908-8108d0e62f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:04.182434 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8b87d-7225-49c3-a908-8108d0e62f8e service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:04.182723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8b87d-7225-49c3-a908-8108d0e62f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:04.183006 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8b87d-7225-49c3-a908-8108d0e62f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:04.184790 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-34a8b87d-7225-49c3-a908-8108d0e62f8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:04.252721 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8b87d-7225-49c3-a908-8108d0e62f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:04.254243 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8b87d-7225-49c3-a908-8108d0e62f8e service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:04.263824 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1434/2891] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:29:07.664193 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=48 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:29:07.871915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80cc83-3e25-4a18-b3b5-6fdb86de4f91 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:07.873414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-0d80cc83-3e25-4a18-b3b5-6fdb86de4f91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:07.952359 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80cc83-3e25-4a18-b3b5-6fdb86de4f91 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:07.957688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca591f72-46cc-40b2-b8e9-f0793aa9eea4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:07.958358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca591f72-46cc-40b2-b8e9-f0793aa9eea4 service placement] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:07.958640 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca591f72-46cc-40b2-b8e9-f0793aa9eea4 service placement] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:07.958916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca591f72-46cc-40b2-b8e9-f0793aa9eea4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:07.960688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ca591f72-46cc-40b2-b8e9-f0793aa9eea4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:07.972634 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca591f72-46cc-40b2-b8e9-f0793aa9eea4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:07.974401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca591f72-46cc-40b2-b8e9-f0793aa9eea4 service placement] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:07.984187 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1458/2892] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:29:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:29:11.739431 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8b87d-7225-49c3-a908-8108d0e62f8e service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:11.740956 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-34a8b87d-7225-49c3-a908-8108d0e62f8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:11.753470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8b87d-7225-49c3-a908-8108d0e62f8e service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:11.758271 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c329ed-3c0b-444b-abf2-5baffcf6f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:11.759179 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c329ed-3c0b-444b-abf2-5baffcf6f106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:11.759499 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c329ed-3c0b-444b-abf2-5baffcf6f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:11.759776 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c329ed-3c0b-444b-abf2-5baffcf6f106 admin admin] PATH_INFO: `/v3/users/1beeb2f4efbb462ebc8a00ac0693e797` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:11.760971 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c329ed-3c0b-444b-abf2-5baffcf6f106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1beeb2f4efbb462ebc8a00ac0693e797)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:11.762876 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c329ed-3c0b-444b-abf2-5baffcf6f106 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:11.949220 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-57c329ed-3c0b-444b-abf2-5baffcf6f106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1beeb2f4efbb462ebc8a00ac0693e797'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:12.018469 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-57c329ed-3c0b-444b-abf2-5baffcf6f106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1beeb2f4efbb462ebc8a00ac0693e797'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:12.025951 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-57c329ed-3c0b-444b-abf2-5baffcf6f106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1beeb2f4efbb462ebc8a00ac0693e797'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:12.026572 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-57c329ed-3c0b-444b-abf2-5baffcf6f106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1beeb2f4efbb462ebc8a00ac0693e797'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:12.038295 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:29:12.041122 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-57c329ed-3c0b-444b-abf2-5baffcf6f106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1beeb2f4efbb462ebc8a00ac0693e797'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:12.051081 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1435/2893] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:29:11 2022] DELETE /identity/v3/users/1beeb2f4efbb462ebc8a00ac0693e797 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:29:12.334784 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca591f72-46cc-40b2-b8e9-f0793aa9eea4 service placement] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:12.345898 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca591f72-46cc-40b2-b8e9-f0793aa9eea4 service placement] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:12.405734 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521ecf0-aaa2-4211-90ed-0b63641747ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:12.406600 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521ecf0-aaa2-4211-90ed-0b63641747ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:12.406885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521ecf0-aaa2-4211-90ed-0b63641747ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:12.407169 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521ecf0-aaa2-4211-90ed-0b63641747ca admin admin] PATH_INFO: `/v3/projects/5000174fef0c48f3bf9c775ed2a236c8` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:12.408348 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521ecf0-aaa2-4211-90ed-0b63641747ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5000174fef0c48f3bf9c775ed2a236c8)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:12.410278 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521ecf0-aaa2-4211-90ed-0b63641747ca admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:12.561940 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6521ecf0-aaa2-4211-90ed-0b63641747ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5000174fef0c48f3bf9c775ed2a236c8', 'request_id': 'req-6521ecf0-aaa2-4211-90ed-0b63641747ca'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:12.568798 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6521ecf0-aaa2-4211-90ed-0b63641747ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5000174fef0c48f3bf9c775ed2a236c8', 'request_id': 'req-6521ecf0-aaa2-4211-90ed-0b63641747ca'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:12.646752 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6521ecf0-aaa2-4211-90ed-0b63641747ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5000174fef0c48f3bf9c775ed2a236c8', 'request_id': 'req-6521ecf0-aaa2-4211-90ed-0b63641747ca'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:12.657961 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6521ecf0-aaa2-4211-90ed-0b63641747ca admin admin] The token cache is being invalidate because project 5000174fef0c48f3bf9c775ed2a236c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:29:12.664122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6521ecf0-aaa2-4211-90ed-0b63641747ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:12.664122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-6521ecf0-aaa2-4211-90ed-0b63641747ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:12.664122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1459/2894] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:29:12 2022] DELETE /identity/v3/projects/5000174fef0c48f3bf9c775ed2a236c8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:29:12.664539 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c329ed-3c0b-444b-abf2-5baffcf6f106 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:12.665963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-57c329ed-3c0b-444b-abf2-5baffcf6f106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:12.679759 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c329ed-3c0b-444b-abf2-5baffcf6f106 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:12.736463 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af9f5a-5f8d-4d05-8946-f3ae3974229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:12.737363 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af9f5a-5f8d-4d05-8946-f3ae3974229e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:12.737650 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af9f5a-5f8d-4d05-8946-f3ae3974229e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:12.737928 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af9f5a-5f8d-4d05-8946-f3ae3974229e admin admin] PATH_INFO: `/v3/users/ad44c61281224c5e9c1b666b52577bc3` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:12.739090 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af9f5a-5f8d-4d05-8946-f3ae3974229e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad44c61281224c5e9c1b666b52577bc3)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:12.741063 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af9f5a-5f8d-4d05-8946-f3ae3974229e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:12.940428 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-66af9f5a-5f8d-4d05-8946-f3ae3974229e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad44c61281224c5e9c1b666b52577bc3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:13.028909 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-66af9f5a-5f8d-4d05-8946-f3ae3974229e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad44c61281224c5e9c1b666b52577bc3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:13.037361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-66af9f5a-5f8d-4d05-8946-f3ae3974229e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad44c61281224c5e9c1b666b52577bc3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:13.038094 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-66af9f5a-5f8d-4d05-8946-f3ae3974229e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad44c61281224c5e9c1b666b52577bc3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:13.050900 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-66af9f5a-5f8d-4d05-8946-f3ae3974229e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad44c61281224c5e9c1b666b52577bc3'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:13.057154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1436/2895] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:29:12 2022] DELETE /identity/v3/users/ad44c61281224c5e9c1b666b52577bc3 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:29:13.283406 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521ecf0-aaa2-4211-90ed-0b63641747ca admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:13.284969 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6521ecf0-aaa2-4211-90ed-0b63641747ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:13.299688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521ecf0-aaa2-4211-90ed-0b63641747ca admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:13.317726 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:29:13.358821 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90854386-0d53-49c9-8d73-60428bfaf0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:13.359781 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854386-0d53-49c9-8d73-60428bfaf0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:13.360066 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854386-0d53-49c9-8d73-60428bfaf0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:13.360510 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854386-0d53-49c9-8d73-60428bfaf0b2 admin admin] PATH_INFO: `/v3/projects/8fcb5cc621b74a15a274797859cdc07c` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:13.361911 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90854386-0d53-49c9-8d73-60428bfaf0b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fcb5cc621b74a15a274797859cdc07c)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:13.363831 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90854386-0d53-49c9-8d73-60428bfaf0b2 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:13.509541 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-90854386-0d53-49c9-8d73-60428bfaf0b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fcb5cc621b74a15a274797859cdc07c', 'request_id': 'req-90854386-0d53-49c9-8d73-60428bfaf0b2'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:13.515619 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-90854386-0d53-49c9-8d73-60428bfaf0b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fcb5cc621b74a15a274797859cdc07c', 'request_id': 'req-90854386-0d53-49c9-8d73-60428bfaf0b2'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:13.589398 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-90854386-0d53-49c9-8d73-60428bfaf0b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fcb5cc621b74a15a274797859cdc07c', 'request_id': 'req-90854386-0d53-49c9-8d73-60428bfaf0b2'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:13.601564 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-90854386-0d53-49c9-8d73-60428bfaf0b2 admin admin] The token cache is being invalidate because project 8fcb5cc621b74a15a274797859cdc07c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:29:13.602041 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-90854386-0d53-49c9-8d73-60428bfaf0b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:13.602687 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-90854386-0d53-49c9-8d73-60428bfaf0b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:13.604231 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1460/2896] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:29:13 2022] DELETE /identity/v3/projects/8fcb5cc621b74a15a274797859cdc07c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:29:22.591074 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af9f5a-5f8d-4d05-8946-f3ae3974229e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:22.592528 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-66af9f5a-5f8d-4d05-8946-f3ae3974229e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:22.605259 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af9f5a-5f8d-4d05-8946-f3ae3974229e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:22.660911 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c795e8-2e66-4669-a07a-9f0b65cd2452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:22.661813 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c795e8-2e66-4669-a07a-9f0b65cd2452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:22.662108 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c795e8-2e66-4669-a07a-9f0b65cd2452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:22.662449 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c795e8-2e66-4669-a07a-9f0b65cd2452 admin admin] PATH_INFO: `/v3/users/53a5f5a90a1c4cacb7e62ee2ac411f17` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:22.663801 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c795e8-2e66-4669-a07a-9f0b65cd2452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a5f5a90a1c4cacb7e62ee2ac411f17)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:22.665761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c795e8-2e66-4669-a07a-9f0b65cd2452 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:22.678954 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:29:22.889241 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c1c795e8-2e66-4669-a07a-9f0b65cd2452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a5f5a90a1c4cacb7e62ee2ac411f17'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:22.977873 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c1c795e8-2e66-4669-a07a-9f0b65cd2452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a5f5a90a1c4cacb7e62ee2ac411f17'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:22.985359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c1c795e8-2e66-4669-a07a-9f0b65cd2452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a5f5a90a1c4cacb7e62ee2ac411f17'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:22.986004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c1c795e8-2e66-4669-a07a-9f0b65cd2452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a5f5a90a1c4cacb7e62ee2ac411f17'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:22.998729 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-c1c795e8-2e66-4669-a07a-9f0b65cd2452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a5f5a90a1c4cacb7e62ee2ac411f17'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:23.004737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1437/2897] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:29:22 2022] DELETE /identity/v3/users/53a5f5a90a1c4cacb7e62ee2ac411f17 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:29:23.010182 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9eb307-8170-4611-af60-b4ed4a68dc44 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:23.011199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9eb307-8170-4611-af60-b4ed4a68dc44 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:23.011199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9eb307-8170-4611-af60-b4ed4a68dc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:23.028680 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-4b9eb307-8170-4611-af60-b4ed4a68dc44 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:29:23.030097 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4b9eb307-8170-4611-af60-b4ed4a68dc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:23.089735 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1461/2898] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:29:23.099312 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c795e8-2e66-4669-a07a-9f0b65cd2452 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:23.100733 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c1c795e8-2e66-4669-a07a-9f0b65cd2452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:23.158051 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c795e8-2e66-4669-a07a-9f0b65cd2452 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:23.161599 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a31c3c-6932-41d1-935c-7af29eb39a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:23.162268 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a31c3c-6932-41d1-935c-7af29eb39a55 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:23.162559 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a31c3c-6932-41d1-935c-7af29eb39a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:23.162945 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a31c3c-6932-41d1-935c-7af29eb39a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:23.171920 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a31c3c-6932-41d1-935c-7af29eb39a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:23.173404 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a31c3c-6932-41d1-935c-7af29eb39a55 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:23.183506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1438/2899] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:29:23.591641 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9eb307-8170-4611-af60-b4ed4a68dc44 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:23.594564 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-4b9eb307-8170-4611-af60-b4ed4a68dc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:23.607152 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9eb307-8170-4611-af60-b4ed4a68dc44 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:23.613574 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75558286-578f-4454-b9d5-1290dee97929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:23.614454 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75558286-578f-4454-b9d5-1290dee97929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:23.614732 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75558286-578f-4454-b9d5-1290dee97929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:23.615003 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75558286-578f-4454-b9d5-1290dee97929 admin admin] PATH_INFO: `/v3/projects/281e30ad34284b39a62299a0e4848635` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:23.617601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75558286-578f-4454-b9d5-1290dee97929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=281e30ad34284b39a62299a0e4848635)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:23.623205 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75558286-578f-4454-b9d5-1290dee97929 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:23.776514 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:29:23.781910 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-75558286-578f-4454-b9d5-1290dee97929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '281e30ad34284b39a62299a0e4848635', 'request_id': 'req-75558286-578f-4454-b9d5-1290dee97929'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:23.785782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-75558286-578f-4454-b9d5-1290dee97929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '281e30ad34284b39a62299a0e4848635', 'request_id': 'req-75558286-578f-4454-b9d5-1290dee97929'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:23.857706 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-75558286-578f-4454-b9d5-1290dee97929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '281e30ad34284b39a62299a0e4848635', 'request_id': 'req-75558286-578f-4454-b9d5-1290dee97929'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:23.868995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-75558286-578f-4454-b9d5-1290dee97929 admin admin] The token cache is being invalidate because project 281e30ad34284b39a62299a0e4848635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:29:23.869510 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-75558286-578f-4454-b9d5-1290dee97929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:23.870598 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-75558286-578f-4454-b9d5-1290dee97929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:29:23.872262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1462/2900] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:29:23 2022] DELETE /identity/v3/projects/281e30ad34284b39a62299a0e4848635 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:29:23.877288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ce58f-4c9b-444c-8fc2-5fbb5c503233 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:23.877775 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ce58f-4c9b-444c-8fc2-5fbb5c503233 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:23.888791 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ce58f-4c9b-444c-8fc2-5fbb5c503233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:23.895868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c51ce58f-4c9b-444c-8fc2-5fbb5c503233 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:29:23.897237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c51ce58f-4c9b-444c-8fc2-5fbb5c503233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:23.960124 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1439/2901] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:29:23.967800 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e77ba-f3d4-43dd-8971-0da1272c14f8 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:23.968110 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e77ba-f3d4-43dd-8971-0da1272c14f8 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:23.968384 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e77ba-f3d4-43dd-8971-0da1272c14f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:23.987122 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-3e6e77ba-f3d4-43dd-8971-0da1272c14f8 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:29:23.988399 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-3e6e77ba-f3d4-43dd-8971-0da1272c14f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:23.997124 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1463/2902] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:29:24.001213 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ce58f-4c9b-444c-8fc2-5fbb5c503233 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:24.011828 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ce58f-4c9b-444c-8fc2-5fbb5c503233 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:24.016461 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b1e52-ee3a-4516-88c4-6065fb99501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:24.017147 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b1e52-ee3a-4516-88c4-6065fb99501c admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:24.017438 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b1e52-ee3a-4516-88c4-6065fb99501c admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:24.017720 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b1e52-ee3a-4516-88c4-6065fb99501c admin admin] PATH_INFO: `/v3/domains` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:24.018451 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b1e52-ee3a-4516-88c4-6065fb99501c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:29:24.018798 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b1e52-ee3a-4516-88c4-6065fb99501c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:24.020419 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b1e52-ee3a-4516-88c4-6065fb99501c admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:24.032116 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1440/2903] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:29:24.036117 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e77ba-f3d4-43dd-8971-0da1272c14f8 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:24.046016 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e77ba-f3d4-43dd-8971-0da1272c14f8 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:24.050676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f9405-b2db-458a-8036-203b22e0800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:24.051327 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f9405-b2db-458a-8036-203b22e0800a admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:24.051610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f9405-b2db-458a-8036-203b22e0800a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:24.051888 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f9405-b2db-458a-8036-203b22e0800a admin admin] PATH_INFO: `/v3/projects` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:24.052583 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f9405-b2db-458a-8036-203b22e0800a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:24.055401 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f9405-b2db-458a-8036-203b22e0800a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:24.150918 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1464/2904] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:29:24 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:29:24.155111 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b1e52-ee3a-4516-88c4-6065fb99501c admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:24.165700 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b1e52-ee3a-4516-88c4-6065fb99501c admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:24.185011 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:29:24.221081 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f4d50-6647-4fb0-9212-7d300c4af436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:24.226772 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4d50-6647-4fb0-9212-7d300c4af436 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:24.226772 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4d50-6647-4fb0-9212-7d300c4af436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:24.226772 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4d50-6647-4fb0-9212-7d300c4af436 admin admin] PATH_INFO: `/v3/users` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:24.226772 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f4d50-6647-4fb0-9212-7d300c4af436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:24.226772 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f4d50-6647-4fb0-9212-7d300c4af436 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:24.356112 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1441/2905] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:29:24 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:29:24.360659 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f9405-b2db-458a-8036-203b22e0800a admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:24.371852 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f9405-b2db-458a-8036-203b22e0800a admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:24.376335 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ada25-84fe-48c4-bb0f-359fc804fc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:24.377033 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ada25-84fe-48c4-bb0f-359fc804fc81 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:24.382071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ada25-84fe-48c4-bb0f-359fc804fc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:24.382071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ada25-84fe-48c4-bb0f-359fc804fc81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:24.382071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ada25-84fe-48c4-bb0f-359fc804fc81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:24.382071 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ada25-84fe-48c4-bb0f-359fc804fc81 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:24.390723 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1465/2906] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:29:24.394745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f4d50-6647-4fb0-9212-7d300c4af436 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:24.404907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f4d50-6647-4fb0-9212-7d300c4af436 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:24.409723 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeee5d-cbf1-4cd5-9579-066f2458d8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:24.410459 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeee5d-cbf1-4cd5-9579-066f2458d8de admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:24.410751 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeee5d-cbf1-4cd5-9579-066f2458d8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:24.411032 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeee5d-cbf1-4cd5-9579-066f2458d8de admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:24.411783 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caeee5d-cbf1-4cd5-9579-066f2458d8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:24.413951 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caeee5d-cbf1-4cd5-9579-066f2458d8de admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:24.425457 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1442/2907] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:29:24.430225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ada25-84fe-48c4-bb0f-359fc804fc81 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:24.440722 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ada25-84fe-48c4-bb0f-359fc804fc81 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:24.445262 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257b17c-c34c-40e9-9497-2115510b21ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:24.446129 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257b17c-c34c-40e9-9497-2115510b21ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:24.446408 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257b17c-c34c-40e9-9497-2115510b21ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:24.446684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257b17c-c34c-40e9-9497-2115510b21ca admin admin] PATH_INFO: `/v3/projects/6555a6b515af44e08fd282f747277531/users/e85e37541108470fa8a45c6892a68e0b/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:24.461889 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257b17c-c34c-40e9-9497-2115510b21ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6555a6b515af44e08fd282f747277531, user_id=e85e37541108470fa8a45c6892a68e0b, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:24.464552 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257b17c-c34c-40e9-9497-2115510b21ca admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:24.538946 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1466/2908] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:29:24 2022] PUT /identity/v3/projects/6555a6b515af44e08fd282f747277531/users/e85e37541108470fa8a45c6892a68e0b/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:29:24.544240 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b4be4-f19c-4ec8-9fec-dfbd8b059224 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:24.544565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b4be4-f19c-4ec8-9fec-dfbd8b059224 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:24.544879 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b4be4-f19c-4ec8-9fec-dfbd8b059224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:24.562604 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-a12b4be4-f19c-4ec8-9fec-dfbd8b059224 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:29:24.563808 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-a12b4be4-f19c-4ec8-9fec-dfbd8b059224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:24.622936 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1443/2909] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:29:24.632421 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257b17c-c34c-40e9-9497-2115510b21ca admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:24.634159 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7257b17c-c34c-40e9-9497-2115510b21ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:24.690284 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257b17c-c34c-40e9-9497-2115510b21ca admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:24.693968 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78e430-02c4-444d-a01e-84c19808eecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:24.694601 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78e430-02c4-444d-a01e-84c19808eecb service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:24.694883 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78e430-02c4-444d-a01e-84c19808eecb service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:24.695174 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78e430-02c4-444d-a01e-84c19808eecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:24.704109 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78e430-02c4-444d-a01e-84c19808eecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:24.705559 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78e430-02c4-444d-a01e-84c19808eecb service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:24.715399 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1467/2910] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:29:26.018411 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369b0db-4085-4260-b372-a82286b836ce None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:26.018905 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369b0db-4085-4260-b372-a82286b836ce None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:26.019028 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369b0db-4085-4260-b372-a82286b836ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:26.047103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-e369b0db-4085-4260-b372-a82286b836ce None None] MFA Rules not processed for user `e85e37541108470fa8a45c6892a68e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:29:26.048334 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-e369b0db-4085-4260-b372-a82286b836ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:26.119768 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1444/2911] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:29:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:29:26.130392 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78e430-02c4-444d-a01e-84c19808eecb service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:26.132402 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-6e78e430-02c4-444d-a01e-84c19808eecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:26.188446 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78e430-02c4-444d-a01e-84c19808eecb service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:26.191993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5311b4-6240-46f2-a178-1fc57455d630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d9e5912b8c4f36922cde62830fb7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:26.192637 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5311b4-6240-46f2-a178-1fc57455d630 service cinder] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:26.192916 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5311b4-6240-46f2-a178-1fc57455d630 service cinder] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:26.193221 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5311b4-6240-46f2-a178-1fc57455d630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:26.201944 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5311b4-6240-46f2-a178-1fc57455d630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:26.203358 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5311b4-6240-46f2-a178-1fc57455d630 service cinder] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:26.212081 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1468/2912] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:29:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:29:28.984245 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e485972-8022-4e6e-8497-020c6e9077fc None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:28.984775 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e485972-8022-4e6e-8497-020c6e9077fc None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:28.984874 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e485972-8022-4e6e-8497-020c6e9077fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:29.002365 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7e485972-8022-4e6e-8497-020c6e9077fc None None] MFA Rules not processed for user `e85e37541108470fa8a45c6892a68e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:29:29.003556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7e485972-8022-4e6e-8497-020c6e9077fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:29.011250 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1445/2913] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:29:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:29:36.208034 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:DELETE=4,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:29:38.997323 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:29:45.159007 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5311b4-6240-46f2-a178-1fc57455d630 service cinder] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:45.161056 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-be5311b4-6240-46f2-a178-1fc57455d630 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:45.268450 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5311b4-6240-46f2-a178-1fc57455d630 service cinder] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:45.274008 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad655f-5997-4673-870e-a2cb52c86000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:45.274660 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad655f-5997-4673-870e-a2cb52c86000 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:45.275049 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad655f-5997-4673-870e-a2cb52c86000 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:45.275207 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad655f-5997-4673-870e-a2cb52c86000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:45.277264 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e7ad655f-5997-4673-870e-a2cb52c86000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:45.289851 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad655f-5997-4673-870e-a2cb52c86000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:45.292241 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad655f-5997-4673-870e-a2cb52c86000 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:45.303232 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1469/2914] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:29:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:29:46.861666 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e485972-8022-4e6e-8497-020c6e9077fc None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:46.863046 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7e485972-8022-4e6e-8497-020c6e9077fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:46.879774 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e485972-8022-4e6e-8497-020c6e9077fc None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:46.883436 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e57e7b-8a13-455f-92ae-b9fc3967cea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:46.884118 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e57e7b-8a13-455f-92ae-b9fc3967cea1 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:46.884405 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e57e7b-8a13-455f-92ae-b9fc3967cea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:46.884689 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e57e7b-8a13-455f-92ae-b9fc3967cea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:46.887153 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-98e57e7b-8a13-455f-92ae-b9fc3967cea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:46.901400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e57e7b-8a13-455f-92ae-b9fc3967cea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:46.903406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e57e7b-8a13-455f-92ae-b9fc3967cea1 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:46.914991 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1446/2915] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:29:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:29:52.234225 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad655f-5997-4673-870e-a2cb52c86000 service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:29:52.235709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e7ad655f-5997-4673-870e-a2cb52c86000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:52.312687 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad655f-5997-4673-870e-a2cb52c86000 service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:29:52.318018 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b066023-1963-4e9d-a559-ab75d75f59cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:29:52.318676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b066023-1963-4e9d-a559-ab75d75f59cc service placement] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:52.318958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b066023-1963-4e9d-a559-ab75d75f59cc service placement] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:52.319233 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b066023-1963-4e9d-a559-ab75d75f59cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:52.321026 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-5b066023-1963-4e9d-a559-ab75d75f59cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:52.332743 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b066023-1963-4e9d-a559-ab75d75f59cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:29:52.334334 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b066023-1963-4e9d-a559-ab75d75f59cc service placement] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:29:52.344913 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1470/2916] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:29:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:29:52.908505 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778769b2-93ac-4986-98ee-3c5a099e877f None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:29:52.909044 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778769b2-93ac-4986-98ee-3c5a099e877f None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:29:52.909143 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778769b2-93ac-4986-98ee-3c5a099e877f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:29:52.927335 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-778769b2-93ac-4986-98ee-3c5a099e877f None None] MFA Rules not processed for user `e85e37541108470fa8a45c6892a68e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:29:52.928517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-778769b2-93ac-4986-98ee-3c5a099e877f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:29:52.935480 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1447/2917] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:29:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:30:02.340044 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=85 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:30:02.921212 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=11 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:30:20.731958 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327e600-0689-4a98-9d06-0b703b09737a None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:20.732456 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327e600-0689-4a98-9d06-0b703b09737a None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:20.732551 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327e600-0689-4a98-9d06-0b703b09737a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:20.780202 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-8327e600-0689-4a98-9d06-0b703b09737a None None] MFA Rules not processed for user `253f9ffb48dd4eaab87aae5316fb5394`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:30:20.781926 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8327e600-0689-4a98-9d06-0b703b09737a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:30:20.848223 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1471/2918] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jun 1 18:30:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:30:20.960237 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778769b2-93ac-4986-98ee-3c5a099e877f None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:20.961688 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-778769b2-93ac-4986-98ee-3c5a099e877f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:30:21.050745 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778769b2-93ac-4986-98ee-3c5a099e877f None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:21.055763 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51ceb0-b1c9-4a58-9765-baf98d774adc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f43a4bb5a18445b8836f4613cd5e14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:21.056669 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51ceb0-b1c9-4a58-9765-baf98d774adc service swift] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:21.056978 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51ceb0-b1c9-4a58-9765-baf98d774adc service swift] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:21.057264 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51ceb0-b1c9-4a58-9765-baf98d774adc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:21.065327 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51ceb0-b1c9-4a58-9765-baf98d774adc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:21.066937 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51ceb0-b1c9-4a58-9765-baf98d774adc service swift] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:21.075355 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1448/2919] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jun 1 18:30:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 18:30:30.845148 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=40 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:30:31.072014 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=41 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:30:37.341258 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae984207-d28a-4c06-a0dd-1de148c73a51 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:37.341736 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae984207-d28a-4c06-a0dd-1de148c73a51 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:37.341833 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae984207-d28a-4c06-a0dd-1de148c73a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:37.360465 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-ae984207-d28a-4c06-a0dd-1de148c73a51 None None] MFA Rules not processed for user `253f9ffb48dd4eaab87aae5316fb5394`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:30:37.361721 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-ae984207-d28a-4c06-a0dd-1de148c73a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:30:37.368684 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1472/2920] 10.222.0.33 () {58 vars in 967 bytes} [Wed Jun 1 18:30:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:30:37.381230 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51ceb0-b1c9-4a58-9765-baf98d774adc service swift] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:37.391748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51ceb0-b1c9-4a58-9765-baf98d774adc service swift] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:37.396851 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4646a7-6c4d-4ef8-8092-ba4d1c149269 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f43a4bb5a18445b8836f4613cd5e14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:37.397589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4646a7-6c4d-4ef8-8092-ba4d1c149269 service swift] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:37.397878 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4646a7-6c4d-4ef8-8092-ba4d1c149269 service swift] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:37.398159 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4646a7-6c4d-4ef8-8092-ba4d1c149269 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:37.406339 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4646a7-6c4d-4ef8-8092-ba4d1c149269 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:37.407907 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4646a7-6c4d-4ef8-8092-ba4d1c149269 service swift] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:37.415881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1449/2921] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jun 1 18:30:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 18:30:40.356000 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae984207-d28a-4c06-a0dd-1de148c73a51 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:40.368224 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae984207-d28a-4c06-a0dd-1de148c73a51 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:40.372957 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd39c7e-f467-4ea1-a583-c686f36558e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:40.373828 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39c7e-f467-4ea1-a583-c686f36558e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:40.374131 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39c7e-f467-4ea1-a583-c686f36558e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:40.374407 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39c7e-f467-4ea1-a583-c686f36558e0 admin admin] PATH_INFO: `/v3/users/e85e37541108470fa8a45c6892a68e0b` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:40.375657 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd39c7e-f467-4ea1-a583-c686f36558e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e85e37541108470fa8a45c6892a68e0b)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:40.377646 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd39c7e-f467-4ea1-a583-c686f36558e0 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:40.523151 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-afd39c7e-f467-4ea1-a583-c686f36558e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85e37541108470fa8a45c6892a68e0b'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:30:40.560274 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-afd39c7e-f467-4ea1-a583-c686f36558e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85e37541108470fa8a45c6892a68e0b'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:30:40.567556 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-afd39c7e-f467-4ea1-a583-c686f36558e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85e37541108470fa8a45c6892a68e0b'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:30:40.568198 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-afd39c7e-f467-4ea1-a583-c686f36558e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85e37541108470fa8a45c6892a68e0b'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:30:40.580618 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-afd39c7e-f467-4ea1-a583-c686f36558e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85e37541108470fa8a45c6892a68e0b'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:30:40.586757 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1473/2922] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:30:40 2022] DELETE /identity/v3/users/e85e37541108470fa8a45c6892a68e0b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:30:40.831770 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4646a7-6c4d-4ef8-8092-ba4d1c149269 service swift] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:40.846667 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4646a7-6c4d-4ef8-8092-ba4d1c149269 service swift] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:40.908258 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04827b6c-85fa-45d4-b499-c031fcb0f24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:40.909158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04827b6c-85fa-45d4-b499-c031fcb0f24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:40.909447 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04827b6c-85fa-45d4-b499-c031fcb0f24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:40.909727 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04827b6c-85fa-45d4-b499-c031fcb0f24b admin admin] PATH_INFO: `/v3/projects/6555a6b515af44e08fd282f747277531` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:40.910922 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04827b6c-85fa-45d4-b499-c031fcb0f24b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6555a6b515af44e08fd282f747277531)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:40.912847 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04827b6c-85fa-45d4-b499-c031fcb0f24b admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:41.000174 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-04827b6c-85fa-45d4-b499-c031fcb0f24b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6555a6b515af44e08fd282f747277531', 'request_id': 'req-04827b6c-85fa-45d4-b499-c031fcb0f24b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:30:41.006285 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-04827b6c-85fa-45d4-b499-c031fcb0f24b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6555a6b515af44e08fd282f747277531', 'request_id': 'req-04827b6c-85fa-45d4-b499-c031fcb0f24b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:30:41.045568 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-04827b6c-85fa-45d4-b499-c031fcb0f24b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6555a6b515af44e08fd282f747277531', 'request_id': 'req-04827b6c-85fa-45d4-b499-c031fcb0f24b'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:30:41.056885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-04827b6c-85fa-45d4-b499-c031fcb0f24b admin admin] The token cache is being invalidate because project 6555a6b515af44e08fd282f747277531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:30:41.057206 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-04827b6c-85fa-45d4-b499-c031fcb0f24b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:30:41.057885 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-04827b6c-85fa-45d4-b499-c031fcb0f24b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:30:41.059517 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1450/2923] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:30:40 2022] DELETE /identity/v3/projects/6555a6b515af44e08fd282f747277531 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:30:41.070727 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9b73f-c209-4d24-b6fc-a2ec162e6f8b None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:41.071020 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9b73f-c209-4d24-b6fc-a2ec162e6f8b None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:41.071306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9b73f-c209-4d24-b6fc-a2ec162e6f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:41.088834 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-8ed9b73f-c209-4d24-b6fc-a2ec162e6f8b None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:30:41.090002 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-8ed9b73f-c209-4d24-b6fc-a2ec162e6f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:30:41.150669 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1474/2924] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:30:41.158939 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c21d6-87f6-4d67-8d37-71a5ef256f28 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:41.163605 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c21d6-87f6-4d67-8d37-71a5ef256f28 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:41.163605 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c21d6-87f6-4d67-8d37-71a5ef256f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:41.178182 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-953c21d6-87f6-4d67-8d37-71a5ef256f28 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:30:41.179374 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-953c21d6-87f6-4d67-8d37-71a5ef256f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:30:41.188067 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1451/2925] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:30:41.192374 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9b73f-c209-4d24-b6fc-a2ec162e6f8b None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:41.202031 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9b73f-c209-4d24-b6fc-a2ec162e6f8b None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:41.208538 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deeb72b-354d-4eae-a1eb-04c425856694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:41.209241 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deeb72b-354d-4eae-a1eb-04c425856694 admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:41.209664 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deeb72b-354d-4eae-a1eb-04c425856694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:41.209942 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deeb72b-354d-4eae-a1eb-04c425856694 admin admin] PATH_INFO: `/v3/domains` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:41.210691 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deeb72b-354d-4eae-a1eb-04c425856694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 01 18:30:41.210995 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deeb72b-354d-4eae-a1eb-04c425856694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:41.212588 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deeb72b-354d-4eae-a1eb-04c425856694 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:41.224466 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1475/2926] 10.222.0.33 () {58 vars in 1152 bytes} [Wed Jun 1 18:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 01 18:30:41.229772 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c21d6-87f6-4d67-8d37-71a5ef256f28 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:41.239659 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c21d6-87f6-4d67-8d37-71a5ef256f28 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:41.244291 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf95aa-5eb7-4a6e-992d-f67d041165cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:41.245012 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf95aa-5eb7-4a6e-992d-f67d041165cb admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:41.245301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf95aa-5eb7-4a6e-992d-f67d041165cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:41.245577 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf95aa-5eb7-4a6e-992d-f67d041165cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:41.246258 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf95aa-5eb7-4a6e-992d-f67d041165cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:41.248145 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf95aa-5eb7-4a6e-992d-f67d041165cb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:41.321903 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1452/2927] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:30:41 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:30:41.326058 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deeb72b-354d-4eae-a1eb-04c425856694 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:41.336750 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deeb72b-354d-4eae-a1eb-04c425856694 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:41.383475 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:30:41.392015 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6085254-4053-4c75-93fd-61a55fdeb41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:41.392689 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6085254-4053-4c75-93fd-61a55fdeb41f admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:41.393027 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6085254-4053-4c75-93fd-61a55fdeb41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:41.393303 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6085254-4053-4c75-93fd-61a55fdeb41f admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:41.394049 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6085254-4053-4c75-93fd-61a55fdeb41f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:41.395936 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6085254-4053-4c75-93fd-61a55fdeb41f admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:41.451581 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1476/2928] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:30:41 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:30:41.455879 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf95aa-5eb7-4a6e-992d-f67d041165cb admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:41.466406 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf95aa-5eb7-4a6e-992d-f67d041165cb admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:41.471844 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e83aa3-432a-4462-8b09-d7304982bc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:41.472515 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e83aa3-432a-4462-8b09-d7304982bc5e admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:41.472881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e83aa3-432a-4462-8b09-d7304982bc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:41.473209 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e83aa3-432a-4462-8b09-d7304982bc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:41.473944 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e83aa3-432a-4462-8b09-d7304982bc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:41.475563 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e83aa3-432a-4462-8b09-d7304982bc5e admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:41.487400 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1453/2929] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:30:41.491383 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6085254-4053-4c75-93fd-61a55fdeb41f admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:41.501387 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6085254-4053-4c75-93fd-61a55fdeb41f admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:41.506024 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6ad9e-f5af-4b1e-a5ea-627bcc934aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:41.506694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6ad9e-f5af-4b1e-a5ea-627bcc934aff admin admin] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:41.506976 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6ad9e-f5af-4b1e-a5ea-627bcc934aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:41.507277 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6ad9e-f5af-4b1e-a5ea-627bcc934aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:41.508043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6ad9e-f5af-4b1e-a5ea-627bcc934aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:41.509701 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6ad9e-f5af-4b1e-a5ea-627bcc934aff admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:41.519824 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1477/2930] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:30:41.523737 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e83aa3-432a-4462-8b09-d7304982bc5e admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:41.534154 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e83aa3-432a-4462-8b09-d7304982bc5e admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:41.539126 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c4dc0-fb62-4406-b0ab-22d7c1c41dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:41.540004 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c4dc0-fb62-4406-b0ab-22d7c1c41dce admin admin] REQUEST_METHOD: `PUT` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:41.540289 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c4dc0-fb62-4406-b0ab-22d7c1c41dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:41.540565 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c4dc0-fb62-4406-b0ab-22d7c1c41dce admin admin] PATH_INFO: `/v3/projects/ccc839bf98c1422ba0d56f7359cab30d/users/e037de8735324dc7b54282413474f7af/roles/e8531ae972c749c0a8ea8a73601c5cd1` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:41.556171 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c4dc0-fb62-4406-b0ab-22d7c1c41dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc839bf98c1422ba0d56f7359cab30d, user_id=e037de8735324dc7b54282413474f7af, role_id=e8531ae972c749c0a8ea8a73601c5cd1)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:41.559132 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c4dc0-fb62-4406-b0ab-22d7c1c41dce admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:41.641064 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1454/2931] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:30:41 2022] PUT /identity/v3/projects/ccc839bf98c1422ba0d56f7359cab30d/users/e037de8735324dc7b54282413474f7af/roles/e8531ae972c749c0a8ea8a73601c5cd1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:30:41.645963 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af985a5d-6210-4011-ab8e-7d82dc6e2e91 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:41.646257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af985a5d-6210-4011-ab8e-7d82dc6e2e91 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:41.646563 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af985a5d-6210-4011-ab8e-7d82dc6e2e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:41.664489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-af985a5d-6210-4011-ab8e-7d82dc6e2e91 None None] MFA Rules not processed for user `e7e43dc5addf4a3b9b9bacb5e1aa59a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:30:41.665709 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-af985a5d-6210-4011-ab8e-7d82dc6e2e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:30:41.723572 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1478/2932] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:30:41.733111 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c4dc0-fb62-4406-b0ab-22d7c1c41dce admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:41.735998 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-816c4dc0-fb62-4406-b0ab-22d7c1c41dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:30:41.757113 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:30:41.801287 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c4dc0-fb62-4406-b0ab-22d7c1c41dce admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:41.804992 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f60f26-3cef-4322-b0a1-344b5d3aea17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:41.805849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f60f26-3cef-4322-b0a1-344b5d3aea17 service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:41.806645 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f60f26-3cef-4322-b0a1-344b5d3aea17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:41.806984 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f60f26-3cef-4322-b0a1-344b5d3aea17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:41.817123 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f60f26-3cef-4322-b0a1-344b5d3aea17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:41.818556 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f60f26-3cef-4322-b0a1-344b5d3aea17 service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:41.828890 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1455/2933] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:30:47.145316 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8d91f-a218-454f-973f-c5f5dc6e57e8 None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:47.145819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8d91f-a218-454f-973f-c5f5dc6e57e8 None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:47.146089 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8d91f-a218-454f-973f-c5f5dc6e57e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:47.174382 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b8e8d91f-a218-454f-973f-c5f5dc6e57e8 None None] MFA Rules not processed for user `e037de8735324dc7b54282413474f7af`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:30:47.175607 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b8e8d91f-a218-454f-973f-c5f5dc6e57e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:30:47.243782 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1479/2934] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:30:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:30:47.248564 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f60f26-3cef-4322-b0a1-344b5d3aea17 service neutron] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:47.258878 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f60f26-3cef-4322-b0a1-344b5d3aea17 service neutron] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:47.263686 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24d010-1273-479a-85d0-db1fedabd345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:47.264294 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24d010-1273-479a-85d0-db1fedabd345 admin admin] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:47.264584 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24d010-1273-479a-85d0-db1fedabd345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:47.264868 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24d010-1273-479a-85d0-db1fedabd345 admin admin] PATH_INFO: `/v3/projects` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:47.266486 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24d010-1273-479a-85d0-db1fedabd345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:47.268470 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24d010-1273-479a-85d0-db1fedabd345 admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:47.368430 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1456/2935] 10.222.0.33 () {60 vars in 1152 bytes} [Wed Jun 1 18:30:47 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:30:47.372489 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8d91f-a218-454f-973f-c5f5dc6e57e8 None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:47.384257 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8d91f-a218-454f-973f-c5f5dc6e57e8 None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:47.445227 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f539a33-608f-4220-bba6-95dca023fe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:47.446043 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f539a33-608f-4220-bba6-95dca023fe9d admin admin] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:47.446333 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f539a33-608f-4220-bba6-95dca023fe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:47.446611 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f539a33-608f-4220-bba6-95dca023fe9d admin admin] PATH_INFO: `/v3/users` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:47.447306 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f539a33-608f-4220-bba6-95dca023fe9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:47.449259 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f539a33-608f-4220-bba6-95dca023fe9d admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:47.461573 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:30:47.554888 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1480/2936] 10.222.0.33 () {60 vars in 1143 bytes} [Wed Jun 1 18:30:47 2022] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 01 18:30:47.559162 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24d010-1273-479a-85d0-db1fedabd345 admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:47.569691 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24d010-1273-479a-85d0-db1fedabd345 admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:47.574336 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c393510-0670-4da4-b983-5702f87e05ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:47.574999 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c393510-0670-4da4-b983-5702f87e05ca admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:47.575288 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c393510-0670-4da4-b983-5702f87e05ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:47.575578 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c393510-0670-4da4-b983-5702f87e05ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:47.576329 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c393510-0670-4da4-b983-5702f87e05ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:47.578238 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c393510-0670-4da4-b983-5702f87e05ca admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:47.588825 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1457/2937] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:30:47.592930 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f539a33-608f-4220-bba6-95dca023fe9d admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:47.606694 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f539a33-608f-4220-bba6-95dca023fe9d admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:47.618461 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c273b47-de0e-46f2-a0e1-f2468fe7114a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:47.619403 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c273b47-de0e-46f2-a0e1-f2468fe7114a admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:47.619691 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c273b47-de0e-46f2-a0e1-f2468fe7114a admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:47.619975 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c273b47-de0e-46f2-a0e1-f2468fe7114a admin admin] PATH_INFO: `/v3/projects/21f4b7856dde4dd8938a1cb7f9cc627c/users/43d1b94c017d4a83a28a569d7154fc79/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:47.636118 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c273b47-de0e-46f2-a0e1-f2468fe7114a admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f4b7856dde4dd8938a1cb7f9cc627c, user_id=43d1b94c017d4a83a28a569d7154fc79, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:47.638885 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c273b47-de0e-46f2-a0e1-f2468fe7114a admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:47.738138 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1481/2938] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:30:47 2022] PUT /identity/v3/projects/21f4b7856dde4dd8938a1cb7f9cc627c/users/43d1b94c017d4a83a28a569d7154fc79/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:30:47.742095 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c393510-0670-4da4-b983-5702f87e05ca admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:47.753038 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c393510-0670-4da4-b983-5702f87e05ca admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:47.811115 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11011805-4b83-48e3-a347-70c296dd95de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:47.811732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11011805-4b83-48e3-a347-70c296dd95de admin admin] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:47.812849 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11011805-4b83-48e3-a347-70c296dd95de admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:47.813221 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11011805-4b83-48e3-a347-70c296dd95de admin admin] PATH_INFO: `/v3/roles` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:47.813961 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11011805-4b83-48e3-a347-70c296dd95de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:47.815683 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11011805-4b83-48e3-a347-70c296dd95de admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:47.825574 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1458/2939] 10.222.0.33 () {58 vars in 1121 bytes} [Wed Jun 1 18:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 01 18:30:47.830676 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c273b47-de0e-46f2-a0e1-f2468fe7114a admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:47.844863 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c273b47-de0e-46f2-a0e1-f2468fe7114a admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:47.850153 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713cf0c-1ba8-44ea-a9ec-d5e7dc7f396f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:47.851915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713cf0c-1ba8-44ea-a9ec-d5e7dc7f396f admin admin] REQUEST_METHOD: `PUT` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:47.851915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713cf0c-1ba8-44ea-a9ec-d5e7dc7f396f admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:47.851915 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713cf0c-1ba8-44ea-a9ec-d5e7dc7f396f admin admin] PATH_INFO: `/v3/projects/21f4b7856dde4dd8938a1cb7f9cc627c/users/43d1b94c017d4a83a28a569d7154fc79/roles/7b6b405f7b6f4090a7c5ea400474f8c5` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:47.853715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713cf0c-1ba8-44ea-a9ec-d5e7dc7f396f admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f4b7856dde4dd8938a1cb7f9cc627c, user_id=43d1b94c017d4a83a28a569d7154fc79, role_id=7b6b405f7b6f4090a7c5ea400474f8c5)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:47.856492 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713cf0c-1ba8-44ea-a9ec-d5e7dc7f396f admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:47.869112 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1482/2940] 10.222.0.33 () {60 vars in 1482 bytes} [Wed Jun 1 18:30:47 2022] PUT /identity/v3/projects/21f4b7856dde4dd8938a1cb7f9cc627c/users/43d1b94c017d4a83a28a569d7154fc79/roles/7b6b405f7b6f4090a7c5ea400474f8c5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 01 18:30:53.559496 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f82be-a0f0-43f0-8ff7-8601abcc9451 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:53.560098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f82be-a0f0-43f0-8ff7-8601abcc9451 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:53.560098 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f82be-a0f0-43f0-8ff7-8601abcc9451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:53.590549 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-c67f82be-a0f0-43f0-8ff7-8601abcc9451 None None] MFA Rules not processed for user `43d1b94c017d4a83a28a569d7154fc79`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:30:53.591748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-c67f82be-a0f0-43f0-8ff7-8601abcc9451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:30:53.683993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1459/2941] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:30:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:30:53.699595 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713cf0c-1ba8-44ea-a9ec-d5e7dc7f396f admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:53.703069 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7713cf0c-1ba8-44ea-a9ec-d5e7dc7f396f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:30:53.768336 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713cf0c-1ba8-44ea-a9ec-d5e7dc7f396f admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:53.772144 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2c5f4-c1db-447d-850d-e5a90964bd9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b34d05889f3c4d469f4661061457cb95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:53.772917 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2c5f4-c1db-447d-850d-e5a90964bd9a service glance] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:53.773235 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2c5f4-c1db-447d-850d-e5a90964bd9a service glance] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:53.773513 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2c5f4-c1db-447d-850d-e5a90964bd9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:53.836546 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2c5f4-c1db-447d-850d-e5a90964bd9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:53.838079 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2c5f4-c1db-447d-850d-e5a90964bd9a service glance] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:53.848579 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1483/2942] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:30:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:30:54.152973 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21bc6c-1e95-476f-86b8-07841667e266 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:54.154630 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21bc6c-1e95-476f-86b8-07841667e266 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:54.158621 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21bc6c-1e95-476f-86b8-07841667e266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:54.166638 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:30:54.177286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-0a21bc6c-1e95-476f-86b8-07841667e266 None None] MFA Rules not processed for user `253f9ffb48dd4eaab87aae5316fb5394`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:30:54.181731 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0a21bc6c-1e95-476f-86b8-07841667e266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:30:54.239479 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1460/2943] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jun 1 18:30:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:30:54.251790 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2c5f4-c1db-447d-850d-e5a90964bd9a service glance] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:30:54.253317 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-99a2c5f4-c1db-447d-850d-e5a90964bd9a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:30:54.323881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2c5f4-c1db-447d-850d-e5a90964bd9a service glance] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:30:54.330347 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b95ee4-c48b-4408-ac1b-d83587539453 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f43a4bb5a18445b8836f4613cd5e14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:30:54.332688 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b95ee4-c48b-4408-ac1b-d83587539453 service swift] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:30:54.333029 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b95ee4-c48b-4408-ac1b-d83587539453 service swift] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:30:54.333312 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b95ee4-c48b-4408-ac1b-d83587539453 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:30:54.343993 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b95ee4-c48b-4408-ac1b-d83587539453 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:30:54.345596 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b95ee4-c48b-4408-ac1b-d83587539453 service swift] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:30:54.349199 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:30:54.354408 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1484/2944] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jun 1 18:30:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 18:31:04.071453 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d453269-c2b0-44c6-a9e9-9101d61ff566 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:31:04.072021 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d453269-c2b0-44c6-a9e9-9101d61ff566 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:31:04.072134 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d453269-c2b0-44c6-a9e9-9101d61ff566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:31:04.089547 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-7d453269-c2b0-44c6-a9e9-9101d61ff566 None None] MFA Rules not processed for user `e037de8735324dc7b54282413474f7af`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:31:04.090748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-7d453269-c2b0-44c6-a9e9-9101d61ff566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:31:04.098519 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1461/2945] 10.222.0.33 () {58 vars in 957 bytes} [Wed Jun 1 18:31:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 01 18:31:04.428385 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:31:07.459033 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffeb09-a9ba-4aab-8439-1447a637bd6a None None] REQUEST_METHOD: `POST` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:31:07.459610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffeb09-a9ba-4aab-8439-1447a637bd6a None None] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:31:07.459610 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffeb09-a9ba-4aab-8439-1447a637bd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:31:07.480621 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.auth.core [None req-b9ffeb09-a9ba-4aab-8439-1447a637bd6a None None] MFA Rules not processed for user `253f9ffb48dd4eaab87aae5316fb5394`. Rule list: `[]` (Enabled: `True`). {{(pid=80426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:31:07.481912 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-b9ffeb09-a9ba-4aab-8439-1447a637bd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:31:07.489679 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1485/2946] 10.222.0.33 () {58 vars in 1009 bytes} [Wed Jun 1 18:31:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:31:07.502108 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d453269-c2b0-44c6-a9e9-9101d61ff566 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:31:07.513963 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d453269-c2b0-44c6-a9e9-9101d61ff566 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:31:07.519506 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7d7e2-4a0b-468f-8cd1-f4bc28467ed9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f43a4bb5a18445b8836f4613cd5e14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:31:07.520166 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7d7e2-4a0b-468f-8cd1-f4bc28467ed9 service swift] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:31:07.520452 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7d7e2-4a0b-468f-8cd1-f4bc28467ed9 service swift] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:31:07.520732 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7d7e2-4a0b-468f-8cd1-f4bc28467ed9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:31:07.529170 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7d7e2-4a0b-468f-8cd1-f4bc28467ed9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:31:07.531462 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7d7e2-4a0b-468f-8cd1-f4bc28467ed9 service swift] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:31:07.539802 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1462/2947] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jun 1 18:31:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 18:31:17.472960 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=3 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:31:17.536343 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=32 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:31:41.091298 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffeb09-a9ba-4aab-8439-1447a637bd6a None None] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:31:41.144249 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffeb09-a9ba-4aab-8439-1447a637bd6a None None] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:31:41.147773 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700af69-f37b-44d2-8c74-ee2d3cebe775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:31:41.148435 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700af69-f37b-44d2-8c74-ee2d3cebe775 service neutron] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:31:41.148715 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700af69-f37b-44d2-8c74-ee2d3cebe775 service neutron] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:31:41.149026 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700af69-f37b-44d2-8c74-ee2d3cebe775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:31:41.158010 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700af69-f37b-44d2-8c74-ee2d3cebe775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:31:41.159418 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700af69-f37b-44d2-8c74-ee2d3cebe775 service neutron] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:31:41.168881 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1486/2948] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:31:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:31:51.164842 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=26 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:32:35.357228 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7d7e2-4a0b-468f-8cd1-f4bc28467ed9 service swift] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:32:35.367993 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7d7e2-4a0b-468f-8cd1-f4bc28467ed9 service swift] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:32:35.371696 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca3be2-f915-411f-96ee-6a53623b961f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4254398f2aac42f7b54f29294a73bfda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:32:35.372340 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca3be2-f915-411f-96ee-6a53623b961f service neutron] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:32:35.372622 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca3be2-f915-411f-96ee-6a53623b961f service neutron] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:32:35.372902 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca3be2-f915-411f-96ee-6a53623b961f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:32:35.374738 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-0fca3be2-f915-411f-96ee-6a53623b961f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:32:35.385092 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca3be2-f915-411f-96ee-6a53623b961f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:32:35.386570 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca3be2-f915-411f-96ee-6a53623b961f service neutron] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:32:35.394771 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1463/2949] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:32:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:32:45.391234 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=6 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:33:38.191055 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700af69-f37b-44d2-8c74-ee2d3cebe775 service neutron] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:33:38.192500 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-d700af69-f37b-44d2-8c74-ee2d3cebe775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:33:38.358650 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700af69-f37b-44d2-8c74-ee2d3cebe775 service neutron] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:33:38.365938 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd843e0-df8f-40d0-b55a-a6922746ae11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d5a5ba6aecd46e79dc7199589384a4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:33:38.366703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd843e0-df8f-40d0-b55a-a6922746ae11 service nova] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:33:38.366906 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd843e0-df8f-40d0-b55a-a6922746ae11 service nova] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:33:38.367192 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd843e0-df8f-40d0-b55a-a6922746ae11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:33:38.370336 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-7fd843e0-df8f-40d0-b55a-a6922746ae11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:33:38.384570 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd843e0-df8f-40d0-b55a-a6922746ae11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:33:38.386750 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd843e0-df8f-40d0-b55a-a6922746ae11 service nova] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:33:38.398607 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1487/2950] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:33:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:33:48.392945 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=53 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:33:48.580589 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799650ff-d70f-4ad7-892b-f693caa36377 None None] REQUEST_METHOD: `POST` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:33:48.584318 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799650ff-d70f-4ad7-892b-f693caa36377 None None] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:33:48.584318 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799650ff-d70f-4ad7-892b-f693caa36377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:33:48.610239 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.auth.core [None req-799650ff-d70f-4ad7-892b-f693caa36377 None None] MFA Rules not processed for user `253f9ffb48dd4eaab87aae5316fb5394`. Rule list: `[]` (Enabled: `True`). {{(pid=80427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 01 18:33:48.611441 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-799650ff-d70f-4ad7-892b-f693caa36377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:33:48.618600 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1464/2951] 10.222.0.33 () {58 vars in 967 bytes} [Wed Jun 1 18:33:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 01 18:33:48.658861 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd843e0-df8f-40d0-b55a-a6922746ae11 service nova] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:33:48.670852 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd843e0-df8f-40d0-b55a-a6922746ae11 service nova] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:33:48.675775 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec960b4-7b7a-4cc3-83db-a343271df52e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f43a4bb5a18445b8836f4613cd5e14b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:33:48.676414 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec960b4-7b7a-4cc3-83db-a343271df52e service swift] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:33:48.676697 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec960b4-7b7a-4cc3-83db-a343271df52e service swift] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:33:48.677011 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec960b4-7b7a-4cc3-83db-a343271df52e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:33:48.685246 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec960b4-7b7a-4cc3-83db-a343271df52e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:33:48.686819 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec960b4-7b7a-4cc3-83db-a343271df52e service swift] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:33:48.694668 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1488/2952] 10.222.0.33 () {60 vars in 1384 bytes} [Wed Jun 1 18:33:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 01 18:33:52.879157 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799650ff-d70f-4ad7-892b-f693caa36377 None None] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:33:52.880594 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-799650ff-d70f-4ad7-892b-f693caa36377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:33:52.956487 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799650ff-d70f-4ad7-892b-f693caa36377 None None] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:33:52.961533 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55637e-60e7-4899-9538-edf25767aacc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:33:52.962790 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55637e-60e7-4899-9538-edf25767aacc service placement] REQUEST_METHOD: `GET` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:33:52.963076 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55637e-60e7-4899-9538-edf25767aacc service placement] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:33:52.963361 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55637e-60e7-4899-9538-edf25767aacc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:33:52.965164 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-fe55637e-60e7-4899-9538-edf25767aacc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:33:52.976612 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55637e-60e7-4899-9538-edf25767aacc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:33:52.979019 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55637e-60e7-4899-9538-edf25767aacc service placement] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:33:52.994941 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1465/2953] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:33:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:33:56.781506 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec960b4-7b7a-4cc3-83db-a343271df52e service swift] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:33:56.866698 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec960b4-7b7a-4cc3-83db-a343271df52e service swift] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:33:56.872057 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c9e33-1a60-4c43-be79-e7c71d9a7430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:33:56.872954 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c9e33-1a60-4c43-be79-e7c71d9a7430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:33:56.873254 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c9e33-1a60-4c43-be79-e7c71d9a7430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:33:56.873531 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c9e33-1a60-4c43-be79-e7c71d9a7430 admin admin] PATH_INFO: `/v3/users/e037de8735324dc7b54282413474f7af` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:33:56.874703 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c9e33-1a60-4c43-be79-e7c71d9a7430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e037de8735324dc7b54282413474f7af)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:33:56.876629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c9e33-1a60-4c43-be79-e7c71d9a7430 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:33:57.166035 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e51c9e33-1a60-4c43-be79-e7c71d9a7430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e037de8735324dc7b54282413474f7af'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:57.243629 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e51c9e33-1a60-4c43-be79-e7c71d9a7430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e037de8735324dc7b54282413474f7af'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:57.250753 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e51c9e33-1a60-4c43-be79-e7c71d9a7430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e037de8735324dc7b54282413474f7af'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:57.251383 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e51c9e33-1a60-4c43-be79-e7c71d9a7430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e037de8735324dc7b54282413474f7af'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:57.263929 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-e51c9e33-1a60-4c43-be79-e7c71d9a7430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e037de8735324dc7b54282413474f7af'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:57.269812 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1489/2954] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:33:56 2022] DELETE /identity/v3/users/e037de8735324dc7b54282413474f7af => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:33:57.537158 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55637e-60e7-4899-9538-edf25767aacc service placement] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:33:57.548860 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55637e-60e7-4899-9538-edf25767aacc service placement] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:33:57.610456 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50415b-cbab-4285-818d-9e5daedb47eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:33:57.611326 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50415b-cbab-4285-818d-9e5daedb47eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:33:57.611614 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50415b-cbab-4285-818d-9e5daedb47eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:33:57.611901 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50415b-cbab-4285-818d-9e5daedb47eb admin admin] PATH_INFO: `/v3/projects/ccc839bf98c1422ba0d56f7359cab30d` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:33:57.614103 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50415b-cbab-4285-818d-9e5daedb47eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc839bf98c1422ba0d56f7359cab30d)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:33:57.615029 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50415b-cbab-4285-818d-9e5daedb47eb admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:33:57.714359 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bd50415b-cbab-4285-818d-9e5daedb47eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc839bf98c1422ba0d56f7359cab30d', 'request_id': 'req-bd50415b-cbab-4285-818d-9e5daedb47eb'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:57.720629 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bd50415b-cbab-4285-818d-9e5daedb47eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc839bf98c1422ba0d56f7359cab30d', 'request_id': 'req-bd50415b-cbab-4285-818d-9e5daedb47eb'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:57.781232 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bd50415b-cbab-4285-818d-9e5daedb47eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc839bf98c1422ba0d56f7359cab30d', 'request_id': 'req-bd50415b-cbab-4285-818d-9e5daedb47eb'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:57.793692 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:33:57.807372 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bd50415b-cbab-4285-818d-9e5daedb47eb admin admin] The token cache is being invalidate because project ccc839bf98c1422ba0d56f7359cab30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:33:57.807665 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bd50415b-cbab-4285-818d-9e5daedb47eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:57.808301 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-bd50415b-cbab-4285-818d-9e5daedb47eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:57.809881 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1466/2955] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:33:57 2022] DELETE /identity/v3/projects/ccc839bf98c1422ba0d56f7359cab30d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:33:57.813815 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c9e33-1a60-4c43-be79-e7c71d9a7430 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:33:57.815208 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-e51c9e33-1a60-4c43-be79-e7c71d9a7430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:33:57.828219 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c9e33-1a60-4c43-be79-e7c71d9a7430 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:33:57.872505 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:33:57.883763 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86fb99-f553-4b2d-89be-0ecc8b34e924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:33:57.884642 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86fb99-f553-4b2d-89be-0ecc8b34e924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:33:57.885003 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86fb99-f553-4b2d-89be-0ecc8b34e924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:33:57.885236 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86fb99-f553-4b2d-89be-0ecc8b34e924 admin admin] PATH_INFO: `/v3/users/43d1b94c017d4a83a28a569d7154fc79` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:33:57.886427 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86fb99-f553-4b2d-89be-0ecc8b34e924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d1b94c017d4a83a28a569d7154fc79)` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:33:57.888353 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86fb99-f553-4b2d-89be-0ecc8b34e924 admin admin] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:33:58.029228 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-5e86fb99-f553-4b2d-89be-0ecc8b34e924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d1b94c017d4a83a28a569d7154fc79'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:58.083730 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-5e86fb99-f553-4b2d-89be-0ecc8b34e924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d1b94c017d4a83a28a569d7154fc79'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:58.091901 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-5e86fb99-f553-4b2d-89be-0ecc8b34e924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d1b94c017d4a83a28a569d7154fc79'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:58.092592 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-5e86fb99-f553-4b2d-89be-0ecc8b34e924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d1b94c017d4a83a28a569d7154fc79'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:58.105363 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.notifications [None req-5e86fb99-f553-4b2d-89be-0ecc8b34e924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d1b94c017d4a83a28a569d7154fc79'} {{(pid=80426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:58.111267 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1490/2956] 10.222.0.33 () {58 vars in 1223 bytes} [Wed Jun 1 18:33:57 2022] DELETE /identity/v3/users/43d1b94c017d4a83a28a569d7154fc79 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:33:58.354709 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50415b-cbab-4285-818d-9e5daedb47eb admin admin] Authenticating user token {{(pid=80427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:33:58.356185 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.fernet_utils [None req-bd50415b-cbab-4285-818d-9e5daedb47eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:33:58.369286 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50415b-cbab-4285-818d-9e5daedb47eb admin admin] Validating token access rules against request {{(pid=80427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:33:58.568015 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac81b04-3090-41c2-acb6-49cfe06938ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e43dc5addf4a3b9b9bacb5e1aa59a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ab5b23ebc224a5b9dd9616b70ea67bd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:33:58.568873 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac81b04-3090-41c2-acb6-49cfe06938ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:33:58.569205 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac81b04-3090-41c2-acb6-49cfe06938ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:33:58.569483 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac81b04-3090-41c2-acb6-49cfe06938ab admin admin] PATH_INFO: `/v3/projects/21f4b7856dde4dd8938a1cb7f9cc627c` {{(pid=80427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:33:58.570661 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac81b04-3090-41c2-acb6-49cfe06938ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f4b7856dde4dd8938a1cb7f9cc627c)` {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:33:58.573201 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac81b04-3090-41c2-acb6-49cfe06938ab admin admin] RBAC: Authorization granted {{(pid=80427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:33:58.683755 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6ac81b04-3090-41c2-acb6-49cfe06938ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f4b7856dde4dd8938a1cb7f9cc627c', 'request_id': 'req-6ac81b04-3090-41c2-acb6-49cfe06938ab'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:58.689748 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6ac81b04-3090-41c2-acb6-49cfe06938ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f4b7856dde4dd8938a1cb7f9cc627c', 'request_id': 'req-6ac81b04-3090-41c2-acb6-49cfe06938ab'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:58.758156 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6ac81b04-3090-41c2-acb6-49cfe06938ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f4b7856dde4dd8938a1cb7f9cc627c', 'request_id': 'req-6ac81b04-3090-41c2-acb6-49cfe06938ab'} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:58.769246 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6ac81b04-3090-41c2-acb6-49cfe06938ab admin admin] The token cache is being invalidate because project 21f4b7856dde4dd8938a1cb7f9cc627c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 01 18:33:58.769537 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6ac81b04-3090-41c2-acb6-49cfe06938ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:58.770197 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG keystone.notifications [None req-6ac81b04-3090-41c2-acb6-49cfe06938ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 01 18:33:58.771761 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: [pid: 80427|app: 0|req: 1467/2957] 10.222.0.33 () {58 vars in 1232 bytes} [Wed Jun 1 18:33:58 2022] DELETE /identity/v3/projects/21f4b7856dde4dd8938a1cb7f9cc627c => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 01 18:34:08.107773 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:34:08.766245 dv-cinder-797608-23-iscsi devstack@keystone.service[80427]: DEBUG dbcounter [-] [80427] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 01 18:34:54.695070 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86fb99-f553-4b2d-89be-0ecc8b34e924 admin admin] Authenticating user token {{(pid=80426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 01 18:34:54.696487 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-5e86fb99-f553-4b2d-89be-0ecc8b34e924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:34:54.777746 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86fb99-f553-4b2d-89be-0ecc8b34e924 admin admin] Validating token access rules against request {{(pid=80426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 01 18:34:54.835212 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da900011-6ed0-4fe5-ab78-374485c3a34e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae952b30dffa450e97ce4a73da8d00f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68bf9a1e88a64a02ba53d0bedb76072a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 01 18:34:54.835859 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da900011-6ed0-4fe5-ab78-374485c3a34e service placement] REQUEST_METHOD: `GET` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 01 18:34:54.836137 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da900011-6ed0-4fe5-ab78-374485c3a34e service placement] SCRIPT_NAME: `/identity` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 01 18:34:54.836410 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da900011-6ed0-4fe5-ab78-374485c3a34e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 01 18:34:54.838178 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.fernet_utils [None req-da900011-6ed0-4fe5-ab78-374485c3a34e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 01 18:34:54.849596 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da900011-6ed0-4fe5-ab78-374485c3a34e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 01 18:34:54.851163 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da900011-6ed0-4fe5-ab78-374485c3a34e service placement] RBAC: Authorization granted {{(pid=80426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 01 18:34:54.861498 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: [pid: 80426|app: 0|req: 1491/2958] 10.222.0.33 () {60 vars in 1365 bytes} [Wed Jun 1 18:34:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 01 18:35:04.857322 dv-cinder-797608-23-iscsi devstack@keystone.service[80426]: DEBUG dbcounter [-] [80426] Writing DB stats keystone:SELECT=63 {{(pid=80426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}